2023-09-29T23:08:13.868 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-29T23:08:13.868 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi --description rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} --owner scheduled_yuriw@teuthology --verbose --archive /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406546 -- /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406546/orig.config.yaml 2023-09-29T23:08:13.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T23:08:13.978 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406546 branch: wip-yuri4-testing-2023-09-29-0928-quincy description: rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} email: yweinste@redhat.com first_in_suite: false job_id: '7406546' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri4-testing-2023-09-29-0928-quincy ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore zero block detection: true debug ms: 1 debug osd: 20 osd debug verify cached snaps: true osd debug verify missing on start: true osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd op queue: debug_random osd op queue cut off: debug_random flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 93dce5e17918f8aca65993a7a2dc40233a47b481 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 93dce5e17918f8aca65993a7a2dc40233a47b481 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-yuri4-testing-2023-09-29-0928-quincy sha1: 93dce5e17918f8aca65993a7a2dc40233a47b481 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - osd.0 - osd.1 - osd.2 - client.0 - client.1 seed: 9810 sha1: 93dce5e17918f8aca65993a7a2dc40233a47b481 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri4-testing-2023-09-29-0928-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 93dce5e17918f8aca65993a7a2dc40233a47b481 targets: smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMhfltsGKpUmCXl1oABVs8wfFdkdTW1lrepqc4TEsJ0l5wV1QeJJcASKfZIDDGp5/pPXF1kFdXK18YfJGJ0MCzk= tasks: - install: null - ceph: conf: global: debug client: 20 debug mds: 20 debug ms: 1 osd max object name len: 460 osd max object namespace len: 64 log-ignorelist: - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force - exec: client.0: - ceph osd pool create data_cache 4 - ceph osd tier add cephfs_data data_cache - ceph osd tier cache-mode data_cache writeback - ceph osd tier set-overlay cephfs_data data_cache - ceph osd pool set data_cache hit_set_type bloom - ceph osd pool set data_cache hit_set_count 8 - ceph osd pool set data_cache hit_set_period 3600 - ceph osd pool set data_cache min_read_recency_for_promote 0 - ceph-fuse: null - exec: client.0: - sudo chmod 777 $TESTDIR/mnt.0/ - dd if=/dev/urandom of=$TESTDIR/mnt.0/foo bs=1M count=5 - ls -al $TESTDIR/mnt.0/foo - truncate --size 0 $TESTDIR/mnt.0/foo - ls -al $TESTDIR/mnt.0/foo - dd if=/dev/urandom of=$TESTDIR/mnt.0/foo bs=1M count=5 - ls -al $TESTDIR/mnt.0/foo - cp $TESTDIR/mnt.0/foo /tmp/foo - sync - rados -p data_cache ls - - sleep 10 - rados -p data_cache ls - - rados -p data_cache cache-flush-evict-all - rados -p data_cache ls - - sleep 1 - exec: client.1: - hexdump -C /tmp/foo | head - hexdump -C $TESTDIR/mnt.1/foo | head - cmp $TESTDIR/mnt.1/foo /tmp/foo teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-29_19:38:56 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-09-29T23:08:13.979 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa; will attempt to use it 2023-09-29T23:08:13.979 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks 2023-09-29T23:08:13.979 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-29T23:08:13.981 INFO:teuthology.task.internal:Checking packages... 2023-09-29T23:08:14.003 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '93dce5e17918f8aca65993a7a2dc40233a47b481' 2023-09-29T23:08:14.004 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-29T23:08:14.004 INFO:teuthology.packaging:ref: None 2023-09-29T23:08:14.004 INFO:teuthology.packaging:tag: None 2023-09-29T23:08:14.004 INFO:teuthology.packaging:branch: wip-yuri4-testing-2023-09-29-0928-quincy 2023-09-29T23:08:14.004 INFO:teuthology.packaging:sha1: 93dce5e17918f8aca65993a7a2dc40233a47b481 2023-09-29T23:08:14.004 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri4-testing-2023-09-29-0928-quincy 2023-09-29T23:08:14.281 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1165.g93dce5e1 2023-09-29T23:08:14.281 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-29T23:08:14.289 INFO:teuthology.task.internal:no buildpackages task found 2023-09-29T23:08:14.289 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-29T23:08:14.306 INFO:teuthology.task.internal:Saving configuration 2023-09-29T23:08:14.318 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-29T23:08:14.325 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-29T23:08:14.351 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406546', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 23:03:18.197746', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMhfltsGKpUmCXl1oABVs8wfFdkdTW1lrepqc4TEsJ0l5wV1QeJJcASKfZIDDGp5/pPXF1kFdXK18YfJGJ0MCzk='} 2023-09-29T23:08:14.351 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-29T23:08:14.362 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'client.0', 'client.1'] 2023-09-29T23:08:14.363 INFO:teuthology.run_tasks:Running task console_log... 2023-09-29T23:08:14.409 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1904419ee0>, signals=[15]) 2023-09-29T23:08:14.410 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-29T23:08:14.421 INFO:teuthology.task.internal:Opening connections... 2023-09-29T23:08:14.421 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2023-09-29T23:08:14.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:08:14.492 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-29T23:08:14.503 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-09-29T23:08:14.520 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-09-29T23:08:14.521 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-09-29T23:08:14.576 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-09-29T23:08:14.576 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.4 (Ootpa)" 2023-09-29T23:08:14.576 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-09-29T23:08:14.577 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-09-29T23:08:14.577 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.4" 2023-09-29T23:08:14.577 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-09-29T23:08:14.577 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-29T23:08:14.577 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-09-29T23:08:14.577 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-29T23:08:14.577 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-09-29T23:08:14.577 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-29T23:08:14.577 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-29T23:08:14.577 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:08:14.577 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-29T23:08:14.578 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-29T23:08:14.578 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-29T23:08:14.578 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-29T23:08:14.578 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-09-29T23:08:14.599 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-29T23:08:14.609 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-29T23:08:14.620 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-29T23:08:14.620 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2023-09-29T23:08:14.636 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-29T23:08:14.647 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-29T23:08:14.647 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2023-09-29T23:08:14.692 INFO:teuthology.orchestra.run.smithi092.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-09-29T23:08:14.693 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-29T23:08:14.732 INFO:teuthology.run_tasks:Running task kernel... 2023-09-29T23:08:14.751 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-09-29T23:08:14.751 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-09-29T23:08:14.752 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-29T23:08:14.767 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-29T23:08:14.767 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2023-09-29T23:08:14.823 INFO:teuthology.orchestra.run.smithi092.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-09-29T23:08:14.823 INFO:teuthology.task.kernel:Running kernel on smithi092: 4.18.0-305.25.1.el8_4.x86_64 2023-09-29T23:08:14.823 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum install -y kernel 2023-09-29T23:08:16.217 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:08:16.218 INFO:teuthology.orchestra.run.smithi092.stdout:Unable to read consumer identity 2023-09-29T23:08:17.598 INFO:teuthology.orchestra.run.smithi092.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-09-29T23:08:18.164 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 30 MB/s | 16 MB 00:00 2023-09-29T23:08:21.678 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 3.8 MB/s | 24 kB 00:00 2023-09-29T23:08:22.396 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-09-29T23:08:22.396 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-09-29T23:08:22.397 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-09-29T23:08:22.556 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:08:22.557 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2023-09-29T23:08:22.557 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:08:22.669 DEBUG:teuthology.orchestra.run.smithi092:> echo no | sudo yum reinstall kernel || true 2023-09-29T23:08:23.010 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:08:23.011 INFO:teuthology.orchestra.run.smithi092.stdout:Unable to read consumer identity 2023-09-29T23:08:23.303 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:02 ago on Fri 29 Sep 2023 11:08:21 PM UTC. 2023-09-29T23:08:23.426 INFO:teuthology.orchestra.run.smithi092.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-09-29T23:08:23.427 INFO:teuthology.orchestra.run.smithi092.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-09-29T23:08:23.427 INFO:teuthology.orchestra.run.smithi092.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-09-29T23:08:23.453 INFO:teuthology.orchestra.run.smithi092.stderr:Error: No packages marked for reinstall. 2023-09-29T23:08:23.503 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum reinstall -y kernel || true 2023-09-29T23:08:23.845 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:08:23.845 INFO:teuthology.orchestra.run.smithi092.stdout:Unable to read consumer identity 2023-09-29T23:08:24.140 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:03 ago on Fri 29 Sep 2023 11:08:21 PM UTC. 2023-09-29T23:08:24.285 INFO:teuthology.orchestra.run.smithi092.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-09-29T23:08:24.285 INFO:teuthology.orchestra.run.smithi092.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-09-29T23:08:24.285 INFO:teuthology.orchestra.run.smithi092.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-09-29T23:08:24.323 INFO:teuthology.orchestra.run.smithi092.stderr:Error: No packages marked for reinstall. 2023-09-29T23:08:24.378 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2023-09-29T23:08:24.502 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-09-29T23:08:24.502 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-09-29T23:08:24.502 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-09-29T23:08:24.503 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-29T23:08:24.503 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-29T23:08:24.503 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-09-29T23:08:24.503 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi092.front.sepia.ceph.com, path=None, version=distro) 2023-09-29T23:08:24.503 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2023-09-29T23:08:24.628 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-09-29T23:08:24.628 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-09-29T23:08:24.628 DEBUG:teuthology.orchestra.run.smithi092:> sudo rpm -qi grub2-tools 2023-09-29T23:08:24.655 INFO:teuthology.orchestra.run.smithi092.stdout:Name : grub2-tools 2023-09-29T23:08:24.655 INFO:teuthology.orchestra.run.smithi092.stdout:Epoch : 1 2023-09-29T23:08:24.655 INFO:teuthology.orchestra.run.smithi092.stdout:Version : 2.02 2023-09-29T23:08:24.655 INFO:teuthology.orchestra.run.smithi092.stdout:Release : 99.el8_4.1 2023-09-29T23:08:24.655 INFO:teuthology.orchestra.run.smithi092.stdout:Architecture: x86_64 2023-09-29T23:08:24.655 INFO:teuthology.orchestra.run.smithi092.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-09-29T23:08:24.656 INFO:teuthology.orchestra.run.smithi092.stdout:Group : System Environment/Base 2023-09-29T23:08:24.656 INFO:teuthology.orchestra.run.smithi092.stdout:Size : 9264631 2023-09-29T23:08:24.656 INFO:teuthology.orchestra.run.smithi092.stdout:License : GPLv3+ 2023-09-29T23:08:24.656 INFO:teuthology.orchestra.run.smithi092.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-09-29T23:08:24.656 INFO:teuthology.orchestra.run.smithi092.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-09-29T23:08:24.656 INFO:teuthology.orchestra.run.smithi092.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-09-29T23:08:24.656 INFO:teuthology.orchestra.run.smithi092.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-09-29T23:08:24.656 INFO:teuthology.orchestra.run.smithi092.stdout:Relocations : (not relocatable) 2023-09-29T23:08:24.656 INFO:teuthology.orchestra.run.smithi092.stdout:Packager : Red Hat, Inc. 2023-09-29T23:08:24.656 INFO:teuthology.orchestra.run.smithi092.stdout:Vendor : Red Hat, Inc. 2023-09-29T23:08:24.656 INFO:teuthology.orchestra.run.smithi092.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-29T23:08:24.657 INFO:teuthology.orchestra.run.smithi092.stdout:Summary : Support tools for GRUB. 2023-09-29T23:08:24.657 INFO:teuthology.orchestra.run.smithi092.stdout:Description : 2023-09-29T23:08:24.657 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:08:24.657 INFO:teuthology.orchestra.run.smithi092.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-29T23:08:24.657 INFO:teuthology.orchestra.run.smithi092.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-29T23:08:24.657 INFO:teuthology.orchestra.run.smithi092.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-29T23:08:24.657 INFO:teuthology.orchestra.run.smithi092.stdout:hardware devices. 2023-09-29T23:08:24.657 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:08:24.657 INFO:teuthology.orchestra.run.smithi092.stdout:This subpackage provides tools for support of all platforms. 2023-09-29T23:08:24.658 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-29T23:08:24.658 INFO:teuthology.task.kernel:Updating grub on smithi092 to boot 4.18.0-425.3.1.el8.x86_64 2023-09-29T23:08:24.658 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-29T23:08:26.044 INFO:teuthology.orchestra.run.smithi092.stderr:Generating grub configuration file ... 2023-09-29T23:08:28.205 INFO:teuthology.orchestra.run.smithi092.stderr:done 2023-09-29T23:08:28.207 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2023-09-29T23:08:28.230 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.npbxtSetpa 2023-09-29T23:08:28.231 DEBUG:teuthology.orchestra.run.smithi092:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.npbxtSetpa 2023-09-29T23:08:28.307 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.npbxtSetpa 2023-09-29T23:08:28.482 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.npbxtSetpa is 6KB 2023-09-29T23:08:28.531 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.npbxtSetpa 2023-09-29T23:08:28.544 DEBUG:teuthology.orchestra.run.smithi092:> sudo /bin/ls /boot/loader/entries || true 2023-09-29T23:08:28.613 INFO:teuthology.orchestra.run.smithi092.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-09-29T23:08:28.613 INFO:teuthology.orchestra.run.smithi092.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-09-29T23:08:28.614 INFO:teuthology.orchestra.run.smithi092.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-09-29T23:08:28.614 INFO:teuthology.orchestra.run.smithi092.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-09-29T23:08:28.615 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-09-29T23:08:28.775 DEBUG:teuthology.orchestra.run.smithi092:> sudo shutdown -r now 2023-09-29T23:08:58.806 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-09-29T23:08:58.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-09-29T23:08:58.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:09:17.306 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-09-29T23:09:26.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-09-29T23:09:26.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:09:29.370 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-09-29T23:09:41.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-09-29T23:09:41.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:10:13.253 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-09-29T23:10:13.690 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-09-29T23:10:13.691 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-425.3.1.el8.x86_64"... 2023-09-29T23:10:13.691 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2023-09-29T23:10:13.705 INFO:teuthology.orchestra.run.smithi092.stdout:4.18.0-425.3.1.el8.x86_64 2023-09-29T23:10:13.705 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-09-29T23:10:13.705 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-29T23:10:13.705 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-09-29T23:10:14.707 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-09-29T23:10:14.707 DEBUG:teuthology.orchestra.run.smithi092:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-29T23:10:15.387 INFO:teuthology.orchestra.run.smithi092.stdout:ttyS1 2023-09-29T23:10:15.426 DEBUG:teuthology.parallel:result is None 2023-09-29T23:10:15.427 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-29T23:10:15.434 INFO:teuthology.task.internal:Creating test directory... 2023-09-29T23:10:15.434 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-29T23:10:15.579 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-29T23:10:15.587 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-29T23:10:15.597 INFO:teuthology.task.internal:Creating archive directory... 2023-09-29T23:10:15.597 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-29T23:10:15.901 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-29T23:10:15.909 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-29T23:10:15.909 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-29T23:10:16.196 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-29T23:10:16.318 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-29T23:10:16.340 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-29T23:10:16.347 INFO:teuthology.task.internal:Configuring sudo... 2023-09-29T23:10:16.347 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-29T23:10:16.681 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-29T23:10:16.689 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-29T23:10:16.690 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-29T23:10:16.720 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-29T23:10:16.803 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-29T23:10:16.842 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-29T23:10:16.924 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-29T23:10:16.964 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:10:16.964 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-29T23:10:17.030 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2023-09-29T23:10:17.194 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-29T23:10:17.468 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-29T23:10:17.476 INFO:teuthology.task.internal:Starting timer... 2023-09-29T23:10:17.476 INFO:teuthology.run_tasks:Running task pcp... 2023-09-29T23:10:17.496 INFO:teuthology.run_tasks:Running task selinux... 2023-09-29T23:10:17.506 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-09-29T23:10:17.507 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2023-09-29T23:10:17.761 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: [ OK ] 2023-09-29T23:10:17.764 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-29T23:10:17.764 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2023-09-29T23:10:17.784 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2023-09-29T23:10:17.784 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi092.front.sepia.ceph.com': 'permissive'} 2023-09-29T23:10:17.784 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-29T23:10:17.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-29T23:10:17.850 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-29T23:10:17.850 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2023-09-29T23:10:17.914 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-29T23:10:17.923 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-09-29T23:10:17.928 INFO:teuthology.repo_utils:Fetching main from origin 2023-09-29T23:10:18.128 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-29T23:10:18.143 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-29T23:10:18.144 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi092.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-29T23:18:39.837 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi092.front.sepia.ceph.com')] 2023-09-29T23:18:39.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-09-29T23:18:39.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T23:18:39.909 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-09-29T23:18:39.931 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-09-29T23:18:39.931 INFO:teuthology.run_tasks:Running task clock... 2023-09-29T23:18:39.944 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-29T23:18:39.945 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-29T23:18:39.945 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-29T23:18:39.999 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-29T23:18:40.013 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-29T23:18:40.054 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2023-09-29T23:18:40.064 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2023-09-29T23:18:40.077 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-29T23:18:40.091 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-29T23:18:40.167 INFO:teuthology.orchestra.run.smithi092.stderr:bash: ntpq: command not found 2023-09-29T23:18:40.170 INFO:teuthology.orchestra.run.smithi092.stdout:210 Number of sources = 4 2023-09-29T23:18:40.170 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-29T23:18:40.170 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2023-09-29T23:18:40.170 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-29T23:18:40.170 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-29T23:18:40.170 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-29T23:18:40.170 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-29T23:18:40.171 INFO:teuthology.run_tasks:Running task install... 2023-09-29T23:18:40.178 DEBUG:teuthology.task.install:project ceph 2023-09-29T23:18:40.179 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481'}} 2023-09-29T23:18:40.179 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481'} 2023-09-29T23:18:40.179 INFO:teuthology.task.install:Using flavor: default 2023-09-29T23:18:40.184 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-29T23:18:40.184 INFO:teuthology.task.install:extra packages: [] 2023-09-29T23:18:40.185 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481', 'tag': None, 'wait_for_package': False} 2023-09-29T23:18:40.185 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=93dce5e17918f8aca65993a7a2dc40233a47b481 2023-09-29T23:18:40.408 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/centos/8/flavors/default/ 2023-09-29T23:18:40.408 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1165.g93dce5e1 2023-09-29T23:18:40.572 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-29T23:18:40.572 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:18:40.572 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-29T23:18:40.597 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-09-29T23:18:40.598 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/93dce5e17918f8aca65993a7a2dc40233a47b481/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-29T23:18:40.664 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-29T23:18:40.738 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-29T23:18:40.803 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2023-09-29T23:18:40.805 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2023-09-29T23:18:41.195 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:18:41.503 INFO:teuthology.orchestra.run.smithi092.stdout:44 files removed 2023-09-29T23:18:41.559 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw 2023-09-29T23:18:41.908 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:18:42.658 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 252 kB/s | 78 kB 00:00 2023-09-29T23:18:42.938 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 38 kB/s | 9.2 kB 00:00 2023-09-29T23:18:43.208 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 6.1 kB/s | 1.5 kB 00:00 2023-09-29T23:18:43.320 INFO:teuthology.orchestra.run.smithi092.stdout:Copr repo for python3-asyncssh owned by ceph 42 kB/s | 3.5 kB 00:00 2023-09-29T23:18:44.155 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-09-29T23:18:47.508 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 1.7 MB/s | 24 kB 00:00 2023-09-29T23:18:47.890 INFO:teuthology.orchestra.run.smithi092.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 127 MB/s | 38 MB 00:00 2023-09-29T23:18:53.433 INFO:teuthology.orchestra.run.smithi092.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 121 MB/s | 33 MB 00:00 2023-09-29T23:19:01.967 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:19:01.970 INFO:teuthology.orchestra.run.smithi092.stdout:==================================================================================================== 2023-09-29T23:19:01.970 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-09-29T23:19:01.970 INFO:teuthology.orchestra.run.smithi092.stdout:==================================================================================================== 2023-09-29T23:19:01.970 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-09-29T23:19:01.970 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 17 M 2023-09-29T23:19:01.970 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2023-09-29T23:19:01.970 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 3.5 M 2023-09-29T23:19:01.970 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 3.6 M 2023-09-29T23:19:01.970 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-09-29T23:19:01.970 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 5.2 M 2023-09-29T23:19:01.971 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 23 M 2023-09-29T23:19:01.971 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 24 k 2023-09-29T23:19:01.971 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-29T23:19:01.971 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 796 k 2023-09-29T23:19:01.971 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-29T23:19:01.971 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-29T23:19:01.971 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 506 k 2023-09-29T23:19:01.971 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-09-29T23:19:01.971 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 5.6 M 2023-09-29T23:19:01.971 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-29T23:19:01.972 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-29T23:19:01.972 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 45 k 2023-09-29T23:19:01.972 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 115 k 2023-09-29T23:19:01.972 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 190 k 2023-09-29T23:19:01.972 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-29T23:19:01.972 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 370 k 2023-09-29T23:19:01.972 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 358 k 2023-09-29T23:19:01.972 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 107 k 2023-09-29T23:19:01.972 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-29T23:19:01.972 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:19:01.972 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-09-29T23:19:01.972 INFO:teuthology.orchestra.run.smithi092.stdout:==================================================================================================== 2023-09-29T23:19:01.973 INFO:teuthology.orchestra.run.smithi092.stdout:Install 21 Packages 2023-09-29T23:19:01.973 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 2 Packages 2023-09-29T23:19:01.973 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:19:01.973 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 63 M 2023-09-29T23:19:01.973 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-09-29T23:19:03.372 INFO:teuthology.orchestra.run.smithi092.stdout:(1/23): ceph-base-17.2.6-1165.g93dce5e1.el8.x86 3.9 MB/s | 5.2 MB 00:01 2023-09-29T23:19:03.446 INFO:teuthology.orchestra.run.smithi092.stdout:(2/23): ceph-selinux-17.2.6-1165.g93dce5e1.el8. 334 kB/s | 24 kB 00:00 2023-09-29T23:19:03.628 INFO:teuthology.orchestra.run.smithi092.stdout:(3/23): libcephfs2-17.2.6-1165.g93dce5e1.el8.x8 4.3 MB/s | 796 kB 00:00 2023-09-29T23:19:03.733 INFO:teuthology.orchestra.run.smithi092.stdout:(4/23): ceph-radosgw-17.2.6-1165.g93dce5e1.el8. 9.9 MB/s | 17 MB 00:01 2023-09-29T23:19:03.768 INFO:teuthology.orchestra.run.smithi092.stdout:(5/23): libradosstriper1-17.2.6-1165.g93dce5e1. 3.5 MB/s | 506 kB 00:00 2023-09-29T23:19:03.858 INFO:teuthology.orchestra.run.smithi092.stdout:(6/23): python3-ceph-argparse-17.2.6-1165.g93dc 492 kB/s | 45 kB 00:00 2023-09-29T23:19:04.129 INFO:teuthology.orchestra.run.smithi092.stdout:(7/23): ceph-common-17.2.6-1165.g93dce5e1.el8.x 11 MB/s | 23 MB 00:02 2023-09-29T23:19:04.228 INFO:teuthology.orchestra.run.smithi092.stdout:(8/23): librgw2-17.2.6-1165.g93dce5e1.el8.x86_6 11 MB/s | 5.6 MB 00:00 2023-09-29T23:19:04.229 INFO:teuthology.orchestra.run.smithi092.stdout:(9/23): python3-cephfs-17.2.6-1165.g93dce5e1.el 1.9 MB/s | 190 kB 00:00 2023-09-29T23:19:04.253 INFO:teuthology.orchestra.run.smithi092.stdout:(10/23): python3-rados-17.2.6-1165.g93dce5e1.el 15 MB/s | 370 kB 00:00 2023-09-29T23:19:04.275 INFO:teuthology.orchestra.run.smithi092.stdout:(11/23): python3-rbd-17.2.6-1165.g93dce5e1.el8. 7.7 MB/s | 358 kB 00:00 2023-09-29T23:19:04.275 INFO:teuthology.orchestra.run.smithi092.stdout:(12/23): python3-rgw-17.2.6-1165.g93dce5e1.el8. 4.6 MB/s | 107 kB 00:00 2023-09-29T23:19:04.528 INFO:teuthology.orchestra.run.smithi092.stdout:(13/23): python3-ceph-common-17.2.6-1165.g93dce 172 kB/s | 115 kB 00:00 2023-09-29T23:19:04.771 INFO:teuthology.orchestra.run.smithi092.stdout:(14/23): liboath-2.6.2-3.el8.x86_64.rpm 119 kB/s | 59 kB 00:00 2023-09-29T23:19:05.017 INFO:teuthology.orchestra.run.smithi092.stdout:(15/23): libunwind-1.3.1-3.el8.x86_64.rpm 153 kB/s | 75 kB 00:00 2023-09-29T23:19:05.055 INFO:teuthology.orchestra.run.smithi092.stdout:(16/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.2 MB/s | 47 kB 00:00 2023-09-29T23:19:05.086 INFO:teuthology.orchestra.run.smithi092.stdout:(17/23): gperftools-libs-2.7-9.el8.x86_64.rpm 377 kB/s | 306 kB 00:00 2023-09-29T23:19:05.088 INFO:teuthology.orchestra.run.smithi092.stdout:(18/23): python3-prettytable-0.7.2-14.el8.noarc 1.3 MB/s | 44 kB 00:00 2023-09-29T23:19:05.121 INFO:teuthology.orchestra.run.smithi092.stdout:(19/23): librdkafka-0.11.4-1.el8.x86_64.rpm 11 MB/s | 353 kB 00:00 2023-09-29T23:19:05.145 INFO:teuthology.orchestra.run.smithi092.stdout:(20/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-09-29T23:19:05.422 INFO:teuthology.orchestra.run.smithi092.stdout:(21/23): librbd1-17.2.6-1165.g93dce5e1.el8.x86_ 13 MB/s | 3.6 MB 00:00 2023-09-29T23:19:05.577 INFO:teuthology.orchestra.run.smithi092.stdout:(22/23): librados2-17.2.6-1165.g93dce5e1.el8.x8 7.6 MB/s | 3.5 MB 00:00 2023-09-29T23:19:06.947 INFO:teuthology.orchestra.run.smithi092.stdout:(23/23): thrift-0.13.0-2.el8.x86_64.rpm 816 kB/s | 1.7 MB 00:02 2023-09-29T23:19:06.954 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-09-29T23:19:06.954 INFO:teuthology.orchestra.run.smithi092.stdout:Total 13 MB/s | 63 MB 00:04 2023-09-29T23:19:06.959 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-09-29T23:19:07.005 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-09-29T23:19:07.005 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-09-29T23:19:07.768 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-09-29T23:19:07.772 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-09-29T23:19:08.951 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-09-29T23:19:09.171 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 1/25 2023-09-29T23:19:09.563 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 1/25 2023-09-29T23:19:09.805 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:17.2.6-1165.g93dce5e1.el8.x86_64 2/25 2023-09-29T23:19:09.916 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:17.2.6-1165.g93dce5e1.el8.x86_64 2/25 2023-09-29T23:19:10.136 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:17.2.6-1165.g93dce5e1.el8.x86_64 3/25 2023-09-29T23:19:10.430 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/25 2023-09-29T23:19:10.655 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:17.2.6-1165.g93dce5e1.el8.x86_64 5/25 2023-09-29T23:19:11.037 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:17.2.6-1165.g93dce5e1.el8.x86_64 5/25 2023-09-29T23:19:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:17.2.6-1165.g93dce5e1.el8.x86_64 6/25 2023-09-29T23:19:11.382 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:17.2.6-1165.g93dce5e1.el8.x86_64 6/25 2023-09-29T23:19:11.563 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 7/25 2023-09-29T23:19:11.633 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 7/25 2023-09-29T23:19:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2023-09-29T23:19:12.681 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/25 2023-09-29T23:19:12.871 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:17.2.6-1165.g93dce5e1.el8.x86_64 10/25 2023-09-29T23:19:12.953 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:17.2.6-1165.g93dce5e1.el8.x86_64 10/25 2023-09-29T23:19:13.115 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:17.2.6-1165.g93dce5e1.el8. 11/25 2023-09-29T23:19:13.324 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:17.2.6-1165.g93dce5e1.el8.x86_64 12/25 2023-09-29T23:19:13.581 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:17.2.6-1165.g93dce5e1.el8.x86_64 13/25 2023-09-29T23:19:13.849 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:17.2.6-1165.g93dce5e1.el8.x86_64 14/25 2023-09-29T23:19:14.046 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:17.2.6-1165.g93dce5e1.el8.x86_6 15/25 2023-09-29T23:19:14.117 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1165.g93dce5e1.el8.x86_6 15/25 2023-09-29T23:19:14.347 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-09-29T23:19:14.572 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/25 2023-09-29T23:19:14.842 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-09-29T23:19:15.038 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:17.2.6-1165.g93dce5e1.el8.x8 19/25 2023-09-29T23:19:20.214 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:17.2.6-1165.g93dce5e1.el8.x86_64 20/25 2023-09-29T23:19:20.469 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:17.2.6-1165.g93dce5e1.el8.x86_64 20/25 2023-09-29T23:19:21.080 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:17.2.6-1165.g93dce5e1.el8.x86_64 20/25 2023-09-29T23:19:21.981 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:17.2.6-1165.g93dce5e1.el8.x86_64 21/25 2023-09-29T23:19:22.062 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:17.2.6-1165.g93dce5e1.el8.x86_64 21/25 2023-09-29T23:19:22.210 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:17.2.6-1165.g93dce5e1.el8.x86_64 22/25 2023-09-29T23:19:40.194 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1165.g93dce5e1.el8.x86_64 22/25 2023-09-29T23:19:40.194 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2023-09-29T23:19:40.194 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2023-09-29T23:19:40.194 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2023-09-29T23:19:40.194 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /run 2023-09-29T23:19:40.195 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2023-09-29T23:19:40.195 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2023-09-29T23:19:40.195 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2023-09-29T23:19:40.195 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2023-09-29T23:19:40.195 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2023-09-29T23:19:40.195 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:19:41.918 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:17.2.6-1165.g93dce5e1.el8.x86_64 23/25 2023-09-29T23:19:41.988 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1165.g93dce5e1.el8.x86_64 23/25 2023-09-29T23:19:41.988 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-09-29T23:19:42.225 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-09-29T23:19:42.225 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-09-29T23:19:43.041 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-09-29T23:19:43.041 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/25 2023-09-29T23:19:43.041 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:17.2.6-1165.g93dce5e1.el8.x86_64 2/25 2023-09-29T23:19:43.041 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:17.2.6-1165.g93dce5e1.el8.x86_64 3/25 2023-09-29T23:19:43.041 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:17.2.6-1165.g93dce5e1.el8.x86_64 4/25 2023-09-29T23:19:43.041 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:17.2.6-1165.g93dce5e1.el8.x86_64 5/25 2023-09-29T23:19:43.041 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:17.2.6-1165.g93dce5e1.el8.x86_6 6/25 2023-09-29T23:19:43.042 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:17.2.6-1165.g93dce5e1.el8.x86_64 7/25 2023-09-29T23:19:43.042 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1165.g93dce5e1.el8. 8/25 2023-09-29T23:19:43.042 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:17.2.6-1165.g93dce5e1.el8.x8 9/25 2023-09-29T23:19:43.042 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:17.2.6-1165.g93dce5e1.el8.x86_64 10/25 2023-09-29T23:19:43.042 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:17.2.6-1165.g93dce5e1.el8.x86_64 11/25 2023-09-29T23:19:43.042 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:17.2.6-1165.g93dce5e1.el8.x86_64 12/25 2023-09-29T23:19:43.042 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:17.2.6-1165.g93dce5e1.el8.x86_64 13/25 2023-09-29T23:19:43.042 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 14/25 2023-09-29T23:19:43.042 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 15/25 2023-09-29T23:19:43.042 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 16/25 2023-09-29T23:19:43.043 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 17/25 2023-09-29T23:19:43.043 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 18/25 2023-09-29T23:19:43.043 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 19/25 2023-09-29T23:19:43.043 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 20/25 2023-09-29T23:19:43.043 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 21/25 2023-09-29T23:19:43.043 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:17.2.6-1165.g93dce5e1.el8.x86_64 22/25 2023-09-29T23:19:43.043 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-09-29T23:19:43.043 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:17.2.6-1165.g93dce5e1.el8.x86_64 24/25 2023-09-29T23:19:44.434 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-09-29T23:19:44.435 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:51 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:19:46.335 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-09-29T23:19:46.466 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:19:46.466 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2023-09-29T23:19:46.466 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:19:46.466 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:19:46.466 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-09-29T23:19:46.466 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:19:46.467 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:19:46.467 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:19:46.467 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:19:46.467 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-29T23:19:46.467 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:19:46.467 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-29T23:19:46.467 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-29T23:19:46.467 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:19:46.467 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-09-29T23:19:46.467 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:19:46.467 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-29T23:19:46.468 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-29T23:19:46.468 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:19:46.468 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:19:46.468 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:19:46.468 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-29T23:19:46.468 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:19:46.468 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:19:46.468 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:19:46.468 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-29T23:19:46.468 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:19:46.468 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:19:46.631 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-test 2023-09-29T23:19:46.995 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:19:47.781 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:54 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:19:49.636 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:19:49.637 INFO:teuthology.orchestra.run.smithi092.stdout:============================================================================================ 2023-09-29T23:19:49.637 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-09-29T23:19:49.637 INFO:teuthology.orchestra.run.smithi092.stdout:============================================================================================ 2023-09-29T23:19:49.638 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-09-29T23:19:49.638 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 52 M 2023-09-29T23:19:49.638 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-09-29T23:19:49.638 INFO:teuthology.orchestra.run.smithi092.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-09-29T23:19:49.638 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 175 k 2023-09-29T23:19:49.638 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-29T23:19:49.638 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-09-29T23:19:49.638 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-29T23:19:49.638 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:19:49.638 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-09-29T23:19:49.639 INFO:teuthology.orchestra.run.smithi092.stdout:============================================================================================ 2023-09-29T23:19:49.639 INFO:teuthology.orchestra.run.smithi092.stdout:Install 6 Packages 2023-09-29T23:19:49.639 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:19:49.639 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 53 M 2023-09-29T23:19:49.640 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 233 M 2023-09-29T23:19:49.640 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-09-29T23:19:49.643 INFO:teuthology.orchestra.run.smithi092.stdout:(1/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 22 MB/s | 70 kB 00:00 2023-09-29T23:19:49.691 INFO:teuthology.orchestra.run.smithi092.stdout:(2/6): jq-1.5-12.el8.x86_64.rpm 3.3 MB/s | 161 kB 00:00 2023-09-29T23:19:49.717 INFO:teuthology.orchestra.run.smithi092.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 7.2 MB/s | 187 kB 00:00 2023-09-29T23:19:49.744 INFO:teuthology.orchestra.run.smithi092.stdout:(4/6): socat-1.7.3.3-2.el8.x86_64.rpm 11 MB/s | 302 kB 00:00 2023-09-29T23:19:49.901 INFO:teuthology.orchestra.run.smithi092.stdout:(5/6): libcephsqlite-17.2.6-1165.g93dce5e1.el8. 668 kB/s | 175 kB 00:00 2023-09-29T23:19:52.541 INFO:teuthology.orchestra.run.smithi092.stdout:(6/6): ceph-test-17.2.6-1165.g93dce5e1.el8.x86_ 18 MB/s | 52 MB 00:02 2023-09-29T23:19:52.544 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-09-29T23:19:52.545 INFO:teuthology.orchestra.run.smithi092.stdout:Total 18 MB/s | 53 MB 00:02 2023-09-29T23:19:52.548 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-09-29T23:19:52.571 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-09-29T23:19:52.571 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-09-29T23:19:52.949 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-09-29T23:19:52.953 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-09-29T23:19:53.479 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-09-29T23:19:53.708 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 1/6 2023-09-29T23:19:53.928 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 2/6 2023-09-29T23:19:53.993 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 2/6 2023-09-29T23:19:54.179 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : jq-1.5-12.el8.x86_64 3/6 2023-09-29T23:19:54.369 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 4/6 2023-09-29T23:19:54.544 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:17.2.6-1165.g93dce5e1.el8.x86_64 5/6 2023-09-29T23:19:59.551 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1165.g93dce5e1.el8.x86_64 5/6 2023-09-29T23:19:59.909 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:17.2.6-1165.g93dce5e1.el8.x86_64 6/6 2023-09-29T23:20:00.180 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-test-2:17.2.6-1165.g93dce5e1.el8.x86_64 6/6 2023-09-29T23:20:00.180 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/6 2023-09-29T23:20:00.180 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:17.2.6-1165.g93dce5e1.el8.x86_64 2/6 2023-09-29T23:20:00.180 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 3/6 2023-09-29T23:20:00.180 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : jq-1.5-12.el8.x86_64 4/6 2023-09-29T23:20:00.180 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 5/6 2023-09-29T23:20:01.215 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 6/6 2023-09-29T23:20:01.215 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:08 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:20:03.077 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-09-29T23:20:03.175 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:20:03.175 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-09-29T23:20:03.176 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:20:03.176 INFO:teuthology.orchestra.run.smithi092.stdout: jq-1.5-12.el8.x86_64 2023-09-29T23:20:03.176 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:20:03.176 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-29T23:20:03.176 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.3.3-2.el8.x86_64 2023-09-29T23:20:03.176 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-29T23:20:03.176 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:20:03.177 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:20:03.287 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph 2023-09-29T23:20:03.642 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:20:04.386 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:11 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:20:06.272 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:20:06.336 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================================= 2023-09-29T23:20:06.336 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-09-29T23:20:06.337 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================================= 2023-09-29T23:20:06.337 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-09-29T23:20:06.337 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 6.4 k 2023-09-29T23:20:06.337 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-09-29T23:20:06.337 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 2.3 M 2023-09-29T23:20:06.337 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 1.6 M 2023-09-29T23:20:06.337 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1165.g93dce5e1.el8 ceph-noarch 238 k 2023-09-29T23:20:06.338 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 3.9 M 2023-09-29T23:20:06.338 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 17 M 2023-09-29T23:20:06.338 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-29T23:20:06.338 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-29T23:20:06.338 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-29T23:20:06.338 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-29T23:20:06.338 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-29T23:20:06.338 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-29T23:20:06.339 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-29T23:20:06.339 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-29T23:20:06.339 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-29T23:20:06.339 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-29T23:20:06.339 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-29T23:20:06.339 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-29T23:20:06.339 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-29T23:20:06.340 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-29T23:20:06.340 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-29T23:20:06.340 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-29T23:20:06.340 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-29T23:20:06.340 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-29T23:20:06.340 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-29T23:20:06.340 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-29T23:20:06.340 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-29T23:20:06.340 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-29T23:20:06.340 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:20:06.341 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-09-29T23:20:06.341 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================================= 2023-09-29T23:20:06.341 INFO:teuthology.orchestra.run.smithi092.stdout:Install 28 Packages 2023-09-29T23:20:06.341 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:20:06.341 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 27 M 2023-09-29T23:20:06.341 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 106 M 2023-09-29T23:20:06.341 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-09-29T23:20:06.507 INFO:teuthology.orchestra.run.smithi092.stdout:(1/28): ceph-17.2.6-1165.g93dce5e1.el8.x86_64.r 72 kB/s | 6.4 kB 00:00 2023-09-29T23:20:06.655 INFO:teuthology.orchestra.run.smithi092.stdout:(2/28): ceph-mgr-17.2.6-1165.g93dce5e1.el8.x86_ 6.6 MB/s | 1.6 MB 00:00 2023-09-29T23:20:06.966 INFO:teuthology.orchestra.run.smithi092.stdout:(3/28): ceph-mon-17.2.6-1165.g93dce5e1.el8.x86_ 8.6 MB/s | 3.9 MB 00:00 2023-09-29T23:20:07.020 INFO:teuthology.orchestra.run.smithi092.stdout:(4/28): ceph-mgr-modules-core-17.2.6-1165.g93dc 4.4 MB/s | 238 kB 00:00 2023-09-29T23:20:07.510 INFO:teuthology.orchestra.run.smithi092.stdout:(5/28): ceph-osd-17.2.6-1165.g93dce5e1.el8.x86_ 20 MB/s | 17 MB 00:00 2023-09-29T23:20:07.511 INFO:teuthology.orchestra.run.smithi092.stdout:(6/28): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 89 kB/s | 44 kB 00:00 2023-09-29T23:20:07.776 INFO:teuthology.orchestra.run.smithi092.stdout:(7/28): python3-beautifulsoup4-4.6.3-2.el8.1.no 699 kB/s | 185 kB 00:00 2023-09-29T23:20:07.873 INFO:teuthology.orchestra.run.smithi092.stdout:(8/28): ceph-mds-17.2.6-1165.g93dce5e1.el8.x86_ 1.6 MB/s | 2.3 MB 00:01 2023-09-29T23:20:07.978 INFO:teuthology.orchestra.run.smithi092.stdout:(9/28): python3-cherrypy-18.4.0-1.el8.noarch.rp 1.9 MB/s | 384 kB 00:00 2023-09-29T23:20:08.031 INFO:teuthology.orchestra.run.smithi092.stdout:(10/28): python3-cheroot-8.5.2-1.el8.noarch.rpm 332 kB/s | 173 kB 00:00 2023-09-29T23:20:08.059 INFO:teuthology.orchestra.run.smithi092.stdout:(11/28): python3-jaraco-functools-2.0-4.el8.noa 218 kB/s | 18 kB 00:00 2023-09-29T23:20:08.125 INFO:teuthology.orchestra.run.smithi092.stdout:(12/28): python3-logutils-0.3.5-11.el8.noarch.r 517 kB/s | 49 kB 00:00 2023-09-29T23:20:08.133 INFO:teuthology.orchestra.run.smithi092.stdout:(13/28): python3-jaraco-6.2-6.el8.noarch.rpm 43 kB/s | 11 kB 00:00 2023-09-29T23:20:08.144 INFO:teuthology.orchestra.run.smithi092.stdout:(14/28): python3-more-itertools-7.2.0-3.el8.noa 688 kB/s | 59 kB 00:00 2023-09-29T23:20:08.225 INFO:teuthology.orchestra.run.smithi092.stdout:(15/28): python3-simplegeneric-0.8.1-17.el8.noa 232 kB/s | 19 kB 00:00 2023-09-29T23:20:08.240 INFO:teuthology.orchestra.run.smithi092.stdout:(16/28): python3-portend-2.6-1.el8.noarch.rpm 146 kB/s | 16 kB 00:00 2023-09-29T23:20:08.307 INFO:teuthology.orchestra.run.smithi092.stdout:(17/28): python3-singledispatch-3.4.0.3-18.el8. 291 kB/s | 24 kB 00:00 2023-09-29T23:20:08.312 INFO:teuthology.orchestra.run.smithi092.stdout:(18/28): python3-pecan-1.3.2-9.el8.noarch.rpm 1.5 MB/s | 283 kB 00:00 2023-09-29T23:20:08.372 INFO:teuthology.orchestra.run.smithi092.stdout:(19/28): python3-tempora-1.14.1-5.el8.noarch.rp 222 kB/s | 29 kB 00:00 2023-09-29T23:20:08.389 INFO:teuthology.orchestra.run.smithi092.stdout:(20/28): python3-trustme-0.6.0-4.el8.noarch.rpm 335 kB/s | 27 kB 00:00 2023-09-29T23:20:08.428 INFO:teuthology.orchestra.run.smithi092.stdout:(21/28): python3-waitress-1.4.3-1.el8.noarch.rp 2.2 MB/s | 255 kB 00:00 2023-09-29T23:20:08.478 INFO:teuthology.orchestra.run.smithi092.stdout:(22/28): python3-webtest-2.0.33-1.el8.noarch.rp 962 kB/s | 85 kB 00:00 2023-09-29T23:20:08.510 INFO:teuthology.orchestra.run.smithi092.stdout:(23/28): python3-zc-lockfile-2.0-2.el8.noarch.r 279 kB/s | 23 kB 00:00 2023-09-29T23:20:08.541 INFO:teuthology.orchestra.run.smithi092.stdout:(24/28): python3-werkzeug-0.12.2-4.el8.noarch.r 7.1 MB/s | 457 kB 00:00 2023-09-29T23:20:08.582 INFO:teuthology.orchestra.run.smithi092.stdout:(25/28): python3-markupsafe-0.23-19.el8.x86_64. 539 kB/s | 39 kB 00:00 2023-09-29T23:20:08.601 INFO:teuthology.orchestra.run.smithi092.stdout:(26/28): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-09-29T23:20:08.625 INFO:teuthology.orchestra.run.smithi092.stdout:(27/28): python3-pytz-2017.2-9.el8.noarch.rpm 1.2 MB/s | 54 kB 00:00 2023-09-29T23:20:08.685 INFO:teuthology.orchestra.run.smithi092.stdout:(28/28): python3-webob-1.8.5-1.el8.1.noarch.rpm 802 kB/s | 251 kB 00:00 2023-09-29T23:20:08.691 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-09-29T23:20:08.691 INFO:teuthology.orchestra.run.smithi092.stdout:Total 11 MB/s | 27 MB 00:02 2023-09-29T23:20:08.695 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-09-29T23:20:08.731 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-09-29T23:20:08.732 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-09-29T23:20:09.137 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-09-29T23:20:09.142 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-09-29T23:20:10.351 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-09-29T23:20:10.608 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/28 2023-09-29T23:20:10.831 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/28 2023-09-29T23:20:11.029 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 3/28 2023-09-29T23:20:11.315 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 4/28 2023-09-29T23:20:11.682 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 5/28 2023-09-29T23:20:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 6/28 2023-09-29T23:20:12.205 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 7/28 2023-09-29T23:20:12.424 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 8/28 2023-09-29T23:20:12.598 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 9/28 2023-09-29T23:20:12.779 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 10/28 2023-09-29T23:20:12.993 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 11/28 2023-09-29T23:20:13.202 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 12/28 2023-09-29T23:20:13.339 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 13/28 2023-09-29T23:20:13.589 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 14/28 2023-09-29T23:20:13.811 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 15/28 2023-09-29T23:20:14.013 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 16/28 2023-09-29T23:20:14.315 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-2.6-1.el8.noarch 17/28 2023-09-29T23:20:14.589 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 18/28 2023-09-29T23:20:15.139 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 19/28 2023-09-29T23:20:15.838 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 20/28 2023-09-29T23:20:16.120 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 21/28 2023-09-29T23:20:16.436 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 22/28 2023-09-29T23:20:16.817 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1165.g93dce5e1.el8. 23/28 2023-09-29T23:20:17.002 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:17.2.6-1165.g93dce5e1.el8.x86_64 24/28 2023-09-29T23:20:18.497 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1165.g93dce5e1.el8.x86_64 24/28 2023-09-29T23:20:18.693 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:17.2.6-1165.g93dce5e1.el8.x86_64 25/28 2023-09-29T23:20:19.087 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:17.2.6-1165.g93dce5e1.el8.x86_64 25/28 2023-09-29T23:20:19.273 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:17.2.6-1165.g93dce5e1.el8.x86_64 26/28 2023-09-29T23:20:19.503 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:17.2.6-1165.g93dce5e1.el8.x86_64 26/28 2023-09-29T23:20:19.673 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:17.2.6-1165.g93dce5e1.el8.x86_64 27/28 2023-09-29T23:20:19.691 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:17.2.6-1165.g93dce5e1.el8.x86_64 27/28 2023-09-29T23:20:19.847 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:17.2.6-1165.g93dce5e1.el8.x86_64 28/28 2023-09-29T23:20:20.248 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-2:17.2.6-1165.g93dce5e1.el8.x86_64 28/28 2023-09-29T23:20:20.248 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/28 2023-09-29T23:20:20.248 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:17.2.6-1165.g93dce5e1.el8.x86_64 2/28 2023-09-29T23:20:20.248 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:17.2.6-1165.g93dce5e1.el8.x86_64 3/28 2023-09-29T23:20:20.248 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:17.2.6-1165.g93dce5e1.el8.x86_64 4/28 2023-09-29T23:20:20.249 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:17.2.6-1165.g93dce5e1.el8.x86_64 5/28 2023-09-29T23:20:20.249 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1165.g93dce5e1.el8. 6/28 2023-09-29T23:20:20.249 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/28 2023-09-29T23:20:20.249 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/28 2023-09-29T23:20:20.249 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/28 2023-09-29T23:20:20.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/28 2023-09-29T23:20:20.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 11/28 2023-09-29T23:20:20.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 12/28 2023-09-29T23:20:20.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 13/28 2023-09-29T23:20:20.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 14/28 2023-09-29T23:20:20.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 15/28 2023-09-29T23:20:20.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-2.6-1.el8.noarch 16/28 2023-09-29T23:20:20.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 17/28 2023-09-29T23:20:20.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 18/28 2023-09-29T23:20:20.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 19/28 2023-09-29T23:20:20.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 20/28 2023-09-29T23:20:20.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 21/28 2023-09-29T23:20:20.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 22/28 2023-09-29T23:20:20.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 23/28 2023-09-29T23:20:20.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 24/28 2023-09-29T23:20:20.252 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 25/28 2023-09-29T23:20:20.252 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 26/28 2023-09-29T23:20:20.252 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 27/28 2023-09-29T23:20:21.737 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 28/28 2023-09-29T23:20:21.737 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:28 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:20:23.583 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-09-29T23:20:23.681 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:20:23.682 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-09-29T23:20:23.682 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:20:23.682 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:20:23.682 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:20:23.682 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:17.2.6-1165.g93dce5e1.el8.noarch 2023-09-29T23:20:23.682 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:20:23.682 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:20:23.682 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-29T23:20:23.682 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-29T23:20:23.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-29T23:20:23.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-29T23:20:23.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-29T23:20:23.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-29T23:20:23.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-29T23:20:23.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-29T23:20:23.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-29T23:20:23.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-29T23:20:23.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-29T23:20:23.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-2.6-1.el8.noarch 2023-09-29T23:20:23.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-29T23:20:23.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-29T23:20:23.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-29T23:20:23.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-29T23:20:23.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-29T23:20:23.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-29T23:20:23.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-29T23:20:23.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-29T23:20:23.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-29T23:20:23.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-29T23:20:23.684 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:20:23.684 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:20:23.831 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-base 2023-09-29T23:20:24.194 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:20:25.049 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:32 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:20:26.666 INFO:teuthology.orchestra.run.smithi092.stdout:Package ceph-base-2:17.2.6-1165.g93dce5e1.el8.x86_64 is already installed. 2023-09-29T23:20:27.152 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:20:27.153 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2023-09-29T23:20:27.154 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:20:27.247 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install cephadm 2023-09-29T23:20:27.609 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:20:28.405 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:35 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:20:30.225 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:20:30.226 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:20:30.226 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-09-29T23:20:30.226 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:20:30.226 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-09-29T23:20:30.226 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:17.2.6-1165.g93dce5e1.el8 ceph-noarch 80 k 2023-09-29T23:20:30.226 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:20:30.226 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-09-29T23:20:30.227 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:20:30.227 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2023-09-29T23:20:30.227 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:20:30.227 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 80 k 2023-09-29T23:20:30.227 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 363 k 2023-09-29T23:20:30.227 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-09-29T23:20:30.359 INFO:teuthology.orchestra.run.smithi092.stdout:cephadm-17.2.6-1165.g93dce5e1.el8.noarch.rpm 606 kB/s | 80 kB 00:00 2023-09-29T23:20:30.359 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-09-29T23:20:30.360 INFO:teuthology.orchestra.run.smithi092.stdout:Total 599 kB/s | 80 kB 00:00 2023-09-29T23:20:30.360 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-09-29T23:20:30.368 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-09-29T23:20:30.368 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-09-29T23:20:30.370 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-09-29T23:20:30.374 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-09-29T23:20:30.424 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-09-29T23:20:35.029 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:17.2.6-1165.g93dce5e1.el8.noarch 1/1 2023-09-29T23:20:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:17.2.6-1165.g93dce5e1.el8.noarch 1/1 2023-09-29T23:20:35.446 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:17.2.6-1165.g93dce5e1.el8.noarch 1/1 2023-09-29T23:20:36.382 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:17.2.6-1165.g93dce5e1.el8.noarch 1/1 2023-09-29T23:20:36.382 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:43 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:20:38.233 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-09-29T23:20:38.328 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:20:38.328 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-09-29T23:20:38.328 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:17.2.6-1165.g93dce5e1.el8.noarch 2023-09-29T23:20:38.328 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:20:38.328 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:20:38.463 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-immutable-object-cache 2023-09-29T23:20:38.836 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:20:39.585 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:46 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:20:41.433 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:20:41.434 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:20:41.434 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repo Size 2023-09-29T23:20:41.434 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:20:41.434 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-09-29T23:20:41.434 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 161 k 2023-09-29T23:20:41.434 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:20:41.434 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-09-29T23:20:41.434 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:20:41.435 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2023-09-29T23:20:41.435 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:20:41.435 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 161 k 2023-09-29T23:20:41.435 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 490 k 2023-09-29T23:20:41.435 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-09-29T23:20:41.819 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-immutable-object-cache-17.2.6-1165.g93dce5 421 kB/s | 161 kB 00:00 2023-09-29T23:20:41.819 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-09-29T23:20:41.819 INFO:teuthology.orchestra.run.smithi092.stdout:Total 419 kB/s | 161 kB 00:00 2023-09-29T23:20:41.820 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-09-29T23:20:41.832 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-09-29T23:20:41.832 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-09-29T23:20:41.885 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-09-29T23:20:41.889 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-09-29T23:20:42.041 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-09-29T23:20:42.235 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1165.g93dce5e1. 1/1 2023-09-29T23:20:42.644 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1165.g93dce5e1. 1/1 2023-09-29T23:20:43.593 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1165.g93dce5e1. 1/1 2023-09-29T23:20:43.593 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:50 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:20:45.415 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-09-29T23:20:45.513 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:20:45.513 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-09-29T23:20:45.513 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:20:45.513 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:20:45.513 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:20:45.629 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr 2023-09-29T23:20:45.991 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:20:46.753 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:53 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:20:48.112 INFO:teuthology.orchestra.run.smithi092.stdout:Package ceph-mgr-2:17.2.6-1165.g93dce5e1.el8.x86_64 is already installed. 2023-09-29T23:20:48.584 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:20:48.585 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2023-09-29T23:20:48.585 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:20:48.686 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-dashboard 2023-09-29T23:20:49.045 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:20:49.971 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:01:56 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:20:51.886 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:20:51.887 INFO:teuthology.orchestra.run.smithi092.stdout:=================================================================================================== 2023-09-29T23:20:51.887 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-09-29T23:20:51.887 INFO:teuthology.orchestra.run.smithi092.stdout:=================================================================================================== 2023-09-29T23:20:51.888 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-09-29T23:20:51.888 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1165.g93dce5e1.el8 ceph-noarch 1.7 M 2023-09-29T23:20:51.888 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-09-29T23:20:51.888 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1165.g93dce5e1.el8 ceph-noarch 23 k 2023-09-29T23:20:51.888 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1165.g93dce5e1.el8 ceph-noarch 14 k 2023-09-29T23:20:51.888 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-29T23:20:51.888 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-29T23:20:51.888 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-29T23:20:51.888 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:20:51.888 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-09-29T23:20:51.888 INFO:teuthology.orchestra.run.smithi092.stdout:=================================================================================================== 2023-09-29T23:20:51.888 INFO:teuthology.orchestra.run.smithi092.stdout:Install 6 Packages 2023-09-29T23:20:51.889 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:20:51.889 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 2.0 M 2023-09-29T23:20:51.889 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 8.0 M 2023-09-29T23:20:51.889 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-09-29T23:20:52.168 INFO:teuthology.orchestra.run.smithi092.stdout:(1/6): ceph-grafana-dashboards-17.2.6-1165.g93d 210 kB/s | 23 kB 00:00 2023-09-29T23:20:52.177 INFO:teuthology.orchestra.run.smithi092.stdout:(2/6): ceph-prometheus-alerts-17.2.6-1165.g93dc 122 kB/s | 14 kB 00:00 2023-09-29T23:20:52.303 INFO:teuthology.orchestra.run.smithi092.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 249 kB/s | 34 kB 00:00 2023-09-29T23:20:52.321 INFO:teuthology.orchestra.run.smithi092.stdout:(4/6): ceph-mgr-dashboard-17.2.6-1165.g93dce5e1 6.4 MB/s | 1.7 MB 00:00 2023-09-29T23:20:52.341 INFO:teuthology.orchestra.run.smithi092.stdout:(5/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.1 MB/s | 43 kB 00:00 2023-09-29T23:20:52.404 INFO:teuthology.orchestra.run.smithi092.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 866 kB/s | 196 kB 00:00 2023-09-29T23:20:52.406 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-09-29T23:20:52.406 INFO:teuthology.orchestra.run.smithi092.stdout:Total 3.9 MB/s | 2.0 MB 00:00 2023-09-29T23:20:52.408 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-09-29T23:20:52.416 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-09-29T23:20:52.416 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-09-29T23:20:52.500 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-09-29T23:20:52.504 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-09-29T23:20:52.803 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-09-29T23:20:53.036 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2023-09-29T23:20:53.248 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2023-09-29T23:20:53.451 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2023-09-29T23:20:53.588 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1165.g93dce5e1.el8.n 4/6 2023-09-29T23:20:53.967 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1165.g93dce5e1.el8. 5/6 2023-09-29T23:20:54.235 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1165.g93dce5e1.el8.noarc 6/6 2023-09-29T23:20:54.496 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1165.g93dce5e1.el8.noarc 6/6 2023-09-29T23:20:54.496 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1165.g93dce5e1.el8. 1/6 2023-09-29T23:20:54.496 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1165.g93dce5e1.el8.noarc 2/6 2023-09-29T23:20:54.496 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1165.g93dce5e1.el8.n 3/6 2023-09-29T23:20:54.497 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2023-09-29T23:20:54.497 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2023-09-29T23:20:55.430 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2023-09-29T23:20:55.430 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:02 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:20:57.352 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-09-29T23:20:57.449 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:20:57.449 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-09-29T23:20:57.449 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:17.2.6-1165.g93dce5e1.el8.noarch 2023-09-29T23:20:57.450 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:17.2.6-1165.g93dce5e1.el8.noarch 2023-09-29T23:20:57.450 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:17.2.6-1165.g93dce5e1.el8.noarch 2023-09-29T23:20:57.450 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-29T23:20:57.450 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-29T23:20:57.450 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-29T23:20:57.450 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:20:57.450 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:20:57.584 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-diskprediction-local 2023-09-29T23:20:57.947 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:20:58.774 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:05 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:21:00.648 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:21:00.649 INFO:teuthology.orchestra.run.smithi092.stdout:====================================================================================================================== 2023-09-29T23:21:00.649 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-09-29T23:21:00.649 INFO:teuthology.orchestra.run.smithi092.stdout:====================================================================================================================== 2023-09-29T23:21:00.650 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-09-29T23:21:00.650 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1165.g93dce5e1.el8 ceph-noarch 7.4 M 2023-09-29T23:21:00.650 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-09-29T23:21:00.650 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-09-29T23:21:00.650 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-09-29T23:21:00.650 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-09-29T23:21:00.650 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-29T23:21:00.650 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-29T23:21:00.650 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-29T23:21:00.650 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-09-29T23:21:00.650 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:21:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-09-29T23:21:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:====================================================================================================================== 2023-09-29T23:21:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:Install 8 Packages 2023-09-29T23:21:00.651 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:21:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 36 M 2023-09-29T23:21:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 199 M 2023-09-29T23:21:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-09-29T23:21:00.684 INFO:teuthology.orchestra.run.smithi092.stdout:(1/8): libquadmath-8.4.1-1.el8.x86_64.rpm 5.2 MB/s | 169 kB 00:00 2023-09-29T23:21:00.696 INFO:teuthology.orchestra.run.smithi092.stdout:(2/8): libgfortran-8.4.1-1.el8.x86_64.rpm 14 MB/s | 639 kB 00:00 2023-09-29T23:21:00.717 INFO:teuthology.orchestra.run.smithi092.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 11 MB/s | 225 kB 00:00 2023-09-29T23:21:00.784 INFO:teuthology.orchestra.run.smithi092.stdout:(4/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 55 MB/s | 3.7 MB 00:00 2023-09-29T23:21:00.868 INFO:teuthology.orchestra.run.smithi092.stdout:(5/8): openblas-threads-0.3.12-1.el8.x86_64.rpm 57 MB/s | 4.7 MB 00:00 2023-09-29T23:21:00.987 INFO:teuthology.orchestra.run.smithi092.stdout:(6/8): python3-scipy-1.0.0-20.module+el8.1.0+33 48 MB/s | 15 MB 00:00 2023-09-29T23:21:01.033 INFO:teuthology.orchestra.run.smithi092.stdout:(7/8): openblas-0.3.12-1.el8.x86_64.rpm 28 MB/s | 4.6 MB 00:00 2023-09-29T23:21:01.238 INFO:teuthology.orchestra.run.smithi092.stdout:(8/8): ceph-mgr-diskprediction-local-17.2.6-116 13 MB/s | 7.4 MB 00:00 2023-09-29T23:21:01.240 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-09-29T23:21:01.240 INFO:teuthology.orchestra.run.smithi092.stdout:Total 61 MB/s | 36 MB 00:00 2023-09-29T23:21:01.250 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-09-29T23:21:01.269 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-09-29T23:21:01.269 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-09-29T23:21:01.724 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-09-29T23:21:01.728 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-09-29T23:21:02.343 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-09-29T23:21:02.530 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 1/8 2023-09-29T23:21:02.661 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 1/8 2023-09-29T23:21:02.804 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 2/8 2023-09-29T23:21:03.367 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 2/8 2023-09-29T23:21:03.529 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 3/8 2023-09-29T23:21:04.092 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 3/8 2023-09-29T23:21:04.262 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.12-1.el8.x86_64 4/8 2023-09-29T23:21:05.018 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 4/8 2023-09-29T23:21:05.373 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2023-09-29T23:21:06.096 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2023-09-29T23:21:08.166 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2023-09-29T23:21:09.420 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 7/8 2023-09-29T23:21:09.620 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1165.g93dce5e 8/8 2023-09-29T23:21:09.919 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1165.g93dce5e 8/8 2023-09-29T23:21:09.919 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1165.g93dce5e 1/8 2023-09-29T23:21:09.919 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 2/8 2023-09-29T23:21:09.919 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 3/8 2023-09-29T23:21:09.919 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 4/8 2023-09-29T23:21:09.919 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2023-09-29T23:21:09.919 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 6/8 2023-09-29T23:21:09.919 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 7/8 2023-09-29T23:21:10.878 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 8/8 2023-09-29T23:21:10.878 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:17 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:21:13.286 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-09-29T23:21:13.387 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:21:13.388 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-09-29T23:21:13.388 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1165.g93dce5e1.el8.noarch 2023-09-29T23:21:13.388 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-09-29T23:21:13.388 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-09-29T23:21:13.388 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.12-1.el8.x86_64 2023-09-29T23:21:13.388 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-09-29T23:21:13.388 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-09-29T23:21:13.388 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-09-29T23:21:13.388 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-09-29T23:21:13.388 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:21:13.389 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:21:13.557 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-rook 2023-09-29T23:21:13.928 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:21:14.780 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:21 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:21:16.681 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:21:16.682 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================================== 2023-09-29T23:21:16.683 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-09-29T23:21:16.683 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================================== 2023-09-29T23:21:16.683 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-09-29T23:21:16.683 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:17.2.6-1165.g93dce5e1.el8 ceph-noarch 47 k 2023-09-29T23:21:16.683 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-09-29T23:21:16.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-29T23:21:16.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-29T23:21:16.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-29T23:21:16.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-29T23:21:16.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-29T23:21:16.683 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-29T23:21:16.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-29T23:21:16.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-29T23:21:16.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-29T23:21:16.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-29T23:21:16.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-29T23:21:16.684 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-29T23:21:16.684 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:21:16.684 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-09-29T23:21:16.684 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================================== 2023-09-29T23:21:16.684 INFO:teuthology.orchestra.run.smithi092.stdout:Install 13 Packages 2023-09-29T23:21:16.684 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:21:16.685 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 1.9 M 2023-09-29T23:21:16.685 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 25 M 2023-09-29T23:21:16.685 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-09-29T23:21:17.113 INFO:teuthology.orchestra.run.smithi092.stdout:(1/13): python3-cachetools-3.1.1-4.el8.noarch.r 384 kB/s | 33 kB 00:00 2023-09-29T23:21:17.127 INFO:teuthology.orchestra.run.smithi092.stdout:(2/13): python3-certifi-2018.10.15-7.el8.noarch 162 kB/s | 16 kB 00:00 2023-09-29T23:21:17.153 INFO:teuthology.orchestra.run.smithi092.stdout:(3/13): python3-google-auth-1.1.1-10.el8.noarch 2.0 MB/s | 81 kB 00:00 2023-09-29T23:21:17.166 INFO:teuthology.orchestra.run.smithi092.stdout:(4/13): ceph-mgr-rook-17.2.6-1165.g93dce5e1.el8 341 kB/s | 47 kB 00:00 2023-09-29T23:21:17.174 INFO:teuthology.orchestra.run.smithi092.stdout:(5/13): python3-rsa-4.9-2.el8.noarch.rpm 3.1 MB/s | 64 kB 00:00 2023-09-29T23:21:17.218 INFO:teuthology.orchestra.run.smithi092.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 3.5 MB/s | 155 kB 00:00 2023-09-29T23:21:17.237 INFO:teuthology.orchestra.run.smithi092.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 2.2 MB/s | 43 kB 00:00 2023-09-29T23:21:17.256 INFO:teuthology.orchestra.run.smithi092.stdout:(8/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 1.4 MB/s | 27 kB 00:00 2023-09-29T23:21:17.269 INFO:teuthology.orchestra.run.smithi092.stdout:(9/13): python3-kubernetes-11.0.0-6.el8.noarch. 8.2 MB/s | 1.2 MB 00:00 2023-09-29T23:21:17.278 INFO:teuthology.orchestra.run.smithi092.stdout:(10/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 5.7 MB/s | 126 kB 00:00 2023-09-29T23:21:17.281 INFO:teuthology.orchestra.run.smithi092.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 530 kB/s | 61 kB 00:00 2023-09-29T23:21:17.312 INFO:teuthology.orchestra.run.smithi092.stdout:(12/13): python3-pyasn1-modules-0.3.7-6.el8.noa 2.5 MB/s | 110 kB 00:00 2023-09-29T23:21:17.321 INFO:teuthology.orchestra.run.smithi092.stdout:(13/13): python3-jsonpointer-1.10-11.el8.noarch 458 kB/s | 20 kB 00:00 2023-09-29T23:21:17.325 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-09-29T23:21:17.325 INFO:teuthology.orchestra.run.smithi092.stdout:Total 3.0 MB/s | 1.9 MB 00:00 2023-09-29T23:21:17.330 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-09-29T23:21:17.344 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-09-29T23:21:17.345 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-09-29T23:21:17.439 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-09-29T23:21:17.444 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-09-29T23:21:17.983 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-09-29T23:21:18.293 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-09-29T23:21:18.541 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el8.noarch 2/13 2023-09-29T23:21:18.741 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2023-09-29T23:21:18.984 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 4/13 2023-09-29T23:21:19.251 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 5/13 2023-09-29T23:21:19.557 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-09-29T23:21:19.847 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-09-29T23:21:20.092 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2023-09-29T23:21:20.308 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-09-29T23:21:20.591 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2023-09-29T23:21:21.792 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2023-09-29T23:21:22.120 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 12/13 2023-09-29T23:21:22.286 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:17.2.6-1165.g93dce5e1.el8.noarch 13/13 2023-09-29T23:21:22.552 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1165.g93dce5e1.el8.noarch 13/13 2023-09-29T23:21:22.552 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1165.g93dce5e1.el8.noarch 1/13 2023-09-29T23:21:22.552 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2023-09-29T23:21:22.552 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2023-09-29T23:21:22.552 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2023-09-29T23:21:22.553 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/13 2023-09-29T23:21:22.553 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 6/13 2023-09-29T23:21:22.553 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2023-09-29T23:21:22.553 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-09-29T23:21:22.553 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-09-29T23:21:22.553 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 10/13 2023-09-29T23:21:22.553 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 11/13 2023-09-29T23:21:22.553 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 12/13 2023-09-29T23:21:23.542 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 13/13 2023-09-29T23:21:23.542 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:30 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:21:28.113 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-09-29T23:21:28.214 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:21:28.214 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-09-29T23:21:28.214 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:17.2.6-1165.g93dce5e1.el8.noarch 2023-09-29T23:21:28.214 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-29T23:21:28.214 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-29T23:21:28.214 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-29T23:21:28.214 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-29T23:21:28.215 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-29T23:21:28.215 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-29T23:21:28.215 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-29T23:21:28.215 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-29T23:21:28.215 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-29T23:21:28.215 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-29T23:21:28.215 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-29T23:21:28.215 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-29T23:21:28.215 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:21:28.215 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:21:28.403 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-mgr-cephadm 2023-09-29T23:21:28.772 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:21:29.590 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:36 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:21:31.481 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:21:31.482 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================================== 2023-09-29T23:21:31.482 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-09-29T23:21:31.482 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================================== 2023-09-29T23:21:31.482 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-09-29T23:21:31.482 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1165.g93dce5e1.el8 ceph-noarch 121 k 2023-09-29T23:21:31.483 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-09-29T23:21:31.483 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-29T23:21:31.483 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-29T23:21:31.483 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-29T23:21:31.483 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-29T23:21:31.483 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:21:31.483 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-09-29T23:21:31.483 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================================== 2023-09-29T23:21:31.483 INFO:teuthology.orchestra.run.smithi092.stdout:Install 5 Packages 2023-09-29T23:21:31.483 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:21:31.484 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 6.0 M 2023-09-29T23:21:31.484 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 26 M 2023-09-29T23:21:31.484 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-09-29T23:21:31.908 INFO:teuthology.orchestra.run.smithi092.stdout:(1/5): ceph-mgr-cephadm-17.2.6-1165.g93dce5e1.e 471 kB/s | 121 kB 00:00 2023-09-29T23:21:32.157 INFO:teuthology.orchestra.run.smithi092.stdout:(2/5): python3-natsort-7.1.1-2.el8.noarch.rpm 119 kB/s | 60 kB 00:00 2023-09-29T23:21:32.180 INFO:teuthology.orchestra.run.smithi092.stdout:(3/5): python3-babel-2.5.1-5.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-09-29T23:21:32.335 INFO:teuthology.orchestra.run.smithi092.stdout:(4/5): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 3.0 MB/s | 538 kB 00:00 2023-09-29T23:21:32.432 INFO:teuthology.orchestra.run.smithi092.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 610 kB/s | 476 kB 00:00 2023-09-29T23:21:32.434 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-09-29T23:21:32.434 INFO:teuthology.orchestra.run.smithi092.stdout:Total 6.3 MB/s | 6.0 MB 00:00 2023-09-29T23:21:32.437 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-09-29T23:21:32.448 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-09-29T23:21:32.448 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-09-29T23:21:32.545 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-09-29T23:21:32.549 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-09-29T23:21:33.584 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-09-29T23:21:33.946 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 1/5 2023-09-29T23:21:34.218 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 2/5 2023-09-29T23:21:34.581 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-09-29T23:21:34.878 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-09-29T23:21:35.080 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1165.g93dce5e1.el8.noarch 5/5 2023-09-29T23:21:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1165.g93dce5e1.el8.noarch 5/5 2023-09-29T23:21:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1165.g93dce5e1.el8.noarch 1/5 2023-09-29T23:21:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-09-29T23:21:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-09-29T23:21:35.348 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 4/5 2023-09-29T23:21:36.317 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 5/5 2023-09-29T23:21:36.317 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:43 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:21:39.234 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-09-29T23:21:39.331 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:21:39.331 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-09-29T23:21:39.331 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:17.2.6-1165.g93dce5e1.el8.noarch 2023-09-29T23:21:39.332 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-29T23:21:39.332 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.5.1-5.el8.noarch 2023-09-29T23:21:39.332 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-09-29T23:21:39.332 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-29T23:21:39.332 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:21:39.332 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:21:39.468 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-fuse 2023-09-29T23:21:39.837 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:21:41.451 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:48 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:21:43.243 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:21:43.243 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:21:43.244 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-09-29T23:21:43.244 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:21:43.244 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-09-29T23:21:43.244 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse 2023-09-29T23:21:43.244 INFO:teuthology.orchestra.run.smithi092.stdout: x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 874 k 2023-09-29T23:21:43.244 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-09-29T23:21:43.244 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-29T23:21:43.244 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:21:43.244 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-09-29T23:21:43.244 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:21:43.244 INFO:teuthology.orchestra.run.smithi092.stdout:Install 2 Packages 2023-09-29T23:21:43.245 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:21:43.245 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 957 k 2023-09-29T23:21:43.245 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 3.0 M 2023-09-29T23:21:43.245 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-09-29T23:21:43.373 INFO:teuthology.orchestra.run.smithi092.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 645 kB/s | 83 kB 00:00 2023-09-29T23:21:43.630 INFO:teuthology.orchestra.run.smithi092.stdout:(2/2): ceph-fuse-17.2.6-1165.g93dce5e1.el8.x86_ 2.2 MB/s | 874 kB 00:00 2023-09-29T23:21:43.639 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-09-29T23:21:43.639 INFO:teuthology.orchestra.run.smithi092.stdout:Total 2.4 MB/s | 957 kB 00:00 2023-09-29T23:21:43.639 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-09-29T23:21:43.653 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-09-29T23:21:43.653 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-09-29T23:21:43.736 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-09-29T23:21:43.741 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-09-29T23:21:43.940 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-09-29T23:21:44.251 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2023-09-29T23:21:44.462 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:17.2.6-1165.g93dce5e1.el8.x86_64 2/2 2023-09-29T23:21:44.886 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-fuse-2:17.2.6-1165.g93dce5e1.el8.x86_64 2/2 2023-09-29T23:21:44.886 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/2 2023-09-29T23:21:45.902 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2023-09-29T23:21:45.902 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:52 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:21:49.982 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-09-29T23:21:50.078 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:21:50.078 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-09-29T23:21:50.078 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:17.2.6-1165.g93dce5e1.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2023-09-29T23:21:50.078 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:21:50.078 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:21:50.206 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-volume 2023-09-29T23:21:50.581 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:21:52.366 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:02:59 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:21:54.413 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:21:54.414 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:21:54.414 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-09-29T23:21:54.414 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:21:54.414 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-09-29T23:21:54.414 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:17.2.6-1165.g93dce5e1.el8 ceph-noarch 267 k 2023-09-29T23:21:54.414 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:21:54.414 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-09-29T23:21:54.414 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:21:54.414 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2023-09-29T23:21:54.415 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:21:54.415 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 267 k 2023-09-29T23:21:54.415 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 1.3 M 2023-09-29T23:21:54.415 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-09-29T23:21:54.708 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-volume-17.2.6-1165.g93dce5e1.el8.noarch.rp 909 kB/s | 267 kB 00:00 2023-09-29T23:21:54.709 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-09-29T23:21:54.709 INFO:teuthology.orchestra.run.smithi092.stdout:Total 905 kB/s | 267 kB 00:00 2023-09-29T23:21:54.710 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-09-29T23:21:54.720 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-09-29T23:21:54.720 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-09-29T23:21:54.755 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-09-29T23:21:54.760 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-09-29T23:21:54.938 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-09-29T23:21:55.268 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:17.2.6-1165.g93dce5e1.el8.noarch 1/1 2023-09-29T23:21:55.665 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:17.2.6-1165.g93dce5e1.el8.noarch 1/1 2023-09-29T23:21:56.663 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:17.2.6-1165.g93dce5e1.el8.noarch 1/1 2023-09-29T23:21:56.663 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:03:03 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:22:00.078 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-09-29T23:22:00.176 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:22:00.176 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-09-29T23:22:00.176 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:17.2.6-1165.g93dce5e1.el8.noarch 2023-09-29T23:22:00.176 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:22:00.176 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:22:00.314 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install librados-devel 2023-09-29T23:22:00.687 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:22:02.426 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:03:09 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:22:04.289 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:22:04.289 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:22:04.290 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repo Size 2023-09-29T23:22:04.290 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:22:04.290 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-09-29T23:22:04.290 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 130 k 2023-09-29T23:22:04.290 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:22:04.290 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-09-29T23:22:04.290 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:22:04.290 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2023-09-29T23:22:04.290 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:22:04.290 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 130 k 2023-09-29T23:22:04.290 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 464 k 2023-09-29T23:22:04.291 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-09-29T23:22:04.548 INFO:teuthology.orchestra.run.smithi092.stdout:librados-devel-17.2.6-1165.g93dce5e1.el8.x86_64 504 kB/s | 130 kB 00:00 2023-09-29T23:22:04.549 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-09-29T23:22:04.549 INFO:teuthology.orchestra.run.smithi092.stdout:Total 500 kB/s | 130 kB 00:00 2023-09-29T23:22:04.550 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-09-29T23:22:04.556 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-09-29T23:22:04.557 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-09-29T23:22:04.612 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-09-29T23:22:04.616 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-09-29T23:22:04.789 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-09-29T23:22:04.990 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/1 2023-09-29T23:22:05.272 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados-devel-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/1 2023-09-29T23:22:06.255 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/1 2023-09-29T23:22:06.255 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:03:13 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:22:10.234 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-09-29T23:22:10.331 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:22:10.332 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-09-29T23:22:10.332 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:22:10.332 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:22:10.332 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:22:10.457 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install libcephfs2 2023-09-29T23:22:10.831 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:22:12.513 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:03:19 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:22:13.834 INFO:teuthology.orchestra.run.smithi092.stdout:Package libcephfs2-2:17.2.6-1165.g93dce5e1.el8.x86_64 is already installed. 2023-09-29T23:22:14.311 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:22:14.312 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2023-09-29T23:22:14.313 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:22:14.456 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install libcephfs-devel 2023-09-29T23:22:14.827 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:22:16.486 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:03:23 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:22:18.298 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:22:18.298 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:22:18.299 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repo Size 2023-09-29T23:22:18.299 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:22:18.299 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-09-29T23:22:18.299 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 25 k 2023-09-29T23:22:18.299 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:22:18.299 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-09-29T23:22:18.299 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:22:18.299 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2023-09-29T23:22:18.299 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:22:18.300 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 25 k 2023-09-29T23:22:18.300 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 109 k 2023-09-29T23:22:18.300 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-09-29T23:22:18.410 INFO:teuthology.orchestra.run.smithi092.stdout:libcephfs-devel-17.2.6-1165.g93dce5e1.el8.x86_6 225 kB/s | 25 kB 00:00 2023-09-29T23:22:18.411 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-09-29T23:22:18.411 INFO:teuthology.orchestra.run.smithi092.stdout:Total 222 kB/s | 25 kB 00:00 2023-09-29T23:22:18.411 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-09-29T23:22:18.415 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-09-29T23:22:18.415 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-09-29T23:22:18.417 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-09-29T23:22:18.421 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-09-29T23:22:18.488 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-09-29T23:22:18.645 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/1 2023-09-29T23:22:18.909 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs-devel-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/1 2023-09-29T23:22:19.919 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/1 2023-09-29T23:22:19.920 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:03:26 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:22:26.530 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-09-29T23:22:26.626 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:22:26.627 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-09-29T23:22:26.627 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:22:26.627 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:22:26.627 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:22:26.755 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install librados2 2023-09-29T23:22:27.127 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:22:28.833 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:03:35 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:22:30.172 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-2:17.2.6-1165.g93dce5e1.el8.x86_64 is already installed. 2023-09-29T23:22:30.640 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:22:30.641 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2023-09-29T23:22:30.642 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:22:30.749 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install librbd1 2023-09-29T23:22:31.121 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:22:32.754 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:03:39 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:22:34.221 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-2:17.2.6-1165.g93dce5e1.el8.x86_64 is already installed. 2023-09-29T23:22:34.697 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:22:34.698 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2023-09-29T23:22:34.698 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:22:34.807 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-rados 2023-09-29T23:22:35.194 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:22:36.845 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:03:43 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:22:38.312 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-rados-2:17.2.6-1165.g93dce5e1.el8.x86_64 is already installed. 2023-09-29T23:22:38.785 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:22:38.786 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2023-09-29T23:22:38.786 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:22:38.901 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-rgw 2023-09-29T23:22:39.270 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:22:40.901 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:03:47 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:22:42.277 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-rgw-2:17.2.6-1165.g93dce5e1.el8.x86_64 is already installed. 2023-09-29T23:22:42.756 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:22:42.757 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2023-09-29T23:22:42.757 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:22:42.865 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-cephfs 2023-09-29T23:22:43.234 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:22:45.164 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:03:52 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:22:46.552 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-cephfs-2:17.2.6-1165.g93dce5e1.el8.x86_64 is already installed. 2023-09-29T23:22:47.026 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:22:47.027 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2023-09-29T23:22:47.027 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:22:47.133 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install python3-rbd 2023-09-29T23:22:47.503 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:22:49.293 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:03:56 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:22:50.684 INFO:teuthology.orchestra.run.smithi092.stdout:Package python3-rbd-2:17.2.6-1165.g93dce5e1.el8.x86_64 is already installed. 2023-09-29T23:22:51.156 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:22:51.156 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2023-09-29T23:22:51.157 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:22:51.274 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install rbd-fuse 2023-09-29T23:22:51.644 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:22:53.436 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:04:00 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:22:55.293 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:22:55.293 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:22:55.293 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2023-09-29T23:22:55.294 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:22:55.294 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-09-29T23:22:55.294 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 90 k 2023-09-29T23:22:55.294 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:22:55.294 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-09-29T23:22:55.294 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:22:55.294 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2023-09-29T23:22:55.294 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:22:55.295 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 90 k 2023-09-29T23:22:55.295 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 264 k 2023-09-29T23:22:55.295 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-09-29T23:22:55.447 INFO:teuthology.orchestra.run.smithi092.stdout:rbd-fuse-17.2.6-1165.g93dce5e1.el8.x86_64.rpm 593 kB/s | 90 kB 00:00 2023-09-29T23:22:55.447 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-09-29T23:22:55.448 INFO:teuthology.orchestra.run.smithi092.stdout:Total 588 kB/s | 90 kB 00:00 2023-09-29T23:22:55.448 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-09-29T23:22:55.460 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-09-29T23:22:55.460 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-09-29T23:22:55.517 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-09-29T23:22:55.521 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-09-29T23:22:55.669 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-09-29T23:22:55.896 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/1 2023-09-29T23:22:56.162 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-fuse-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/1 2023-09-29T23:22:57.101 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/1 2023-09-29T23:22:57.102 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:04:04 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:22:59.809 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-09-29T23:22:59.904 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:22:59.904 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-09-29T23:22:59.904 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:22:59.904 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:22:59.904 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:23:00.060 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install rbd-mirror 2023-09-29T23:23:00.432 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:23:02.155 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:04:09 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:23:03.994 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:23:03.994 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:23:03.995 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repo Size 2023-09-29T23:23:03.995 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:23:03.995 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-09-29T23:23:03.995 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 3.5 M 2023-09-29T23:23:03.995 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:03.995 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-09-29T23:23:03.995 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:23:03.995 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2023-09-29T23:23:03.995 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:03.995 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 3.5 M 2023-09-29T23:23:03.995 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 16 M 2023-09-29T23:23:03.995 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-09-29T23:23:04.455 INFO:teuthology.orchestra.run.smithi092.stdout:rbd-mirror-17.2.6-1165.g93dce5e1.el8.x86_64.rpm 7.5 MB/s | 3.5 MB 00:00 2023-09-29T23:23:04.456 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-09-29T23:23:04.457 INFO:teuthology.orchestra.run.smithi092.stdout:Total 7.5 MB/s | 3.5 MB 00:00 2023-09-29T23:23:04.457 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-09-29T23:23:04.473 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-09-29T23:23:04.473 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-09-29T23:23:04.541 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-09-29T23:23:04.545 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-09-29T23:23:05.006 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-09-29T23:23:05.194 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/1 2023-09-29T23:23:05.622 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/1 2023-09-29T23:23:06.583 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/1 2023-09-29T23:23:06.583 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:04:13 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:23:08.890 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-09-29T23:23:08.990 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:08.991 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-09-29T23:23:08.991 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:23:08.991 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:08.991 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:23:09.111 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install rbd-nbd 2023-09-29T23:23:09.484 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-09-29T23:23:10.404 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:04:17 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:23:12.253 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-09-29T23:23:12.253 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:23:12.253 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2023-09-29T23:23:12.253 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:23:12.254 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-09-29T23:23:12.254 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:17.2.6-1165.g93dce5e1.el8 ceph 173 k 2023-09-29T23:23:12.254 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:12.254 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-09-29T23:23:12.254 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2023-09-29T23:23:12.254 INFO:teuthology.orchestra.run.smithi092.stdout:Install 1 Package 2023-09-29T23:23:12.254 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:12.255 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 173 k 2023-09-29T23:23:12.255 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 552 k 2023-09-29T23:23:12.255 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-09-29T23:23:12.512 INFO:teuthology.orchestra.run.smithi092.stdout:rbd-nbd-17.2.6-1165.g93dce5e1.el8.x86_64.rpm 672 kB/s | 173 kB 00:00 2023-09-29T23:23:12.513 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-09-29T23:23:12.513 INFO:teuthology.orchestra.run.smithi092.stdout:Total 668 kB/s | 173 kB 00:00 2023-09-29T23:23:12.513 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-09-29T23:23:12.526 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-09-29T23:23:12.527 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-09-29T23:23:12.584 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-09-29T23:23:12.588 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-09-29T23:23:12.711 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-09-29T23:23:12.908 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/1 2023-09-29T23:23:13.178 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-nbd-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/1 2023-09-29T23:23:14.135 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:17.2.6-1165.g93dce5e1.el8.x86_64 1/1 2023-09-29T23:23:14.135 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:04:21 ago on Fri 29 Sep 2023 11:18:53 PM UTC. 2023-09-29T23:23:17.057 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-09-29T23:23:17.157 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:17.158 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-09-29T23:23:17.158 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:17.2.6-1165.g93dce5e1.el8.x86_64 2023-09-29T23:23:17.158 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:17.158 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-09-29T23:23:17.285 DEBUG:teuthology.parallel:result is None 2023-09-29T23:23:17.285 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=93dce5e17918f8aca65993a7a2dc40233a47b481 2023-09-29T23:23:17.513 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-29T23:23:17.532 INFO:teuthology.orchestra.run.smithi092.stdout:17.2.6-1165.g93dce5e1.el8 2023-09-29T23:23:17.533 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1165.g93dce5e1.el8 2023-09-29T23:23:17.533 INFO:teuthology.task.install:The correct ceph version 17.2.6-1165.g93dce5e1 is installed. 2023-09-29T23:23:17.533 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-29T23:23:17.533 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:17.533 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-29T23:23:17.598 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-29T23:23:17.599 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:17.599 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2023-09-29T23:23:17.666 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-29T23:23:17.730 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-29T23:23:17.730 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:17.730 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-29T23:23:17.794 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-29T23:23:17.857 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-29T23:23:17.858 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:17.858 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2023-09-29T23:23:17.921 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-29T23:23:17.986 INFO:teuthology.run_tasks:Running task ceph... 2023-09-29T23:23:18.055 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-29T23:23:18.055 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /var/log/ceph 2023-09-29T23:23:18.078 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-29T23:23:18.079 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-29T23:23:18.143 INFO:tasks.ceph:Creating extra log directories... 2023-09-29T23:23:18.143 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-29T23:23:18.215 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-29T23:23:18.215 INFO:tasks.ceph:config {'conf': {'global': {'debug client': 20, 'debug mds': 20, 'debug ms': 1, 'osd max object name len': 460, 'osd max object namespace len': 64, 'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-29T23:23:18.215 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406546', 'branch': 'wip-yuri4-testing-2023-09-29-0928-quincy', 'description': 'rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7406546', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2023-09-29-0928-quincy'}, 'ceph': {'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'branch': 'wip-yuri4-testing-2023-09-29-0928-quincy', 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'client.0', 'client.1']], 'seed': 9810, 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri4-testing-2023-09-29-0928-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481', 'targets': {'smithi092.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMhfltsGKpUmCXl1oABVs8wfFdkdTW1lrepqc4TEsJ0l5wV1QeJJcASKfZIDDGp5/pPXF1kFdXK18YfJGJ0MCzk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'global': {'debug client': 20, 'debug mds': 20, 'debug ms': 1, 'osd max object name len': 460, 'osd max object namespace len': 64, 'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'log-ignorelist': ['overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'flavor': 'default', 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481', 'cluster': 'ceph'}}, {'exec': {'client.0': ['ceph osd pool create data_cache 4', 'ceph osd tier add cephfs_data data_cache', 'ceph osd tier cache-mode data_cache writeback', 'ceph osd tier set-overlay cephfs_data data_cache', 'ceph osd pool set data_cache hit_set_type bloom', 'ceph osd pool set data_cache hit_set_count 8', 'ceph osd pool set data_cache hit_set_period 3600', 'ceph osd pool set data_cache min_read_recency_for_promote 0']}}, {'ceph-fuse': None}, {'exec': {'client.0': ['sudo chmod 777 $TESTDIR/mnt.0/', 'dd if=/dev/urandom of=$TESTDIR/mnt.0/foo bs=1M count=5', 'ls -al $TESTDIR/mnt.0/foo', 'truncate --size 0 $TESTDIR/mnt.0/foo', 'ls -al $TESTDIR/mnt.0/foo', 'dd if=/dev/urandom of=$TESTDIR/mnt.0/foo bs=1M count=5', 'ls -al $TESTDIR/mnt.0/foo', 'cp $TESTDIR/mnt.0/foo /tmp/foo', 'sync', 'rados -p data_cache ls -', 'sleep 10', 'rados -p data_cache ls -', 'rados -p data_cache cache-flush-evict-all', 'rados -p data_cache ls -', 'sleep 1']}}, {'exec': {'client.1': ['hexdump -C /tmp/foo | head', 'hexdump -C $TESTDIR/mnt.1/foo | head', 'cmp $TESTDIR/mnt.1/foo /tmp/foo']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-29_19:38:56', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-09-29T23:23:18.215 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-29T23:23:18.262 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/run/ceph 2023-09-29T23:23:18.326 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:18.326 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2023-09-29T23:23:18.380 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-29T23:23:18.381 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2023-09-29T23:23:18.436 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-29T23:23:18.436 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-29T23:23:18.436 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 217287 Links: 1 2023-09-29T23:23:18.436 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-29T23:23:18.436 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-09-29T23:23:18.436 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-09-29 23:23:05.391066662 +0000 2023-09-29T23:23:18.436 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-09-29 23:18:11.364030858 +0000 2023-09-29T23:23:18.437 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-09-29 23:18:11.364030858 +0000 2023-09-29T23:23:18.437 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-09-29T23:23:18.437 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-29T23:23:18.498 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-09-29T23:23:18.498 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-09-29T23:23:18.498 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000250632 s, 2.0 MB/s 2023-09-29T23:23:18.499 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-29T23:23:18.555 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2023-09-29T23:23:18.610 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-29T23:23:18.610 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-29T23:23:18.611 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 221216 Links: 1 2023-09-29T23:23:18.611 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-29T23:23:18.611 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-09-29T23:23:18.611 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-09-29 23:23:05.391066662 +0000 2023-09-29T23:23:18.611 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-09-29 23:18:11.856016501 +0000 2023-09-29T23:23:18.611 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-09-29 23:18:11.856016501 +0000 2023-09-29T23:23:18.611 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-09-29T23:23:18.611 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-29T23:23:18.674 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-09-29T23:23:18.674 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-09-29T23:23:18.674 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000205347 s, 2.5 MB/s 2023-09-29T23:23:18.675 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-29T23:23:18.730 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2023-09-29T23:23:18.786 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-29T23:23:18.786 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-29T23:23:18.786 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 216860 Links: 1 2023-09-29T23:23:18.786 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-29T23:23:18.786 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-09-29T23:23:18.786 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-09-29 23:23:05.391066662 +0000 2023-09-29T23:23:18.786 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-09-29 23:18:12.339002407 +0000 2023-09-29T23:23:18.786 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-09-29 23:18:12.339002407 +0000 2023-09-29T23:23:18.787 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-09-29T23:23:18.787 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-29T23:23:18.849 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-09-29T23:23:18.849 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-09-29T23:23:18.850 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000236949 s, 2.2 MB/s 2023-09-29T23:23:18.850 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-29T23:23:18.907 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2023-09-29T23:23:18.962 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-29T23:23:18.962 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-29T23:23:18.962 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 217429 Links: 1 2023-09-29T23:23:18.962 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-29T23:23:18.962 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-09-29T23:23:18.962 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-09-29 23:23:05.391066662 +0000 2023-09-29T23:23:18.962 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-09-29 23:18:12.821988312 +0000 2023-09-29T23:23:18.962 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-09-29 23:18:12.821988312 +0000 2023-09-29T23:23:18.962 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-09-29T23:23:18.963 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-29T23:23:19.024 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-09-29T23:23:19.025 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-09-29T23:23:19.025 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000191008 s, 2.7 MB/s 2023-09-29T23:23:19.025 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-29T23:23:19.082 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-09-29T23:23:19.082 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-09-29T23:23:19.082 INFO:tasks.ceph:Generating config... 2023-09-29T23:23:19.083 INFO:tasks.ceph:[global] debug client = 20 2023-09-29T23:23:19.083 INFO:tasks.ceph:[global] debug mds = 20 2023-09-29T23:23:19.083 INFO:tasks.ceph:[global] debug ms = 1 2023-09-29T23:23:19.083 INFO:tasks.ceph:[global] osd max object name len = 460 2023-09-29T23:23:19.083 INFO:tasks.ceph:[global] osd max object namespace len = 64 2023-09-29T23:23:19.084 INFO:tasks.ceph:[global] mon election default strategy = 1 2023-09-29T23:23:19.084 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-29T23:23:19.084 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-29T23:23:19.084 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-29T23:23:19.084 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-29T23:23:19.084 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-29T23:23:19.084 INFO:tasks.ceph:[mon] mon scrub interval = 300 2023-09-29T23:23:19.084 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2023-09-29T23:23:19.084 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-29T23:23:19.084 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-29T23:23:19.084 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2023-09-29T23:23:19.084 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2023-09-29T23:23:19.085 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2023-09-29T23:23:19.085 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2023-09-29T23:23:19.085 INFO:tasks.ceph:[osd] osd op queue = debug_random 2023-09-29T23:23:19.085 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2023-09-29T23:23:19.085 INFO:tasks.ceph:Setting up mon.a... 2023-09-29T23:23:19.085 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-29T23:23:19.161 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.keyring 2023-09-29T23:23:19.163 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-29T23:23:19.242 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-29T23:23:19.306 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.92')] 2023-09-29T23:23:19.306 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.92', 'debug client': 20, 'debug mds': 20, 'debug ms': 1, 'osd max object name len': 460, 'osd max object namespace len': 64, 'mon election default strategy': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mds.a': {}} 2023-09-29T23:23:19.307 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:19.307 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-29T23:23:19.360 DEBUG:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.92 --print /home/ubuntu/cephtest/ceph.monmap 2023-09-29T23:23:19.437 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-29T23:23:19.437 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool: generated fsid 5b80eae7-9a7e-4dc0-8ff1-cd1f82a1fa33 2023-09-29T23:23:19.437 INFO:teuthology.orchestra.run.smithi092.stdout:setting min_mon_release = octopus 2023-09-29T23:23:19.438 INFO:teuthology.orchestra.run.smithi092.stdout:epoch 0 2023-09-29T23:23:19.438 INFO:teuthology.orchestra.run.smithi092.stdout:fsid 5b80eae7-9a7e-4dc0-8ff1-cd1f82a1fa33 2023-09-29T23:23:19.438 INFO:teuthology.orchestra.run.smithi092.stdout:last_changed 2023-09-29T23:23:19.438274+0000 2023-09-29T23:23:19.438 INFO:teuthology.orchestra.run.smithi092.stdout:created 2023-09-29T23:23:19.438274+0000 2023-09-29T23:23:19.438 INFO:teuthology.orchestra.run.smithi092.stdout:min_mon_release 15 (octopus) 2023-09-29T23:23:19.438 INFO:teuthology.orchestra.run.smithi092.stdout:election_strategy: 1 2023-09-29T23:23:19.438 INFO:teuthology.orchestra.run.smithi092.stdout:0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2023-09-29T23:23:19.438 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-09-29T23:23:19.439 DEBUG:teuthology.orchestra.run.smithi092:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-29T23:23:19.493 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5b80eae7-9a7e-4dc0-8ff1-cd1f82a1fa33... 2023-09-29T23:23:19.495 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-29T23:23:19.576 INFO:teuthology.orchestra.run.smithi092.stdout:[global] 2023-09-29T23:23:19.576 INFO:teuthology.orchestra.run.smithi092.stdout: chdir = "" 2023-09-29T23:23:19.576 INFO:teuthology.orchestra.run.smithi092.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-29T23:23:19.576 INFO:teuthology.orchestra.run.smithi092.stdout: auth supported = cephx 2023-09-29T23:23:19.576 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.577 INFO:teuthology.orchestra.run.smithi092.stdout: filestore xattr use omap = true 2023-09-29T23:23:19.577 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.577 INFO:teuthology.orchestra.run.smithi092.stdout: mon clock drift allowed = 1.000 2023-09-29T23:23:19.577 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.577 INFO:teuthology.orchestra.run.smithi092.stdout: osd crush chooseleaf type = 0 2023-09-29T23:23:19.577 INFO:teuthology.orchestra.run.smithi092.stdout: auth debug = true 2023-09-29T23:23:19.577 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.577 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on old message = true 2023-09-29T23:23:19.577 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on bug = true 2023-09-29T23:23:19.577 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.577 INFO:teuthology.orchestra.run.smithi092.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-29T23:23:19.578 INFO:teuthology.orchestra.run.smithi092.stdout: mon pg warn max object skew = 0 2023-09-29T23:23:19.578 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.578 INFO:teuthology.orchestra.run.smithi092.stdout: # disable pg_autoscaler by default for new pools 2023-09-29T23:23:19.578 INFO:teuthology.orchestra.run.smithi092.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-29T23:23:19.578 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.578 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default size = 2 2023-09-29T23:23:19.579 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.579 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow primary affinity = true 2023-09-29T23:23:19.579 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow pg remap = true 2023-09-29T23:23:19.579 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on legacy crush tunables = false 2023-09-29T23:23:19.579 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on crush straw calc version zero = false 2023-09-29T23:23:19.579 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on no sortbitwise = false 2023-09-29T23:23:19.579 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on osd down out interval zero = false 2023-09-29T23:23:19.579 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on too few osds = false 2023-09-29T23:23:19.579 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-29T23:23:19.580 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-29T23:23:19.580 INFO:teuthology.orchestra.run.smithi092.stdout: mon_allow_pool_size_one = true 2023-09-29T23:23:19.580 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.580 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-29T23:23:19.580 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.580 INFO:teuthology.orchestra.run.smithi092.stdout: osd default data pool replay window = 5 2023-09-29T23:23:19.580 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.580 INFO:teuthology.orchestra.run.smithi092.stdout: mon allow pool delete = true 2023-09-29T23:23:19.580 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.580 INFO:teuthology.orchestra.run.smithi092.stdout: mon cluster log file level = debug 2023-09-29T23:23:19.580 INFO:teuthology.orchestra.run.smithi092.stdout: debug asserts on shutdown = true 2023-09-29T23:23:19.581 INFO:teuthology.orchestra.run.smithi092.stdout: mon health detail to clog = false 2023-09-29T23:23:19.581 INFO:teuthology.orchestra.run.smithi092.stdout: mon host = 172.21.15.92 2023-09-29T23:23:19.581 INFO:teuthology.orchestra.run.smithi092.stdout: debug client = 20 2023-09-29T23:23:19.581 INFO:teuthology.orchestra.run.smithi092.stdout: debug mds = 20 2023-09-29T23:23:19.581 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-09-29T23:23:19.581 INFO:teuthology.orchestra.run.smithi092.stdout: osd max object name len = 460 2023-09-29T23:23:19.581 INFO:teuthology.orchestra.run.smithi092.stdout: osd max object namespace len = 64 2023-09-29T23:23:19.581 INFO:teuthology.orchestra.run.smithi092.stdout: mon election default strategy = 1 2023-09-29T23:23:19.581 INFO:teuthology.orchestra.run.smithi092.stdout: fsid = 5b80eae7-9a7e-4dc0-8ff1-cd1f82a1fa33 2023-09-29T23:23:19.581 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.581 INFO:teuthology.orchestra.run.smithi092.stdout:[osd] 2023-09-29T23:23:19.582 INFO:teuthology.orchestra.run.smithi092.stdout: osd journal size = 100 2023-09-29T23:23:19.582 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.582 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub load threshold = 5.0 2023-09-29T23:23:19.582 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub max interval = 600 2023-09-29T23:23:19.582 INFO:teuthology.orchestra.run.smithi092.stdout: osd mclock profile = high_recovery_ops 2023-09-29T23:23:19.582 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.583 INFO:teuthology.orchestra.run.smithi092.stdout: osd recover clone overlap = true 2023-09-29T23:23:19.583 INFO:teuthology.orchestra.run.smithi092.stdout: osd recovery max chunk = 1048576 2023-09-29T23:23:19.583 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.583 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug shutdown = true 2023-09-29T23:23:19.583 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug op order = true 2023-09-29T23:23:19.583 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug verify stray on activate = true 2023-09-29T23:23:19.584 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.584 INFO:teuthology.orchestra.run.smithi092.stdout: osd open classes on start = true 2023-09-29T23:23:19.584 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug pg log writeout = true 2023-09-29T23:23:19.584 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.584 INFO:teuthology.orchestra.run.smithi092.stdout: osd deep scrub update digest min age = 30 2023-09-29T23:23:19.584 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.585 INFO:teuthology.orchestra.run.smithi092.stdout: osd map max advance = 10 2023-09-29T23:23:19.585 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.585 INFO:teuthology.orchestra.run.smithi092.stdout: journal zero on create = true 2023-09-29T23:23:19.585 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.585 INFO:teuthology.orchestra.run.smithi092.stdout: filestore ondisk finisher threads = 3 2023-09-29T23:23:19.585 INFO:teuthology.orchestra.run.smithi092.stdout: filestore apply finisher threads = 3 2023-09-29T23:23:19.586 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.586 INFO:teuthology.orchestra.run.smithi092.stdout: bdev debug aio = true 2023-09-29T23:23:19.586 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug misdirected ops = true 2023-09-29T23:23:19.586 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore zero block detection = True 2023-09-29T23:23:19.586 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-09-29T23:23:19.586 INFO:teuthology.orchestra.run.smithi092.stdout: debug osd = 20 2023-09-29T23:23:19.586 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug verify cached snaps = True 2023-09-29T23:23:19.587 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug verify missing on start = True 2023-09-29T23:23:19.587 INFO:teuthology.orchestra.run.smithi092.stdout: osd mclock override recovery settings = True 2023-09-29T23:23:19.587 INFO:teuthology.orchestra.run.smithi092.stdout: osd op queue = debug_random 2023-09-29T23:23:19.587 INFO:teuthology.orchestra.run.smithi092.stdout: osd op queue cut off = debug_random 2023-09-29T23:23:19.587 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.587 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr] 2023-09-29T23:23:19.587 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-09-29T23:23:19.587 INFO:teuthology.orchestra.run.smithi092.stdout: debug mgr = 20 2023-09-29T23:23:19.587 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2023-09-29T23:23:19.588 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2023-09-29T23:23:19.588 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2023-09-29T23:23:19.588 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2023-09-29T23:23:19.588 INFO:teuthology.orchestra.run.smithi092.stdout: mgr/telemetry/nag = false 2023-09-29T23:23:19.588 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.588 INFO:teuthology.orchestra.run.smithi092.stdout:[mon] 2023-09-29T23:23:19.588 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-09-29T23:23:19.588 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2023-09-29T23:23:19.589 INFO:teuthology.orchestra.run.smithi092.stdout: debug paxos = 20 2023-09-29T23:23:19.589 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2023-09-29T23:23:19.589 INFO:teuthology.orchestra.run.smithi092.stdout: mon data avail warn = 5 2023-09-29T23:23:19.589 INFO:teuthology.orchestra.run.smithi092.stdout: mon mgr mkfs grace = 240 2023-09-29T23:23:19.589 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2023-09-29T23:23:19.589 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd reporter subtree level = osd 2023-09-29T23:23:19.590 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd prime pg temp = true 2023-09-29T23:23:19.590 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2023-09-29T23:23:19.590 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.590 INFO:teuthology.orchestra.run.smithi092.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-29T23:23:19.590 INFO:teuthology.orchestra.run.smithi092.stdout: auth mon ticket ttl = 660 # 11m 2023-09-29T23:23:19.590 INFO:teuthology.orchestra.run.smithi092.stdout: auth service ticket ttl = 240 # 4m 2023-09-29T23:23:19.590 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.590 INFO:teuthology.orchestra.run.smithi092.stdout: # don't complain about insecure global_id in the test suite 2023-09-29T23:23:19.591 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-29T23:23:19.591 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-29T23:23:19.591 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.591 INFO:teuthology.orchestra.run.smithi092.stdout: # 1m isn't quite enough 2023-09-29T23:23:19.591 INFO:teuthology.orchestra.run.smithi092.stdout: mon_down_mkfs_grace = 2m 2023-09-29T23:23:19.591 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.591 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_filestore_osds = false 2023-09-29T23:23:19.591 INFO:teuthology.orchestra.run.smithi092.stdout: mon scrub interval = 300 2023-09-29T23:23:19.591 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:19.591 INFO:teuthology.orchestra.run.smithi092.stdout:[client] 2023-09-29T23:23:19.592 INFO:teuthology.orchestra.run.smithi092.stdout: rgw cache enabled = true 2023-09-29T23:23:19.592 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable ops log = true 2023-09-29T23:23:19.592 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable usage log = true 2023-09-29T23:23:19.592 INFO:teuthology.orchestra.run.smithi092.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-29T23:23:19.592 INFO:teuthology.orchestra.run.smithi092.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-29T23:23:19.592 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.a] 2023-09-29T23:23:19.592 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a] 2023-09-29T23:23:19.593 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-29T23:23:19.593 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-29T23:23:19.684 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-29T23:23:19.684 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:19.684 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-29T23:23:19.699 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:19.699 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-29T23:23:19.753 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi092.front.sepia.ceph.com 2023-09-29T23:23:19.754 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:19.754 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-29T23:23:19.754 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-29T23:23:19.829 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:19.829 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-29T23:23:19.883 INFO:tasks.ceph:Setting up mon nodes... 2023-09-29T23:23:19.884 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-29T23:23:19.884 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-29T23:23:19.971 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-29T23:23:19.974 INFO:tasks.ceph:Setting up mds nodes... 2023-09-29T23:23:19.974 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-29T23:23:20.021 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-29T23:23:20.023 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-29T23:23:20.047 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-29T23:23:20.048 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-29T23:23:20.125 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-29T23:23:20.138 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-09-29T23:23:20.215 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-09-29T23:23:20.228 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-29T23:23:20.228 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-09-29T23:23:20.228 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-29T23:23:20.292 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-09-29T23:23:20.292 INFO:tasks.ceph:role: osd.0 2023-09-29T23:23:20.292 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com 2023-09-29T23:23:20.292 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-29T23:23:20.363 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-29T23:23:20.363 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-29T23:23:20.363 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-29T23:23:20.363 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 2023-09-29T23:23:20.363 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-29T23:23:20.363 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-09-29T23:23:20.364 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-29T23:23:20.364 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-29T23:23:20.364 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-29T23:23:20.364 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-29T23:23:20.799 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-09-29T23:23:20.801 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-09-29T23:23:20.801 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-29T23:23:20.967 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-29T23:23:21.001 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-29T23:23:21.066 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-09-29T23:23:21.066 INFO:tasks.ceph:role: osd.1 2023-09-29T23:23:21.066 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com 2023-09-29T23:23:21.066 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-29T23:23:21.137 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-29T23:23:21.137 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-29T23:23:21.137 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-29T23:23:21.137 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 2023-09-29T23:23:21.138 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-29T23:23:21.138 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-09-29T23:23:21.138 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-29T23:23:21.138 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-29T23:23:21.138 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-29T23:23:21.138 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-29T23:23:21.559 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-09-29T23:23:21.560 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-09-29T23:23:21.561 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-29T23:23:21.668 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-29T23:23:21.697 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-29T23:23:21.761 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-09-29T23:23:21.762 INFO:tasks.ceph:role: osd.2 2023-09-29T23:23:21.762 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com 2023-09-29T23:23:21.762 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-29T23:23:21.833 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-29T23:23:21.833 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-29T23:23:21.834 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-29T23:23:21.834 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 2023-09-29T23:23:21.834 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-29T23:23:21.834 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-09-29T23:23:21.834 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-29T23:23:21.834 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-29T23:23:21.834 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-29T23:23:21.834 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-29T23:23:22.290 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-09-29T23:23:22.292 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-09-29T23:23:22.292 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-29T23:23:22.431 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-29T23:23:22.460 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-29T23:23:22.547 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:22.547+0000 7f17db08a540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-29T23:23:22.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:22.551+0000 7f17db08a540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-29T23:23:22.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:22.551+0000 7f17db08a540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-29T23:23:22.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:22.551+0000 7f17db08a540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-29T23:23:22.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:22.551+0000 7f17db08a540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-29T23:23:22.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:22.552+0000 7f17db08a540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-29T23:23:23.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:23.076+0000 7f17db08a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-29T23:23:23.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:23.844+0000 7f17db08a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-29T23:23:24.632 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-29T23:23:24.661 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-29T23:23:24.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:24.750+0000 7fe69bf54540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-29T23:23:24.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:24.750+0000 7fe69bf54540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-29T23:23:24.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:24.750+0000 7fe69bf54540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-29T23:23:24.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:24.750+0000 7fe69bf54540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-29T23:23:24.753 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:24.750+0000 7fe69bf54540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-29T23:23:24.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:24.750+0000 7fe69bf54540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-29T23:23:25.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:25.273+0000 7fe69bf54540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-29T23:23:26.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:26.039+0000 7fe69bf54540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-29T23:23:26.824 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-29T23:23:26.853 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-29T23:23:26.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:26.936+0000 7fe828da6540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-29T23:23:26.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:26.936+0000 7fe828da6540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-29T23:23:26.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:26.936+0000 7fe828da6540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-29T23:23:26.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:26.936+0000 7fe828da6540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-29T23:23:26.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:26.936+0000 7fe828da6540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-29T23:23:26.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:26.936+0000 7fe828da6540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-29T23:23:27.461 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:27.461+0000 7fe828da6540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-29T23:23:28.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:28.224+0000 7fe828da6540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-29T23:23:29.007 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-29T23:23:29.074 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-29T23:23:29.075 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:29.075 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-29T23:23:29.141 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:29.141 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-29T23:23:29.206 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:29.207 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-29T23:23:29.272 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:29.272 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-29T23:23:29.336 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:29.336 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-29T23:23:29.400 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:29.400 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-29T23:23:29.454 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:29.454 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-09-29T23:23:29.509 INFO:tasks.ceph:Adding keys to all mons... 2023-09-29T23:23:29.509 DEBUG:teuthology.orchestra.run.smithi092:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-29T23:23:29.571 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.x] 2023-09-29T23:23:29.572 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBnXBdlIZ/6ORAAGbhwwZJ3FIxwLsNO5fHn1w== 2023-09-29T23:23:29.572 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a] 2023-09-29T23:23:29.572 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBoXBdlVrJTARAAH5LcOFV453AsAm7Naq73NQ== 2023-09-29T23:23:29.572 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.0] 2023-09-29T23:23:29.572 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBqXBdlHc60IBAAUNsyQH1Sw9P31f493FXngA== 2023-09-29T23:23:29.572 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.1] 2023-09-29T23:23:29.572 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBsXBdlrg/FLBAAnG9ljlOyqK+iTVSyRybgKg== 2023-09-29T23:23:29.572 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.2] 2023-09-29T23:23:29.572 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBuXBdlrezZNxAAtelV1Zhr0PMiNDRwNtb8DQ== 2023-09-29T23:23:29.573 INFO:teuthology.orchestra.run.smithi092.stdout:[client.0] 2023-09-29T23:23:29.573 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBoXBdlGtCJBxAAfo2katGE9smLBMIk7gOn4w== 2023-09-29T23:23:29.573 INFO:teuthology.orchestra.run.smithi092.stdout:[client.1] 2023-09-29T23:23:29.573 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQBoXBdl5zLpDBAAZyzgLvHD3YINHWRU4/zzfQ== 2023-09-29T23:23:29.574 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-29T23:23:29.660 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-29T23:23:29.709 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-29T23:23:29.755 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-29T23:23:29.802 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-29T23:23:29.848 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-29T23:23:29.898 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-29T23:23:29.947 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-29T23:23:29.947 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-29T23:23:29.971 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-29T23:23:30.062 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-29T23:23:30.086 DEBUG:teuthology.orchestra.run.smithi092:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-29T23:23:30.142 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-29T23:23:30.142 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-29T23:23:30.142 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-29T23:23:30.184 INFO:tasks.ceph.mon.a:Started 2023-09-29T23:23:30.184 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph config set mgr mgr_pool false --force 2023-09-29T23:23:30.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.300+0000 7fe1daa80700 1 Processor -- start 2023-09-29T23:23:30.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.300+0000 7fe1daa80700 1 -- start start 2023-09-29T23:23:30.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.300+0000 7fe1daa80700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe1d4132390 0x7fe1d4134770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:30.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.300+0000 7fe1daa80700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d409b500 con 0x7fe1d412f510 2023-09-29T23:23:30.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.300+0000 7fe1daa80700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d4068da0 con 0x7fe1d4132390 2023-09-29T23:23:30.301 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.300+0000 7fe1d927d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe1d4132390 0x7fe1d4134770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:30.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.300+0000 7fe1d9a7e700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fe1d412f510 0x7fe1d412f8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:49890/0 (socket says 172.21.15.92:49890) 2023-09-29T23:23:30.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.300+0000 7fe1d9a7e700 1 -- 172.21.15.92:0/607150164 learned_addr learned my addr 172.21.15.92:0/607150164 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:30.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.301+0000 7fe1d927d700 1 -- 172.21.15.92:0/607150164 >> v2:172.21.15.92:3300/0 conn(0x7fe1d4132390 msgr2=0x7fe1d4134770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-29T23:23:30.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.301+0000 7fe1d927d700 1 -- 172.21.15.92:0/607150164 >> v2:172.21.15.92:3300/0 conn(0x7fe1d4132390 msgr2=0x7fe1d4134770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-29T23:23:30.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.301+0000 7fe1d927d700 1 --2- 172.21.15.92:0/607150164 >> v2:172.21.15.92:3300/0 conn(0x7fe1d4132390 0x7fe1d4134770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-29T23:23:30.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.301+0000 7fe1d927d700 1 --2- 172.21.15.92:0/607150164 >> v2:172.21.15.92:3300/0 conn(0x7fe1d4132390 0x7fe1d4134770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-29T23:23:30.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.324+0000 7fe1d8a7c700 1 -- 172.21.15.92:0/607150164 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119725162 0 0) 0x7fe1d409b500 con 0x7fe1d412f510 2023-09-29T23:23:30.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.324+0000 7fe1d8a7c700 1 -- 172.21.15.92:0/607150164 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1c0003570 con 0x7fe1d412f510 2023-09-29T23:23:30.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.325+0000 7fe1d8a7c700 1 -- 172.21.15.92:0/607150164 <== mon.0 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4284011348 0 0) 0x7fe1c0003570 con 0x7fe1d412f510 2023-09-29T23:23:30.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.325+0000 7fe1d8a7c700 1 -- 172.21.15.92:0/607150164 >> v2:172.21.15.92:3300/0 conn(0x7fe1d4132390 msgr2=0x7fe1d4134770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-29T23:23:30.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.325+0000 7fe1d8a7c700 1 --2- 172.21.15.92:0/607150164 >> v2:172.21.15.92:3300/0 conn(0x7fe1d4132390 0x7fe1d4134770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:30.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.325+0000 7fe1d8a7c700 1 -- 172.21.15.92:0/607150164 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d412f070 con 0x7fe1d412f510 2023-09-29T23:23:30.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.325+0000 7fe1d8a7c700 1 -- 172.21.15.92:0/607150164 <== mon.0 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 1039577708 0 0) 0x7fe1d00015b0 con 0x7fe1d412f510 2023-09-29T23:23:30.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.325+0000 7fe1d8a7c700 1 -- 172.21.15.92:0/607150164 >> v1:172.21.15.92:6789/0 conn(0x7fe1d412f510 legacy=0x7fe1d412f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:30.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.325+0000 7fe1d8a7c700 1 --2- 172.21.15.92:0/607150164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c0003a60 0x7fe1c0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:30.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.325+0000 7fe1d8a7c700 1 -- 172.21.15.92:0/607150164 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d4068da0 con 0x7fe1c0003a60 2023-09-29T23:23:30.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.325+0000 7fe1d9a7e700 1 --2- 172.21.15.92:0/607150164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c0003a60 0x7fe1c0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:30.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.325+0000 7fe1d9a7e700 1 -- 172.21.15.92:0/607150164 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c0003570 con 0x7fe1c0003a60 2023-09-29T23:23:30.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.325+0000 7fe1d9a7e700 1 --2- 172.21.15.92:0/607150164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c0003a60 0x7fe1c0003e50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000c2c0 tx=0x7fe1d409ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab5e0eb8aac4618 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:30.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.325+0000 7fe1d8a7c700 1 -- 172.21.15.92:0/607150164 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1d000cbf0 con 0x7fe1c0003a60 2023-09-29T23:23:30.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.325+0000 7fe1d8a7c700 1 -- 172.21.15.92:0/607150164 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d000cd50 con 0x7fe1c0003a60 2023-09-29T23:23:30.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.325+0000 7fe1d8a7c700 1 -- 172.21.15.92:0/607150164 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1d0005920 con 0x7fe1c0003a60 2023-09-29T23:23:30.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.326+0000 7fe1daa80700 1 -- 172.21.15.92:0/607150164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c0003a60 msgr2=0x7fe1c0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:30.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.326+0000 7fe1daa80700 1 --2- 172.21.15.92:0/607150164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c0003a60 0x7fe1c0003e50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000c2c0 tx=0x7fe1d409ac60 comp rx=0 tx=0).stop 2023-09-29T23:23:30.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.326+0000 7fe1daa80700 1 -- 172.21.15.92:0/607150164 shutdown_connections 2023-09-29T23:23:30.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.326+0000 7fe1daa80700 1 --2- 172.21.15.92:0/607150164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c0003a60 0x7fe1c0003e50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:30.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.326+0000 7fe1daa80700 1 --2- 172.21.15.92:0/607150164 >> v2:172.21.15.92:3300/0 conn(0x7fe1d4132390 0x7fe1d4134770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:30.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.326+0000 7fe1daa80700 1 -- 172.21.15.92:0/607150164 >> 172.21.15.92:0/607150164 conn(0x7fe1d409f0c0 msgr2=0x7fe1d409f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:30.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.326+0000 7fe1daa80700 1 -- 172.21.15.92:0/607150164 shutdown_connections 2023-09-29T23:23:30.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.326+0000 7fe1daa80700 1 -- 172.21.15.92:0/607150164 wait complete. 2023-09-29T23:23:30.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.327+0000 7fe1daa80700 1 Processor -- start 2023-09-29T23:23:30.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.327+0000 7fe1daa80700 1 -- start start 2023-09-29T23:23:30.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.327+0000 7fe1daa80700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c0003a60 0x7fe1d4119b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:30.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.327+0000 7fe1daa80700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d406f4c0 con 0x7fe1c0003a60 2023-09-29T23:23:30.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.327+0000 7fe1d9a7e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c0003a60 0x7fe1d4119b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:30.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.327+0000 7fe1d9a7e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c0003a60 0x7fe1d4119b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36912/0 (socket says 172.21.15.92:36912) 2023-09-29T23:23:30.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.327+0000 7fe1d9a7e700 1 -- 172.21.15.92:0/3246910792 learned_addr learned my addr 172.21.15.92:0/3246910792 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:30.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.327+0000 7fe1d9a7e700 1 -- 172.21.15.92:0/3246910792 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d411c730 con 0x7fe1c0003a60 2023-09-29T23:23:30.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.328+0000 7fe1d9a7e700 1 --2- 172.21.15.92:0/3246910792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c0003a60 0x7fe1d4119b30 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40688c0 tx=0x7fe1d0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:30.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.328+0000 7fe1c9ffb700 1 -- 172.21.15.92:0/3246910792 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1d000cec0 con 0x7fe1c0003a60 2023-09-29T23:23:30.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.328+0000 7fe1c9ffb700 1 -- 172.21.15.92:0/3246910792 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d00011d0 con 0x7fe1c0003a60 2023-09-29T23:23:30.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.328+0000 7fe1daa80700 1 -- 172.21.15.92:0/3246910792 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d411cce0 con 0x7fe1c0003a60 2023-09-29T23:23:30.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.328+0000 7fe1c9ffb700 1 -- 172.21.15.92:0/3246910792 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1d0004b80 con 0x7fe1c0003a60 2023-09-29T23:23:30.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.328+0000 7fe1daa80700 1 -- 172.21.15.92:0/3246910792 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d412d9f0 con 0x7fe1c0003a60 2023-09-29T23:23:30.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.328+0000 7fe1c9ffb700 1 -- 172.21.15.92:0/3246910792 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe1d0019070 con 0x7fe1c0003a60 2023-09-29T23:23:30.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.328+0000 7fe1c9ffb700 1 -- 172.21.15.92:0/3246910792 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe1d00063f0 con 0x7fe1c0003a60 2023-09-29T23:23:30.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.329+0000 7fe1daa80700 1 -- 172.21.15.92:0/3246910792 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d412f270 con 0x7fe1c0003a60 2023-09-29T23:23:30.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.331+0000 7fe1c9ffb700 1 -- 172.21.15.92:0/3246910792 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe1d0017070 con 0x7fe1c0003a60 2023-09-29T23:23:30.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.398+0000 7fe1daa80700 1 -- 172.21.15.92:0/3246910792 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr_pool}] v 0) v1 -- 0x7fe1d405f230 con 0x7fe1c0003a60 2023-09-29T23:23:30.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.401+0000 7fe1c9ffb700 1 -- 172.21.15.92:0/3246910792 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr_pool}]=0 v2)=0 v2) v1 ==== 125+0+0 (secure 0 0 0) 0x7fe1d0006650 con 0x7fe1c0003a60 2023-09-29T23:23:30.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.402+0000 7fe1daa80700 1 -- 172.21.15.92:0/3246910792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c0003a60 msgr2=0x7fe1d4119b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:30.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.402+0000 7fe1daa80700 1 --2- 172.21.15.92:0/3246910792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c0003a60 0x7fe1d4119b30 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40688c0 tx=0x7fe1d0015000 comp rx=0 tx=0).stop 2023-09-29T23:23:30.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.402+0000 7fe1daa80700 1 -- 172.21.15.92:0/3246910792 shutdown_connections 2023-09-29T23:23:30.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.402+0000 7fe1daa80700 1 --2- 172.21.15.92:0/3246910792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1c0003a60 0x7fe1d4119b30 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:30.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.402+0000 7fe1daa80700 1 -- 172.21.15.92:0/3246910792 >> 172.21.15.92:0/3246910792 conn(0x7fe1d409f0c0 msgr2=0x7fe1d409e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:30.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.402+0000 7fe1daa80700 1 -- 172.21.15.92:0/3246910792 shutdown_connections 2023-09-29T23:23:30.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.402+0000 7fe1daa80700 1 -- 172.21.15.92:0/3246910792 wait complete. 2023-09-29T23:23:30.413 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-29T23:23:30.414 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-29T23:23:30.414 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-29T23:23:30.416 INFO:tasks.ceph.mgr.x:Started 2023-09-29T23:23:30.416 INFO:tasks.ceph:Setting crush tunables to default 2023-09-29T23:23:30.416 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd crush tunables default 2023-09-29T23:23:30.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.530+0000 7fee76841700 1 Processor -- start 2023-09-29T23:23:30.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.530+0000 7fee76841700 1 -- start start 2023-09-29T23:23:30.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.530+0000 7fee76841700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fee701304e0 0x7fee701328c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:30.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.530+0000 7fee76841700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7012d180 con 0x7fee7012d5d0 2023-09-29T23:23:30.531 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.530+0000 7fee76841700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7009aa90 con 0x7fee701304e0 2023-09-29T23:23:30.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.530+0000 7fee6f7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fee701304e0 0x7fee701328c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:30.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.530+0000 7fee6ffff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fee7012d5d0 0x7fee7012d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54220/0 (socket says 172.21.15.92:54220) 2023-09-29T23:23:30.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.530+0000 7fee6ffff700 1 -- 172.21.15.92:0/2783267962 learned_addr learned my addr 172.21.15.92:0/2783267962 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:30.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.531+0000 7fee6f7fe700 1 -- 172.21.15.92:0/2783267962 >> v1:172.21.15.92:6789/0 conn(0x7fee7012d5d0 legacy=0x7fee7012d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:30.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.531+0000 7fee6effd700 1 -- 172.21.15.92:0/2783267962 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071965881 0 0) 0x7fee7012d180 con 0x7fee7012d5d0 2023-09-29T23:23:30.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.531+0000 7fee6f7fe700 1 -- 172.21.15.92:0/2783267962 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7012e0b0 con 0x7fee701304e0 2023-09-29T23:23:30.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.531+0000 7fee6f7fe700 1 --2- 172.21.15.92:0/2783267962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee701304e0 0x7fee701328c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fee64009860 tx=0x7fee640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eff04ac351d69e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:30.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.531+0000 7fee6effd700 1 -- 172.21.15.92:0/2783267962 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee6400b680 con 0x7fee701304e0 2023-09-29T23:23:30.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.531+0000 7fee6effd700 1 -- 172.21.15.92:0/2783267962 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6400b7e0 con 0x7fee701304e0 2023-09-29T23:23:30.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.531+0000 7fee6effd700 1 -- 172.21.15.92:0/2783267962 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee6400bad0 con 0x7fee701304e0 2023-09-29T23:23:30.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.532+0000 7fee76841700 1 -- 172.21.15.92:0/2783267962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee701304e0 msgr2=0x7fee701328c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:30.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.532+0000 7fee76841700 1 --2- 172.21.15.92:0/2783267962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee701304e0 0x7fee701328c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fee64009860 tx=0x7fee640091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:30.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.532+0000 7fee76841700 1 -- 172.21.15.92:0/2783267962 shutdown_connections 2023-09-29T23:23:30.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.532+0000 7fee76841700 1 --2- 172.21.15.92:0/2783267962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee701304e0 0x7fee701328c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:30.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.532+0000 7fee76841700 1 -- 172.21.15.92:0/2783267962 >> 172.21.15.92:0/2783267962 conn(0x7fee7006bbd0 msgr2=0x7fee7006dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:30.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.532+0000 7fee76841700 1 -- 172.21.15.92:0/2783267962 shutdown_connections 2023-09-29T23:23:30.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.532+0000 7fee76841700 1 -- 172.21.15.92:0/2783267962 wait complete. 2023-09-29T23:23:30.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.532+0000 7fee76841700 1 Processor -- start 2023-09-29T23:23:30.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.533+0000 7fee76841700 1 -- start start 2023-09-29T23:23:30.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.533+0000 7fee76841700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee7012d5d0 0x7fee70129d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:30.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.533+0000 7fee76841700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee70119300 con 0x7fee7012d5d0 2023-09-29T23:23:30.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.533+0000 7fee6ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee7012d5d0 0x7fee70129d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:30.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.533+0000 7fee6ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee7012d5d0 0x7fee70129d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36932/0 (socket says 172.21.15.92:36932) 2023-09-29T23:23:30.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.533+0000 7fee6ffff700 1 -- 172.21.15.92:0/3790020904 learned_addr learned my addr 172.21.15.92:0/3790020904 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:30.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.533+0000 7fee6ffff700 1 -- 172.21.15.92:0/3790020904 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee64009420 con 0x7fee7012d5d0 2023-09-29T23:23:30.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.533+0000 7fee6ffff700 1 --2- 172.21.15.92:0/3790020904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee7012d5d0 0x7fee70129d70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fee6000c710 tx=0x7fee60007c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:30.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.534+0000 7fee57fff700 1 -- 172.21.15.92:0/3790020904 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee600074d0 con 0x7fee7012d5d0 2023-09-29T23:23:30.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.534+0000 7fee57fff700 1 -- 172.21.15.92:0/3790020904 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee60007650 con 0x7fee7012d5d0 2023-09-29T23:23:30.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.534+0000 7fee76841700 1 -- 172.21.15.92:0/3790020904 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee700952f0 con 0x7fee7012d5d0 2023-09-29T23:23:30.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.534+0000 7fee57fff700 1 -- 172.21.15.92:0/3790020904 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee60005970 con 0x7fee7012d5d0 2023-09-29T23:23:30.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.534+0000 7fee76841700 1 -- 172.21.15.92:0/3790020904 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee70119840 con 0x7fee7012d5d0 2023-09-29T23:23:30.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.534+0000 7fee57fff700 1 -- 172.21.15.92:0/3790020904 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fee60005d50 con 0x7fee7012d5d0 2023-09-29T23:23:30.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.534+0000 7fee57fff700 1 -- 172.21.15.92:0/3790020904 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fee60012750 con 0x7fee7012d5d0 2023-09-29T23:23:30.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.535+0000 7fee76841700 1 -- 172.21.15.92:0/3790020904 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee70116d40 con 0x7fee7012d5d0 2023-09-29T23:23:30.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.538+0000 7fee57fff700 1 -- 172.21.15.92:0/3790020904 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fee60017070 con 0x7fee7012d5d0 2023-09-29T23:23:30.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.613+0000 7fee76841700 1 -- 172.21.15.92:0/3790020904 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fee7005f230 con 0x7fee7012d5d0 2023-09-29T23:23:30.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.616+0000 7fee57fff700 1 -- 172.21.15.92:0/3790020904 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fee6001c580 con 0x7fee7012d5d0 2023-09-29T23:23:30.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.617+0000 7fee76841700 1 -- 172.21.15.92:0/3790020904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee7012d5d0 msgr2=0x7fee70129d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:30.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.617+0000 7fee76841700 1 --2- 172.21.15.92:0/3790020904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee7012d5d0 0x7fee70129d70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fee6000c710 tx=0x7fee60007c00 comp rx=0 tx=0).stop 2023-09-29T23:23:30.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.617+0000 7fee76841700 1 -- 172.21.15.92:0/3790020904 shutdown_connections 2023-09-29T23:23:30.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.617+0000 7fee76841700 1 --2- 172.21.15.92:0/3790020904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee7012d5d0 0x7fee70129d70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:30.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.617+0000 7fee76841700 1 -- 172.21.15.92:0/3790020904 >> 172.21.15.92:0/3790020904 conn(0x7fee7006bbd0 msgr2=0x7fee701308b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:30.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.617+0000 7fee76841700 1 -- 172.21.15.92:0/3790020904 shutdown_connections 2023-09-29T23:23:30.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.617+0000 7fee76841700 1 -- 172.21.15.92:0/3790020904 wait complete. 2023-09-29T23:23:30.618 INFO:teuthology.orchestra.run.smithi092.stderr:adjusted tunables profile to default 2023-09-29T23:23:30.629 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-29T23:23:30.629 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:30.629 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-29T23:23:30.653 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:30.654 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-29T23:23:30.719 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-09-29T23:23:30.719 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-29T23:23:30.784 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new ea64f859-a36f-4804-810d-2fe7081c9990 0 2023-09-29T23:23:30.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.939+0000 7faebd64a700 1 Processor -- start 2023-09-29T23:23:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.939+0000 7faebd64a700 1 -- start start 2023-09-29T23:23:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.939+0000 7faebd64a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7faeb81323d0 0x7faeb81347b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.939+0000 7faebd64a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb809ada0 con 0x7faeb812f350 2023-09-29T23:23:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.939+0000 7faebd64a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb806b650 con 0x7faeb81323d0 2023-09-29T23:23:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.940+0000 7faeb67fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7faeb81323d0 0x7faeb81347b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.940+0000 7faeb6ffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7faeb812f350 0x7faeb812f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54226/0 (socket says 172.21.15.92:54226) 2023-09-29T23:23:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.940+0000 7faeb6ffd700 1 -- 172.21.15.92:0/638868053 learned_addr learned my addr 172.21.15.92:0/638868053 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.940+0000 7faeb67fc700 1 -- 172.21.15.92:0/638868053 >> v1:172.21.15.92:6789/0 conn(0x7faeb812f350 legacy=0x7faeb812f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.940+0000 7faeb5ffb700 1 -- 172.21.15.92:0/638868053 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136326511 0 0) 0x7faeb809ada0 con 0x7faeb812f350 2023-09-29T23:23:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.940+0000 7faeb67fc700 1 -- 172.21.15.92:0/638868053 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb809b130 con 0x7faeb81323d0 2023-09-29T23:23:30.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.940+0000 7faeb67fc700 1 --2- 172.21.15.92:0/638868053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faeb81323d0 0x7faeb81347b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faea8009860 tx=0x7faea80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492c7036e4497db server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:30.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.940+0000 7faeb5ffb700 1 -- 172.21.15.92:0/638868053 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faea800b710 con 0x7faeb81323d0 2023-09-29T23:23:30.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.940+0000 7faeb5ffb700 1 -- 172.21.15.92:0/638868053 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea800b870 con 0x7faeb81323d0 2023-09-29T23:23:30.942 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.940+0000 7faeb5ffb700 1 -- 172.21.15.92:0/638868053 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faea800bb60 con 0x7faeb81323d0 2023-09-29T23:23:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.941+0000 7faebd64a700 1 -- 172.21.15.92:0/638868053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faeb81323d0 msgr2=0x7faeb81347b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.941+0000 7faebd64a700 1 --2- 172.21.15.92:0/638868053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faeb81323d0 0x7faeb81347b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faea8009860 tx=0x7faea80091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.941+0000 7faebd64a700 1 -- 172.21.15.92:0/638868053 shutdown_connections 2023-09-29T23:23:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.941+0000 7faebd64a700 1 --2- 172.21.15.92:0/638868053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faeb81323d0 0x7faeb81347b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.941+0000 7faebd64a700 1 -- 172.21.15.92:0/638868053 >> 172.21.15.92:0/638868053 conn(0x7faeb809b330 msgr2=0x7faeb809b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.941+0000 7faebd64a700 1 -- 172.21.15.92:0/638868053 shutdown_connections 2023-09-29T23:23:30.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.941+0000 7faebd64a700 1 -- 172.21.15.92:0/638868053 wait complete. 2023-09-29T23:23:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.942+0000 7faebd64a700 1 Processor -- start 2023-09-29T23:23:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.942+0000 7faebd64a700 1 -- start start 2023-09-29T23:23:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.942+0000 7faebd64a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faeb812f350 0x7faeb813e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.942+0000 7faebd64a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb811b2e0 con 0x7faeb812f350 2023-09-29T23:23:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.942+0000 7faeb6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faeb812f350 0x7faeb813e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.942+0000 7faeb6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faeb812f350 0x7faeb813e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36956/0 (socket says 172.21.15.92:36956) 2023-09-29T23:23:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.942+0000 7faeb6ffd700 1 -- 172.21.15.92:0/3207366970 learned_addr learned my addr 172.21.15.92:0/3207366970 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.943+0000 7faeb6ffd700 1 -- 172.21.15.92:0/3207366970 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea8009420 con 0x7faeb812f350 2023-09-29T23:23:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.943+0000 7faeb6ffd700 1 --2- 172.21.15.92:0/3207366970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faeb812f350 0x7faeb813e860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faeac00c710 tx=0x7faeac007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.943+0000 7fae9effd700 1 -- 172.21.15.92:0/3207366970 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faeac005c50 con 0x7faeb812f350 2023-09-29T23:23:30.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.943+0000 7fae9effd700 1 -- 172.21.15.92:0/3207366970 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac005db0 con 0x7faeb812f350 2023-09-29T23:23:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.943+0000 7faebd64a700 1 -- 172.21.15.92:0/3207366970 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb811c490 con 0x7faeb812f350 2023-09-29T23:23:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.943+0000 7fae9effd700 1 -- 172.21.15.92:0/3207366970 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faeac007230 con 0x7faeb812f350 2023-09-29T23:23:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.943+0000 7faebd64a700 1 -- 172.21.15.92:0/3207366970 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb811d0a0 con 0x7faeb812f350 2023-09-29T23:23:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.943+0000 7fae9effd700 1 -- 172.21.15.92:0/3207366970 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7faeac007610 con 0x7faeb812f350 2023-09-29T23:23:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.943+0000 7fae9effd700 1 -- 172.21.15.92:0/3207366970 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7faeac012400 con 0x7faeb812f350 2023-09-29T23:23:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.944+0000 7faebd64a700 1 -- 172.21.15.92:0/3207366970 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb805f230 con 0x7faeb812f350 2023-09-29T23:23:30.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:30.946+0000 7fae9effd700 1 -- 172.21.15.92:0/3207366970 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7faeac017070 con 0x7faeb812f350 2023-09-29T23:23:31.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.100+0000 7faebd64a700 1 -- 172.21.15.92:0/3207366970 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ea64f859-a36f-4804-810d-2fe7081c9990", "id": 0} v 0) v1 -- 0x7faeb806c100 con 0x7faeb812f350 2023-09-29T23:23:31.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.103+0000 7fae9effd700 1 -- 172.21.15.92:0/3207366970 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ea64f859-a36f-4804-810d-2fe7081c9990", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7faeac01c580 con 0x7faeb812f350 2023-09-29T23:23:31.104 INFO:teuthology.orchestra.run.smithi092.stdout:0 2023-09-29T23:23:31.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.104+0000 7faebd64a700 1 -- 172.21.15.92:0/3207366970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faeb812f350 msgr2=0x7faeb813e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:31.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.104+0000 7faebd64a700 1 --2- 172.21.15.92:0/3207366970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faeb812f350 0x7faeb813e860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faeac00c710 tx=0x7faeac007d90 comp rx=0 tx=0).stop 2023-09-29T23:23:31.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.104+0000 7faebd64a700 1 -- 172.21.15.92:0/3207366970 shutdown_connections 2023-09-29T23:23:31.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.104+0000 7faebd64a700 1 --2- 172.21.15.92:0/3207366970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faeb812f350 0x7faeb813e860 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:31.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.104+0000 7faebd64a700 1 -- 172.21.15.92:0/3207366970 >> 172.21.15.92:0/3207366970 conn(0x7faeb809b330 msgr2=0x7faeb8067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:31.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.104+0000 7faebd64a700 1 -- 172.21.15.92:0/3207366970 shutdown_connections 2023-09-29T23:23:31.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.104+0000 7faebd64a700 1 -- 172.21.15.92:0/3207366970 wait complete. 2023-09-29T23:23:31.116 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 2e9c0837-2887-469f-9dea-db4bde348578 1 2023-09-29T23:23:31.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.229+0000 7f594eac9700 1 Processor -- start 2023-09-29T23:23:31.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.229+0000 7f594eac9700 1 -- start start 2023-09-29T23:23:31.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.230+0000 7f594eac9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f594812faa0 0x7f59481344f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:31.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.230+0000 7f594eac9700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f594806fc70 con 0x7f594806f280 2023-09-29T23:23:31.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.230+0000 7f594eac9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f594806f650 con 0x7f594812faa0 2023-09-29T23:23:31.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.230+0000 7f5947fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f594812faa0 0x7f59481344f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:31.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.230+0000 7f5947fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f594812faa0 0x7f59481344f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36958/0 (socket says 172.21.15.92:36958) 2023-09-29T23:23:31.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.230+0000 7f594c865700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f594806f280 0x7f594812f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54234/0 (socket says 172.21.15.92:54234) 2023-09-29T23:23:31.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.230+0000 7f5947fff700 1 -- 172.21.15.92:0/683813438 learned_addr learned my addr 172.21.15.92:0/683813438 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:31.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.230+0000 7f5947fff700 1 -- 172.21.15.92:0/683813438 >> v1:172.21.15.92:6789/0 conn(0x7f594806f280 legacy=0x7f594812f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:31.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.230+0000 7f5947fff700 1 -- 172.21.15.92:0/683813438 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59480a1430 con 0x7f594812faa0 2023-09-29T23:23:31.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.230+0000 7f5947fff700 1 --2- 172.21.15.92:0/683813438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594812faa0 0x7f59481344f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5934009930 tx=0x7f5934009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341924d26d1d1516 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:31.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.230+0000 7f59477fe700 1 -- 172.21.15.92:0/683813438 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f593400b860 con 0x7f594812faa0 2023-09-29T23:23:31.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.230+0000 7f59477fe700 1 -- 172.21.15.92:0/683813438 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593400b9c0 con 0x7f594812faa0 2023-09-29T23:23:31.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.230+0000 7f59477fe700 1 -- 172.21.15.92:0/683813438 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f593400bc90 con 0x7f594812faa0 2023-09-29T23:23:31.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.231+0000 7f594eac9700 1 -- 172.21.15.92:0/683813438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594812faa0 msgr2=0x7f59481344f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:31.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.231+0000 7f594eac9700 1 --2- 172.21.15.92:0/683813438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594812faa0 0x7f59481344f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5934009930 tx=0x7f5934009250 comp rx=0 tx=0).stop 2023-09-29T23:23:31.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.231+0000 7f594eac9700 1 -- 172.21.15.92:0/683813438 shutdown_connections 2023-09-29T23:23:31.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.231+0000 7f594eac9700 1 --2- 172.21.15.92:0/683813438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594812faa0 0x7f59481344f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:31.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.231+0000 7f594eac9700 1 -- 172.21.15.92:0/683813438 >> 172.21.15.92:0/683813438 conn(0x7f5948094a70 msgr2=0x7f594806eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:31.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.231+0000 7f594eac9700 1 -- 172.21.15.92:0/683813438 shutdown_connections 2023-09-29T23:23:31.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.231+0000 7f594eac9700 1 -- 172.21.15.92:0/683813438 wait complete. 2023-09-29T23:23:31.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.232+0000 7f594eac9700 1 Processor -- start 2023-09-29T23:23:31.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.232+0000 7f594eac9700 1 -- start start 2023-09-29T23:23:31.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.232+0000 7f594eac9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594806f280 0x7f594813ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:31.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.232+0000 7f594eac9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59481193f0 con 0x7f594806f280 2023-09-29T23:23:31.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.232+0000 7f594c865700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594806f280 0x7f594813ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:31.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.232+0000 7f594c865700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594806f280 0x7f594813ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36968/0 (socket says 172.21.15.92:36968) 2023-09-29T23:23:31.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.232+0000 7f594c865700 1 -- 172.21.15.92:0/683789279 learned_addr learned my addr 172.21.15.92:0/683789279 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:31.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.233+0000 7f594c865700 1 -- 172.21.15.92:0/683789279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59340094f0 con 0x7f594806f280 2023-09-29T23:23:31.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.233+0000 7f594c865700 1 --2- 172.21.15.92:0/683789279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594806f280 0x7f594813ecf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f593c00c460 tx=0x7f593c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:31.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.233+0000 7f5944ff9700 1 -- 172.21.15.92:0/683789279 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f593c005a70 con 0x7f594806f280 2023-09-29T23:23:31.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.233+0000 7f5944ff9700 1 -- 172.21.15.92:0/683789279 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c005bd0 con 0x7f594806f280 2023-09-29T23:23:31.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.233+0000 7f5944ff9700 1 -- 172.21.15.92:0/683789279 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f593c005e80 con 0x7f594806f280 2023-09-29T23:23:31.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.233+0000 7f594eac9700 1 -- 172.21.15.92:0/683789279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594811b190 con 0x7f594806f280 2023-09-29T23:23:31.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.233+0000 7f594eac9700 1 -- 172.21.15.92:0/683789279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5948133710 con 0x7f594806f280 2023-09-29T23:23:31.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.233+0000 7f5944ff9700 1 -- 172.21.15.92:0/683789279 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f593c007350 con 0x7f594806f280 2023-09-29T23:23:31.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.233+0000 7f5944ff9700 1 -- 172.21.15.92:0/683789279 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f593c012400 con 0x7f594806f280 2023-09-29T23:23:31.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.234+0000 7f594eac9700 1 -- 172.21.15.92:0/683789279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594812e1d0 con 0x7f594806f280 2023-09-29T23:23:31.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.236+0000 7f5944ff9700 1 -- 172.21.15.92:0/683789279 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f593c021060 con 0x7f594806f280 2023-09-29T23:23:31.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.317+0000 7f594eac9700 1 -- 172.21.15.92:0/683789279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2e9c0837-2887-469f-9dea-db4bde348578", "id": 1} v 0) v1 -- 0x7f594805f230 con 0x7f594806f280 2023-09-29T23:23:31.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.320+0000 7f5944ff9700 1 -- 172.21.15.92:0/683789279 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2e9c0837-2887-469f-9dea-db4bde348578", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f593c02a0b0 con 0x7f594806f280 2023-09-29T23:23:31.321 INFO:teuthology.orchestra.run.smithi092.stdout:1 2023-09-29T23:23:31.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.321+0000 7f594eac9700 1 -- 172.21.15.92:0/683789279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594806f280 msgr2=0x7f594813ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:31.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.321+0000 7f594eac9700 1 --2- 172.21.15.92:0/683789279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594806f280 0x7f594813ecf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f593c00c460 tx=0x7f593c007f70 comp rx=0 tx=0).stop 2023-09-29T23:23:31.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.321+0000 7f594eac9700 1 -- 172.21.15.92:0/683789279 shutdown_connections 2023-09-29T23:23:31.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.321+0000 7f594eac9700 1 --2- 172.21.15.92:0/683789279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f594806f280 0x7f594813ecf0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:31.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.321+0000 7f594eac9700 1 -- 172.21.15.92:0/683789279 >> 172.21.15.92:0/683789279 conn(0x7f5948094a70 msgr2=0x7f59481322d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:31.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.322+0000 7f594eac9700 1 -- 172.21.15.92:0/683789279 shutdown_connections 2023-09-29T23:23:31.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.322+0000 7f594eac9700 1 -- 172.21.15.92:0/683789279 wait complete. 2023-09-29T23:23:31.334 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 81ff42a8-c905-48bb-a021-3f5734761a24 2 2023-09-29T23:23:31.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.448+0000 7faddf22a700 1 Processor -- start 2023-09-29T23:23:31.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.448+0000 7faddf22a700 1 -- start start 2023-09-29T23:23:31.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.448+0000 7faddf22a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fadd8099bd0 0x7fadd8099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:31.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.448+0000 7faddf22a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd80997a0 con 0x7fadd812f190 2023-09-29T23:23:31.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.448+0000 7faddf22a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd80999d0 con 0x7fadd8099bd0 2023-09-29T23:23:31.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.449+0000 7fadde228700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fadd8099bd0 0x7fadd8099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:31.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.449+0000 7faddda27700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fadd812f190 0x7fadd812f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54240/0 (socket says 172.21.15.92:54240) 2023-09-29T23:23:31.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.449+0000 7faddda27700 1 -- 172.21.15.92:0/1342401537 learned_addr learned my addr 172.21.15.92:0/1342401537 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:31.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.449+0000 7fadde228700 1 -- 172.21.15.92:0/1342401537 >> v1:172.21.15.92:6789/0 conn(0x7fadd812f190 legacy=0x7fadd812f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:31.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.449+0000 7fadde228700 1 -- 172.21.15.92:0/1342401537 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd809ac90 con 0x7fadd8099bd0 2023-09-29T23:23:31.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.449+0000 7fadde228700 1 --2- 172.21.15.92:0/1342401537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadd8099bd0 0x7fadd8099fa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009860 tx=0x7fadc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21140eeed3c76e server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:31.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.449+0000 7faddd226700 1 -- 172.21.15.92:0/1342401537 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadc800b680 con 0x7fadd8099bd0 2023-09-29T23:23:31.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.449+0000 7faddd226700 1 -- 172.21.15.92:0/1342401537 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc800b7e0 con 0x7fadd8099bd0 2023-09-29T23:23:31.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.449+0000 7faddd226700 1 -- 172.21.15.92:0/1342401537 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadc800b990 con 0x7fadd8099bd0 2023-09-29T23:23:31.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.450+0000 7faddf22a700 1 -- 172.21.15.92:0/1342401537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadd8099bd0 msgr2=0x7fadd8099fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:31.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.450+0000 7faddf22a700 1 --2- 172.21.15.92:0/1342401537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadd8099bd0 0x7fadd8099fa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009860 tx=0x7fadc80091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:31.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.450+0000 7faddf22a700 1 -- 172.21.15.92:0/1342401537 shutdown_connections 2023-09-29T23:23:31.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.450+0000 7faddf22a700 1 --2- 172.21.15.92:0/1342401537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadd8099bd0 0x7fadd8099fa0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:31.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.450+0000 7faddf22a700 1 -- 172.21.15.92:0/1342401537 >> 172.21.15.92:0/1342401537 conn(0x7fadd80680a0 msgr2=0x7fadd8096a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:31.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.450+0000 7faddf22a700 1 -- 172.21.15.92:0/1342401537 shutdown_connections 2023-09-29T23:23:31.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.450+0000 7faddf22a700 1 -- 172.21.15.92:0/1342401537 wait complete. 2023-09-29T23:23:31.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.451+0000 7faddf22a700 1 Processor -- start 2023-09-29T23:23:31.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.451+0000 7faddf22a700 1 -- start start 2023-09-29T23:23:31.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.451+0000 7faddf22a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadd8099bd0 0x7fadd811dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:31.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.451+0000 7faddf22a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd811c610 con 0x7fadd8099bd0 2023-09-29T23:23:31.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.451+0000 7fadde228700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadd8099bd0 0x7fadd811dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:31.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.451+0000 7fadde228700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadd8099bd0 0x7fadd811dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36980/0 (socket says 172.21.15.92:36980) 2023-09-29T23:23:31.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.451+0000 7fadde228700 1 -- 172.21.15.92:0/2843138646 learned_addr learned my addr 172.21.15.92:0/2843138646 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:31.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.452+0000 7fadde228700 1 -- 172.21.15.92:0/2843138646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc8009420 con 0x7fadd8099bd0 2023-09-29T23:23:31.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.452+0000 7fadde228700 1 --2- 172.21.15.92:0/2843138646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadd8099bd0 0x7fadd811dd80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fadc8000c00 tx=0x7fadc8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:31.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.452+0000 7fadce7fc700 1 -- 172.21.15.92:0/2843138646 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadc8024470 con 0x7fadd8099bd0 2023-09-29T23:23:31.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.452+0000 7fadce7fc700 1 -- 172.21.15.92:0/2843138646 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc80245d0 con 0x7fadd8099bd0 2023-09-29T23:23:31.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.452+0000 7fadce7fc700 1 -- 172.21.15.92:0/2843138646 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadc8024880 con 0x7fadd8099bd0 2023-09-29T23:23:31.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.452+0000 7faddf22a700 1 -- 172.21.15.92:0/2843138646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd811d960 con 0x7fadd8099bd0 2023-09-29T23:23:31.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.452+0000 7faddf22a700 1 -- 172.21.15.92:0/2843138646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd811a930 con 0x7fadd8099bd0 2023-09-29T23:23:31.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.452+0000 7fadce7fc700 1 -- 172.21.15.92:0/2843138646 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fadc8021070 con 0x7fadd8099bd0 2023-09-29T23:23:31.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.452+0000 7fadce7fc700 1 -- 172.21.15.92:0/2843138646 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fadc801aa60 con 0x7fadd8099bd0 2023-09-29T23:23:31.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.453+0000 7faddf22a700 1 -- 172.21.15.92:0/2843138646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd811bb40 con 0x7fadd8099bd0 2023-09-29T23:23:31.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.455+0000 7fadce7fc700 1 -- 172.21.15.92:0/2843138646 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fadc8024e40 con 0x7fadd8099bd0 2023-09-29T23:23:31.537 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.537+0000 7faddf22a700 1 -- 172.21.15.92:0/2843138646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "81ff42a8-c905-48bb-a021-3f5734761a24", "id": 2} v 0) v1 -- 0x7fadd805f230 con 0x7fadd8099bd0 2023-09-29T23:23:31.540 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.540+0000 7fadce7fc700 1 -- 172.21.15.92:0/2843138646 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "81ff42a8-c905-48bb-a021-3f5734761a24", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fadc801ada0 con 0x7fadd8099bd0 2023-09-29T23:23:31.541 INFO:teuthology.orchestra.run.smithi092.stdout:2 2023-09-29T23:23:31.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.541+0000 7faddf22a700 1 -- 172.21.15.92:0/2843138646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadd8099bd0 msgr2=0x7fadd811dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:31.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.541+0000 7faddf22a700 1 --2- 172.21.15.92:0/2843138646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadd8099bd0 0x7fadd811dd80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fadc8000c00 tx=0x7fadc8016000 comp rx=0 tx=0).stop 2023-09-29T23:23:31.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.541+0000 7faddf22a700 1 -- 172.21.15.92:0/2843138646 shutdown_connections 2023-09-29T23:23:31.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.541+0000 7faddf22a700 1 --2- 172.21.15.92:0/2843138646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadd8099bd0 0x7fadd811dd80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:31.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.541+0000 7faddf22a700 1 -- 172.21.15.92:0/2843138646 >> 172.21.15.92:0/2843138646 conn(0x7fadd80680a0 msgr2=0x7fadd8096d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:31.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.541+0000 7faddf22a700 1 -- 172.21.15.92:0/2843138646 shutdown_connections 2023-09-29T23:23:31.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.541+0000 7faddf22a700 1 -- 172.21.15.92:0/2843138646 wait complete. 2023-09-29T23:23:31.553 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-29T23:23:31.553 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-29T23:23:31.555 INFO:tasks.ceph.osd.0:Started 2023-09-29T23:23:31.555 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-29T23:23:31.555 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-29T23:23:31.557 INFO:tasks.ceph.osd.1:Started 2023-09-29T23:23:31.557 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-29T23:23:31.557 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-29T23:23:31.559 INFO:tasks.ceph.osd.2:Started 2023-09-29T23:23:31.560 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:23:31.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.702+0000 7f0a51a94700 1 Processor -- start 2023-09-29T23:23:31.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.703+0000 7f0a51a94700 1 -- start start 2023-09-29T23:23:31.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.703+0000 7f0a51a94700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0a4c097780 0x7f0a4c131640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:31.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.703+0000 7f0a51a94700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a4c098700 con 0x7f0a4c096ca0 2023-09-29T23:23:31.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.703+0000 7f0a51a94700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4c09f430 con 0x7f0a4c097780 2023-09-29T23:23:31.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.703+0000 7f0a43fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0a4c097780 0x7f0a4c131640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:31.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.703+0000 7f0a4b7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f0a4c096ca0 0x7f0a4c097070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54276/0 (socket says 172.21.15.92:54276) 2023-09-29T23:23:31.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.703+0000 7f0a4b7fe700 1 -- 172.21.15.92:0/3903223733 learned_addr learned my addr 172.21.15.92:0/3903223733 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:31.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.703+0000 7f0a43fff700 1 -- 172.21.15.92:0/3903223733 >> v1:172.21.15.92:6789/0 conn(0x7f0a4c096ca0 legacy=0x7f0a4c097070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:31.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.703+0000 7f0a4affd700 1 -- 172.21.15.92:0/3903223733 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999058199 0 0) 0x7f0a4c098700 con 0x7f0a4c096ca0 2023-09-29T23:23:31.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.703+0000 7f0a43fff700 1 -- 172.21.15.92:0/3903223733 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c06fab0 con 0x7f0a4c097780 2023-09-29T23:23:31.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.704+0000 7f0a43fff700 1 --2- 172.21.15.92:0/3903223733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a4c097780 0x7f0a4c131640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009860 tx=0x7f0a340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43799e42bd251288 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:31.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.704+0000 7f0a4affd700 1 -- 172.21.15.92:0/3903223733 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a3400b680 con 0x7f0a4c097780 2023-09-29T23:23:31.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.704+0000 7f0a4affd700 1 -- 172.21.15.92:0/3903223733 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3400b7e0 con 0x7f0a4c097780 2023-09-29T23:23:31.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.704+0000 7f0a4affd700 1 -- 172.21.15.92:0/3903223733 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a3400bad0 con 0x7f0a4c097780 2023-09-29T23:23:31.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.704+0000 7f0a51a94700 1 -- 172.21.15.92:0/3903223733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a4c097780 msgr2=0x7f0a4c131640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:31.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.704+0000 7f0a51a94700 1 --2- 172.21.15.92:0/3903223733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a4c097780 0x7f0a4c131640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009860 tx=0x7f0a340091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:31.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.704+0000 7f0a51a94700 1 -- 172.21.15.92:0/3903223733 shutdown_connections 2023-09-29T23:23:31.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.704+0000 7f0a51a94700 1 --2- 172.21.15.92:0/3903223733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a4c097780 0x7f0a4c131640 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:31.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.704+0000 7f0a51a94700 1 -- 172.21.15.92:0/3903223733 >> 172.21.15.92:0/3903223733 conn(0x7f0a4c06bd70 msgr2=0x7f0a4c06e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:31.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.704+0000 7f0a51a94700 1 -- 172.21.15.92:0/3903223733 shutdown_connections 2023-09-29T23:23:31.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.705+0000 7f0a51a94700 1 -- 172.21.15.92:0/3903223733 wait complete. 2023-09-29T23:23:31.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.705+0000 7f0a51a94700 1 Processor -- start 2023-09-29T23:23:31.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.705+0000 7f0a51a94700 1 -- start start 2023-09-29T23:23:31.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.706+0000 7f0a51a94700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a4c096ca0 0x7f0a4c08b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:31.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.706+0000 7f0a51a94700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c091a20 con 0x7f0a4c096ca0 2023-09-29T23:23:31.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.706+0000 7f0a4b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a4c096ca0 0x7f0a4c08b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:31.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.706+0000 7f0a4b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a4c096ca0 0x7f0a4c08b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37012/0 (socket says 172.21.15.92:37012) 2023-09-29T23:23:31.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.706+0000 7f0a4b7fe700 1 -- 172.21.15.92:0/2326858861 learned_addr learned my addr 172.21.15.92:0/2326858861 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:31.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.706+0000 7f0a4b7fe700 1 -- 172.21.15.92:0/2326858861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a34009420 con 0x7f0a4c096ca0 2023-09-29T23:23:31.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.706+0000 7f0a4b7fe700 1 --2- 172.21.15.92:0/2326858861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a4c096ca0 0x7f0a4c08b320 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c00c710 tx=0x7f0a3c007c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:31.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.706+0000 7f0a437fe700 1 -- 172.21.15.92:0/2326858861 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a3c0074d0 con 0x7f0a4c096ca0 2023-09-29T23:23:31.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.706+0000 7f0a437fe700 1 -- 172.21.15.92:0/2326858861 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c007650 con 0x7f0a4c096ca0 2023-09-29T23:23:31.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.706+0000 7f0a51a94700 1 -- 172.21.15.92:0/2326858861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4c092bd0 con 0x7f0a4c096ca0 2023-09-29T23:23:31.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.706+0000 7f0a437fe700 1 -- 172.21.15.92:0/2326858861 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a3c005970 con 0x7f0a4c096ca0 2023-09-29T23:23:31.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.706+0000 7f0a51a94700 1 -- 172.21.15.92:0/2326858861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c08c700 con 0x7f0a4c096ca0 2023-09-29T23:23:31.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.707+0000 7f0a437fe700 1 -- 172.21.15.92:0/2326858861 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0a3c005d50 con 0x7f0a4c096ca0 2023-09-29T23:23:31.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.707+0000 7f0a437fe700 1 -- 172.21.15.92:0/2326858861 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f0a3c0128a0 con 0x7f0a4c096ca0 2023-09-29T23:23:31.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.707+0000 7f0a51a94700 1 -- 172.21.15.92:0/2326858861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4c096650 con 0x7f0a4c096ca0 2023-09-29T23:23:31.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.710+0000 7f0a437fe700 1 -- 172.21.15.92:0/2326858861 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0a3c017070 con 0x7f0a4c096ca0 2023-09-29T23:23:31.746 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:31.745+0000 7f0d7b965180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-29T23:23:31.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.776+0000 7f0a51a94700 1 -- 172.21.15.92:0/2326858861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a4c09a1d0 con 0x7f0a4c096ca0 2023-09-29T23:23:31.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.777+0000 7f0a437fe700 1 -- 172.21.15.92:0/2326858861 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v5) v1 ==== 74+0+3382 (secure 0 0 0) 0x7f0a3c012520 con 0x7f0a4c096ca0 2023-09-29T23:23:31.777 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:31.777 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":5,"fsid":"5b80eae7-9a7e-4dc0-8ff1-cd1f82a1fa33","created":"2023-09-29T23:23:30.308760+0000","modified":"2023-09-29T23:23:31.538675+0000","last_up_change":"0.000000","last_in_change":"2023-09-29T23:23:31.538675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"ea64f859-a36f-4804-810d-2fe7081c9990","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2e9c0837-2887-469f-9dea-db4bde348578","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"81ff42a8-c905-48bb-a021-3f5734761a24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:23:31.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.778+0000 7f0a51a94700 1 -- 172.21.15.92:0/2326858861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a4c096ca0 msgr2=0x7f0a4c08b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:31.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.778+0000 7f0a51a94700 1 --2- 172.21.15.92:0/2326858861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a4c096ca0 0x7f0a4c08b320 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c00c710 tx=0x7f0a3c007c00 comp rx=0 tx=0).stop 2023-09-29T23:23:31.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.778+0000 7f0a51a94700 1 -- 172.21.15.92:0/2326858861 shutdown_connections 2023-09-29T23:23:31.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.778+0000 7f0a51a94700 1 --2- 172.21.15.92:0/2326858861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a4c096ca0 0x7f0a4c08b320 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:31.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.778+0000 7f0a51a94700 1 -- 172.21.15.92:0/2326858861 >> 172.21.15.92:0/2326858861 conn(0x7f0a4c06bd70 msgr2=0x7f0a4c09dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:31.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.778+0000 7f0a51a94700 1 -- 172.21.15.92:0/2326858861 shutdown_connections 2023-09-29T23:23:31.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:31.778+0000 7f0a51a94700 1 -- 172.21.15.92:0/2326858861 wait complete. 2023-09-29T23:23:31.790 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-29T23:23:31.790 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-29T23:23:31.879 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:31.879+0000 7f0d7b965180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-29T23:23:31.956 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:31.955+0000 7f0d7b965180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-29T23:23:32.092 DEBUG:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-29T23:23:32.140 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:32.140+0000 7f0d7b965180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-29T23:23:32.147 INFO:tasks.ceph.osd.2.smithi092.stderr:2023-09-29T23:23:32.147+0000 7f77567f3540 -1 Falling back to public interface 2023-09-29T23:23:32.148 INFO:tasks.ceph.osd.1.smithi092.stderr:2023-09-29T23:23:32.148+0000 7f9db0a0a540 -1 Falling back to public interface 2023-09-29T23:23:32.164 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-09-29T23:23:32.164+0000 7effa7b27540 -1 Falling back to public interface 2023-09-29T23:23:32.200 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.199+0000 7f9b61227700 1 Processor -- start 2023-09-29T23:23:32.200 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.199+0000 7f9b61227700 1 -- start start 2023-09-29T23:23:32.200 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.199+0000 7f9b61227700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9b5c09a380 0x7f9b5c097dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:32.201 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.199+0000 7f9b61227700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5c097410 con 0x7f9b5c06ee40 2023-09-29T23:23:32.201 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.199+0000 7f9b61227700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c06f210 con 0x7f9b5c09a380 2023-09-29T23:23:32.201 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.199+0000 7f9b5a59c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9b5c09a380 0x7f9b5c097dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:32.201 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.199+0000 7f9b5ad9d700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f9b5c06ee40 0x7f9b5c0976b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54282/0 (socket says 172.21.15.92:54282) 2023-09-29T23:23:32.201 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.199+0000 7f9b5ad9d700 1 -- 172.21.15.92:0/3153955319 learned_addr learned my addr 172.21.15.92:0/3153955319 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:32.201 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.200+0000 7f9b5a59c700 1 -- 172.21.15.92:0/3153955319 >> v1:172.21.15.92:6789/0 conn(0x7f9b5c06ee40 legacy=0x7f9b5c0976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:32.201 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.200+0000 7f9b5a59c700 1 -- 172.21.15.92:0/3153955319 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c099960 con 0x7f9b5c09a380 2023-09-29T23:23:32.201 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.200+0000 7f9b59d9b700 1 -- 172.21.15.92:0/3153955319 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539850024 0 0) 0x7f9b5c097410 con 0x7f9b5c06ee40 2023-09-29T23:23:32.201 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.200+0000 7f9b5a59c700 1 --2- 172.21.15.92:0/3153955319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b5c09a380 0x7f9b5c097dc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009860 tx=0x7f9b500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98906ad5806c8a40 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:32.201 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.200+0000 7f9b59d9b700 1 -- 172.21.15.92:0/3153955319 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b5000b680 con 0x7f9b5c09a380 2023-09-29T23:23:32.201 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.200+0000 7f9b59d9b700 1 -- 172.21.15.92:0/3153955319 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5000b7e0 con 0x7f9b5c09a380 2023-09-29T23:23:32.201 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.200+0000 7f9b59d9b700 1 -- 172.21.15.92:0/3153955319 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b5000bad0 con 0x7f9b5c09a380 2023-09-29T23:23:32.204 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.200+0000 7f9b61227700 1 -- 172.21.15.92:0/3153955319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b5c09a380 msgr2=0x7f9b5c097dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:32.204 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.200+0000 7f9b61227700 1 --2- 172.21.15.92:0/3153955319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b5c09a380 0x7f9b5c097dc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009860 tx=0x7f9b500091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:32.206 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.200+0000 7f9b61227700 1 -- 172.21.15.92:0/3153955319 shutdown_connections 2023-09-29T23:23:32.206 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.200+0000 7f9b61227700 1 --2- 172.21.15.92:0/3153955319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b5c09a380 0x7f9b5c097dc0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:32.206 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.200+0000 7f9b61227700 1 -- 172.21.15.92:0/3153955319 >> 172.21.15.92:0/3153955319 conn(0x7f9b5c094a70 msgr2=0x7f9b5c06e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:32.206 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.201+0000 7f9b61227700 1 -- 172.21.15.92:0/3153955319 shutdown_connections 2023-09-29T23:23:32.206 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.201+0000 7f9b61227700 1 -- 172.21.15.92:0/3153955319 wait complete. 2023-09-29T23:23:32.206 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.201+0000 7f9b61227700 1 Processor -- start 2023-09-29T23:23:32.207 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.201+0000 7f9b61227700 1 -- start start 2023-09-29T23:23:32.207 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.202+0000 7f9b61227700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b5c06ee40 0x7f9b5c11deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:32.207 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.202+0000 7f9b61227700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c11c740 con 0x7f9b5c06ee40 2023-09-29T23:23:32.207 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.202+0000 7f9b5ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b5c06ee40 0x7f9b5c11deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:32.207 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.202+0000 7f9b5ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b5c06ee40 0x7f9b5c11deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37032/0 (socket says 172.21.15.92:37032) 2023-09-29T23:23:32.207 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.202+0000 7f9b5ad9d700 1 -- 172.21.15.92:0/957091773 learned_addr learned my addr 172.21.15.92:0/957091773 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:32.207 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.202+0000 7f9b5ad9d700 1 -- 172.21.15.92:0/957091773 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b50009420 con 0x7f9b5c06ee40 2023-09-29T23:23:32.207 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.202+0000 7f9b5ad9d700 1 --2- 172.21.15.92:0/957091773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b5c06ee40 0x7f9b5c11deb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00c460 tx=0x7f9b4c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:32.207 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.202+0000 7f9b42ffd700 1 -- 172.21.15.92:0/957091773 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b4c005b30 con 0x7f9b5c06ee40 2023-09-29T23:23:32.207 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.202+0000 7f9b42ffd700 1 -- 172.21.15.92:0/957091773 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c005c90 con 0x7f9b5c06ee40 2023-09-29T23:23:32.207 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.202+0000 7f9b61227700 1 -- 172.21.15.92:0/957091773 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5c069cf0 con 0x7f9b5c06ee40 2023-09-29T23:23:32.208 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.203+0000 7f9b42ffd700 1 -- 172.21.15.92:0/957091773 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b4c0070d0 con 0x7f9b5c06ee40 2023-09-29T23:23:32.208 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.203+0000 7f9b61227700 1 -- 172.21.15.92:0/957091773 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c06b3a0 con 0x7f9b5c06ee40 2023-09-29T23:23:32.208 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.203+0000 7f9b42ffd700 1 -- 172.21.15.92:0/957091773 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9b4c0074b0 con 0x7f9b5c06ee40 2023-09-29T23:23:32.208 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.203+0000 7f9b42ffd700 1 -- 172.21.15.92:0/957091773 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f9b4c0128a0 con 0x7f9b5c06ee40 2023-09-29T23:23:32.208 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.204+0000 7f9b61227700 1 -- 172.21.15.92:0/957091773 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c05f230 con 0x7f9b5c06ee40 2023-09-29T23:23:32.208 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.206+0000 7f9b42ffd700 1 -- 172.21.15.92:0/957091773 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9b4c017070 con 0x7f9b5c06ee40 2023-09-29T23:23:32.275 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.274+0000 7f9b61227700 1 -- 172.21.15.92:0/957091773 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b5c12abc0 con 0x7f9b5c06ee40 2023-09-29T23:23:32.275 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.275+0000 7f9b42ffd700 1 -- 172.21.15.92:0/957091773 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v5) v1 ==== 74+0+3382 (secure 0 0 0) 0x7f9b4c01c500 con 0x7f9b5c06ee40 2023-09-29T23:23:32.275 INFO:teuthology.misc.health.smithi092.stdout: 2023-09-29T23:23:32.276 INFO:teuthology.misc.health.smithi092.stdout:{"epoch":5,"fsid":"5b80eae7-9a7e-4dc0-8ff1-cd1f82a1fa33","created":"2023-09-29T23:23:30.308760+0000","modified":"2023-09-29T23:23:31.538675+0000","last_up_change":"0.000000","last_in_change":"2023-09-29T23:23:31.538675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"ea64f859-a36f-4804-810d-2fe7081c9990","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2e9c0837-2887-469f-9dea-db4bde348578","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"81ff42a8-c905-48bb-a021-3f5734761a24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:23:32.276 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.276+0000 7f9b61227700 1 -- 172.21.15.92:0/957091773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b5c06ee40 msgr2=0x7f9b5c11deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:32.277 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.276+0000 7f9b61227700 1 --2- 172.21.15.92:0/957091773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b5c06ee40 0x7f9b5c11deb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00c460 tx=0x7f9b4c000fe0 comp rx=0 tx=0).stop 2023-09-29T23:23:32.277 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.276+0000 7f9b61227700 1 -- 172.21.15.92:0/957091773 shutdown_connections 2023-09-29T23:23:32.277 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.276+0000 7f9b61227700 1 --2- 172.21.15.92:0/957091773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b5c06ee40 0x7f9b5c11deb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:32.277 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.276+0000 7f9b61227700 1 -- 172.21.15.92:0/957091773 >> 172.21.15.92:0/957091773 conn(0x7f9b5c094a70 msgr2=0x7f9b5c12ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:32.277 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.276+0000 7f9b61227700 1 -- 172.21.15.92:0/957091773 shutdown_connections 2023-09-29T23:23:32.277 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:32.276+0000 7f9b61227700 1 -- 172.21.15.92:0/957091773 wait complete. 2023-09-29T23:23:32.286 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-09-29T23:23:32.325 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:32.324+0000 7f0d7b965180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-29T23:23:32.402 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:32.402+0000 7f0d7b965180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-29T23:23:32.537 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:32.537+0000 7f0d7b965180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-29T23:23:32.632 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:32.632+0000 7f0d7b965180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-29T23:23:33.162 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:33.160+0000 7f0d7b965180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-29T23:23:33.237 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:33.237+0000 7f0d7b965180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-29T23:23:33.316 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:33.315+0000 7f0d7b965180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-29T23:23:33.896 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:33.896+0000 7f0d7b965180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-29T23:23:34.033 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:34.033+0000 7f0d7b965180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-29T23:23:34.134 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:34.134+0000 7f0d7b965180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-29T23:23:34.380 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:34.380+0000 7f0d7b965180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-29T23:23:34.457 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:34.456+0000 7f0d7b965180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-29T23:23:34.629 INFO:tasks.ceph.osd.2.smithi092.stderr:2023-09-29T23:23:34.629+0000 7f77567f3540 -1 osd.2 0 log_to_monitors true 2023-09-29T23:23:34.889 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-09-29T23:23:34.889+0000 7effa7b27540 -1 osd.0 0 log_to_monitors true 2023-09-29T23:23:34.892 INFO:tasks.ceph.osd.1.smithi092.stderr:2023-09-29T23:23:34.892+0000 7f9db0a0a540 -1 osd.1 0 log_to_monitors true 2023-09-29T23:23:35.288 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:35.288+0000 7f0d7b965180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-29T23:23:35.362 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:35.362+0000 7f0d7b965180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-29T23:23:35.435 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:35.435+0000 7f0d7b965180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-29T23:23:35.566 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:35.566+0000 7f0d7b965180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-29T23:23:35.651 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:35.651+0000 7f0d7b965180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-29T23:23:35.689 INFO:tasks.ceph.osd.2.smithi092.stderr:2023-09-29T23:23:35.689+0000 7f774d414700 -1 osd.2 0 waiting for initial osdmap 2023-09-29T23:23:35.695 INFO:tasks.ceph.osd.2.smithi092.stderr:2023-09-29T23:23:35.695+0000 7f774620b700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-29T23:23:35.801 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:35.801+0000 7f0d7b965180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-29T23:23:35.876 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:35.876+0000 7f0d7b965180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-29T23:23:35.951 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:35.951+0000 7f0d7b965180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-29T23:23:36.025 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:36.024+0000 7f0d7b965180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-29T23:23:36.055 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:36.055+0000 7f0d0bc5a700 -1 log_channel(cluster) log [ERR] : Unhandled exception from module 'pg_autoscaler' while running on mgr.x: 'PgAutoscaler' object has no attribute 'noautoscale' 2023-09-29T23:23:36.055 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:36.055+0000 7f0d0bc5a700 -1 pg_autoscaler.serve: 2023-09-29T23:23:36.056 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:36.055+0000 7f0d0bc5a700 -1 Traceback (most recent call last): 2023-09-29T23:23:36.056 INFO:tasks.ceph.mgr.x.smithi092.stderr: File "/usr/share/ceph/mgr/pg_autoscaler/module.py", line 325, in serve 2023-09-29T23:23:36.056 INFO:tasks.ceph.mgr.x.smithi092.stderr: self._maybe_adjust() 2023-09-29T23:23:36.056 INFO:tasks.ceph.mgr.x.smithi092.stderr: File "/usr/share/ceph/mgr/pg_autoscaler/module.py", line 682, in _maybe_adjust 2023-09-29T23:23:36.056 INFO:tasks.ceph.mgr.x.smithi092.stderr: if self.noautoscale: 2023-09-29T23:23:36.056 INFO:tasks.ceph.mgr.x.smithi092.stderr:AttributeError: 'PgAutoscaler' object has no attribute 'noautoscale' 2023-09-29T23:23:36.056 INFO:tasks.ceph.mgr.x.smithi092.stderr: 2023-09-29T23:23:36.687 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-09-29T23:23:36.687+0000 7eff9e748700 -1 osd.0 0 waiting for initial osdmap 2023-09-29T23:23:36.687 INFO:tasks.ceph.osd.1.smithi092.stderr:2023-09-29T23:23:36.687+0000 7f9da8e2e700 -1 osd.1 0 waiting for initial osdmap 2023-09-29T23:23:36.691 INFO:tasks.ceph.osd.0.smithi092.stderr:2023-09-29T23:23:36.691+0000 7eff9753f700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-29T23:23:36.692 INFO:tasks.ceph.osd.1.smithi092.stderr:2023-09-29T23:23:36.691+0000 7f9da0422700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-29T23:23:37.036 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-09-29T23:23:37.036+0000 7f0d34d6b700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-09-29T23:23:37.036 INFO:tasks.ceph.mon.a.smithi092.stderr:2023-09-29T23:23:37.036+0000 7f6a6e1ee700 -1 log_channel(cluster) log [ERR] : Health check failed: Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale' (MGR_MODULE_ERROR) 2023-09-29T23:23:38.588 DEBUG:teuthology.orchestra.run.smithi092:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-29T23:23:38.700 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.699+0000 7f6c7b16c700 1 Processor -- start 2023-09-29T23:23:38.701 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.699+0000 7f6c7b16c700 1 -- start start 2023-09-29T23:23:38.701 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.700+0000 7f6c7b16c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6c7409e360 0x7f6c74132650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:38.701 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.700+0000 7f6c7b16c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c74099440 con 0x7f6c7409d880 2023-09-29T23:23:38.701 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.700+0000 7f6c7b16c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c74099750 con 0x7f6c7409e360 2023-09-29T23:23:38.701 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.700+0000 7f6c73fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6c7409e360 0x7f6c74132650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:38.701 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.700+0000 7f6c78f08700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f6c7409d880 0x7f6c7409dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54292/0 (socket says 172.21.15.92:54292) 2023-09-29T23:23:38.701 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.700+0000 7f6c78f08700 1 -- 172.21.15.92:0/3309427895 learned_addr learned my addr 172.21.15.92:0/3309427895 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:38.701 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.700+0000 7f6c73fff700 1 -- 172.21.15.92:0/3309427895 >> v1:172.21.15.92:6789/0 conn(0x7f6c7409d880 legacy=0x7f6c7409dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:38.701 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.700+0000 7f6c73fff700 1 -- 172.21.15.92:0/3309427895 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7409a670 con 0x7f6c7409e360 2023-09-29T23:23:38.701 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.700+0000 7f6c737fe700 1 -- 172.21.15.92:0/3309427895 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508897019 0 0) 0x7f6c74099440 con 0x7f6c7409d880 2023-09-29T23:23:38.701 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.700+0000 7f6c73fff700 1 --2- 172.21.15.92:0/3309427895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c7409e360 0x7f6c74132650 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009860 tx=0x7f6c600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274d24ca5620ac00 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:38.701 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.700+0000 7f6c737fe700 1 -- 172.21.15.92:0/3309427895 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c6000b680 con 0x7f6c7409e360 2023-09-29T23:23:38.702 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.700+0000 7f6c737fe700 1 -- 172.21.15.92:0/3309427895 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6000b7e0 con 0x7f6c7409e360 2023-09-29T23:23:38.702 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.700+0000 7f6c737fe700 1 -- 172.21.15.92:0/3309427895 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c6000b990 con 0x7f6c7409e360 2023-09-29T23:23:38.707 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.701+0000 7f6c7b16c700 1 -- 172.21.15.92:0/3309427895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c7409e360 msgr2=0x7f6c74132650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:38.707 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.701+0000 7f6c7b16c700 1 --2- 172.21.15.92:0/3309427895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c7409e360 0x7f6c74132650 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009860 tx=0x7f6c600091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:38.707 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.701+0000 7f6c7b16c700 1 -- 172.21.15.92:0/3309427895 shutdown_connections 2023-09-29T23:23:38.707 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.701+0000 7f6c7b16c700 1 --2- 172.21.15.92:0/3309427895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c7409e360 0x7f6c74132650 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:38.707 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.701+0000 7f6c7b16c700 1 -- 172.21.15.92:0/3309427895 >> 172.21.15.92:0/3309427895 conn(0x7f6c7406afb0 msgr2=0x7f6c7406d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:38.707 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.701+0000 7f6c7b16c700 1 -- 172.21.15.92:0/3309427895 shutdown_connections 2023-09-29T23:23:38.707 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.701+0000 7f6c7b16c700 1 -- 172.21.15.92:0/3309427895 wait complete. 2023-09-29T23:23:38.707 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.702+0000 7f6c7b16c700 1 Processor -- start 2023-09-29T23:23:38.708 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.702+0000 7f6c7b16c700 1 -- start start 2023-09-29T23:23:38.708 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.702+0000 7f6c7b16c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c7409d880 0x7f6c74096410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:38.708 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.702+0000 7f6c7b16c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7408d860 con 0x7f6c7409d880 2023-09-29T23:23:38.708 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.702+0000 7f6c78f08700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c7409d880 0x7f6c74096410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:38.709 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.702+0000 7f6c78f08700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c7409d880 0x7f6c74096410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37144/0 (socket says 172.21.15.92:37144) 2023-09-29T23:23:38.709 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.702+0000 7f6c78f08700 1 -- 172.21.15.92:0/1178164854 learned_addr learned my addr 172.21.15.92:0/1178164854 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:38.709 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.703+0000 7f6c78f08700 1 -- 172.21.15.92:0/1178164854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c60009420 con 0x7f6c7409d880 2023-09-29T23:23:38.709 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.703+0000 7f6c78f08700 1 --2- 172.21.15.92:0/1178164854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c7409d880 0x7f6c74096410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800c460 tx=0x7f6c68007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:38.709 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.703+0000 7f6c70ff9700 1 -- 172.21.15.92:0/1178164854 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c68007420 con 0x7f6c7409d880 2023-09-29T23:23:38.709 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.703+0000 7f6c70ff9700 1 -- 172.21.15.92:0/1178164854 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c68007580 con 0x7f6c7409d880 2023-09-29T23:23:38.709 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.703+0000 7f6c7b16c700 1 -- 172.21.15.92:0/1178164854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c740980d0 con 0x7f6c7409d880 2023-09-29T23:23:38.709 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.703+0000 7f6c70ff9700 1 -- 172.21.15.92:0/1178164854 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c68005970 con 0x7f6c7409d880 2023-09-29T23:23:38.709 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.703+0000 7f6c7b16c700 1 -- 172.21.15.92:0/1178164854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7408e5c0 con 0x7f6c7409d880 2023-09-29T23:23:38.709 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.703+0000 7f6c70ff9700 1 -- 172.21.15.92:0/1178164854 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 3) v1 ==== 42379+0+0 (secure 0 0 0) 0x7f6c68005ad0 con 0x7f6c7409d880 2023-09-29T23:23:38.709 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.704+0000 7f6c7b16c700 1 -- 172.21.15.92:0/1178164854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c74097f40 con 0x7f6c7409d880 2023-09-29T23:23:38.710 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.704+0000 7f6c70ff9700 1 --2- 172.21.15.92:0/1178164854 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6c58035520 0x7f6c580379d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:38.710 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.704+0000 7f6c70ff9700 1 -- 172.21.15.92:0/1178164854 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2197+0+0 (secure 0 0 0) 0x7f6c68046410 con 0x7f6c7409d880 2023-09-29T23:23:38.710 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.704+0000 7f6c73fff700 1 --2- 172.21.15.92:0/1178164854 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6c58035520 0x7f6c580379d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:38.710 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.704+0000 7f6c73fff700 1 --2- 172.21.15.92:0/1178164854 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6c58035520 0x7f6c580379d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6c60006eb0 tx=0x7f6c60016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:38.710 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.708+0000 7f6c70ff9700 1 -- 172.21.15.92:0/1178164854 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c6801b3b0 con 0x7f6c7409d880 2023-09-29T23:23:38.891 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.891+0000 7f6c7b16c700 1 -- 172.21.15.92:0/1178164854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c7408c4c0 con 0x7f6c7409d880 2023-09-29T23:23:38.892 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.891+0000 7f6c70ff9700 1 -- 172.21.15.92:0/1178164854 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+4714 (secure 0 0 0) 0x7f6c68017070 con 0x7f6c7409d880 2023-09-29T23:23:38.892 INFO:teuthology.misc.health.smithi092.stdout: 2023-09-29T23:23:38.892 INFO:teuthology.misc.health.smithi092.stdout:{"epoch":10,"fsid":"5b80eae7-9a7e-4dc0-8ff1-cd1f82a1fa33","created":"2023-09-29T23:23:30.308760+0000","modified":"2023-09-29T23:23:38.693769+0000","last_up_change":"2023-09-29T23:23:37.693186+0000","last_in_change":"2023-09-29T23:23:31.538675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"ea64f859-a36f-4804-810d-2fe7081c9990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":85726},{"type":"v1","addr":"172.21.15.92:6817","nonce":85726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":85726},{"type":"v1","addr":"172.21.15.92:6819","nonce":85726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":85726},{"type":"v1","addr":"172.21.15.92:6823","nonce":85726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":85726},{"type":"v1","addr":"172.21.15.92:6821","nonce":85726}]},"public_addr":"172.21.15.92:6817/85726","cluster_addr":"172.21.15.92:6819/85726","heartbeat_back_addr":"172.21.15.92:6823/85726","heartbeat_front_addr":"172.21.15.92:6821/85726","state":["exists","up"]},{"osd":1,"uuid":"2e9c0837-2887-469f-9dea-db4bde348578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":85705},{"type":"v1","addr":"172.21.15.92:6809","nonce":85705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":85705},{"type":"v1","addr":"172.21.15.92:6811","nonce":85705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":85705},{"type":"v1","addr":"172.21.15.92:6815","nonce":85705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":85705},{"type":"v1","addr":"172.21.15.92:6813","nonce":85705}]},"public_addr":"172.21.15.92:6809/85705","cluster_addr":"172.21.15.92:6811/85705","heartbeat_back_addr":"172.21.15.92:6815/85705","heartbeat_front_addr":"172.21.15.92:6813/85705","state":["exists","up"]},{"osd":2,"uuid":"81ff42a8-c905-48bb-a021-3f5734761a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":85704},{"type":"v1","addr":"172.21.15.92:6801","nonce":85704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":85704},{"type":"v1","addr":"172.21.15.92:6803","nonce":85704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":85704},{"type":"v1","addr":"172.21.15.92:6807","nonce":85704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":85704},{"type":"v1","addr":"172.21.15.92:6805","nonce":85704}]},"public_addr":"172.21.15.92:6801/85704","cluster_addr":"172.21.15.92:6803/85704","heartbeat_back_addr":"172.21.15.92:6807/85704","heartbeat_front_addr":"172.21.15.92:6805/85704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.911756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.874000+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.680977+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:23:38.894 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.893+0000 7f6c7b16c700 1 -- 172.21.15.92:0/1178164854 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6c58035520 msgr2=0x7f6c580379d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:38.894 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.893+0000 7f6c7b16c700 1 --2- 172.21.15.92:0/1178164854 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6c58035520 0x7f6c580379d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6c60006eb0 tx=0x7f6c60016000 comp rx=0 tx=0).stop 2023-09-29T23:23:38.894 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.893+0000 7f6c7b16c700 1 -- 172.21.15.92:0/1178164854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c7409d880 msgr2=0x7f6c74096410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:38.894 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.893+0000 7f6c7b16c700 1 --2- 172.21.15.92:0/1178164854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c7409d880 0x7f6c74096410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800c460 tx=0x7f6c68007e30 comp rx=0 tx=0).stop 2023-09-29T23:23:38.894 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.893+0000 7f6c7b16c700 1 -- 172.21.15.92:0/1178164854 shutdown_connections 2023-09-29T23:23:38.894 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.893+0000 7f6c7b16c700 1 --2- 172.21.15.92:0/1178164854 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6c58035520 0x7f6c580379d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:38.894 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.893+0000 7f6c7b16c700 1 --2- 172.21.15.92:0/1178164854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c7409d880 0x7f6c74096410 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:38.894 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.893+0000 7f6c7b16c700 1 -- 172.21.15.92:0/1178164854 >> 172.21.15.92:0/1178164854 conn(0x7f6c7406afb0 msgr2=0x7f6c74086000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:38.895 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.894+0000 7f6c7b16c700 1 -- 172.21.15.92:0/1178164854 shutdown_connections 2023-09-29T23:23:38.895 INFO:teuthology.misc.health.smithi092.stderr:2023-09-29T23:23:38.894+0000 7f6c7b16c700 1 -- 172.21.15.92:0/1178164854 wait complete. 2023-09-29T23:23:38.904 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-09-29T23:23:38.904 INFO:tasks.ceph:Creating RBD pool 2023-09-29T23:23:38.904 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd pool create rbd 8 2023-09-29T23:23:39.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.016+0000 7f159798e700 1 Processor -- start 2023-09-29T23:23:39.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.016+0000 7f159798e700 1 -- start start 2023-09-29T23:23:39.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.017+0000 7f159798e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f159009fd80 0x7f15900a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:39.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.017+0000 7f159798e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1590098710 con 0x7f159012f8b0 2023-09-29T23:23:39.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.017+0000 7f159798e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159012f340 con 0x7f159009fd80 2023-09-29T23:23:39.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.017+0000 7f159572a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f159009fd80 0x7f15900a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:39.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.017+0000 7f1594f29700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f159012f8b0 0x7f1590095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54308/0 (socket says 172.21.15.92:54308) 2023-09-29T23:23:39.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.017+0000 7f159572a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f159009fd80 0x7f15900a3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37146/0 (socket says 172.21.15.92:37146) 2023-09-29T23:23:39.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.017+0000 7f1594f29700 1 -- 172.21.15.92:0/849814582 learned_addr learned my addr 172.21.15.92:0/849814582 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:39.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.017+0000 7f159572a700 1 -- 172.21.15.92:0/849814582 >> v1:172.21.15.92:6789/0 conn(0x7f159012f8b0 legacy=0x7f1590095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:39.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.017+0000 7f159572a700 1 -- 172.21.15.92:0/849814582 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15900997e0 con 0x7f159009fd80 2023-09-29T23:23:39.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.017+0000 7f1587fff700 1 -- 172.21.15.92:0/849814582 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140319885 0 0) 0x7f1590098710 con 0x7f159012f8b0 2023-09-29T23:23:39.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.017+0000 7f159572a700 1 --2- 172.21.15.92:0/849814582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f159009fd80 0x7f15900a3090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f158c009860 tx=0x7f158c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bb66e6d5d5566a server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:39.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.018+0000 7f1587fff700 1 -- 172.21.15.92:0/849814582 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f158c00b680 con 0x7f159009fd80 2023-09-29T23:23:39.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.018+0000 7f1587fff700 1 -- 172.21.15.92:0/849814582 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c00b7e0 con 0x7f159009fd80 2023-09-29T23:23:39.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.018+0000 7f1587fff700 1 -- 172.21.15.92:0/849814582 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f158c00b990 con 0x7f159009fd80 2023-09-29T23:23:39.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.018+0000 7f159798e700 1 -- 172.21.15.92:0/849814582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f159009fd80 msgr2=0x7f15900a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:39.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.018+0000 7f159798e700 1 --2- 172.21.15.92:0/849814582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f159009fd80 0x7f15900a3090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f158c009860 tx=0x7f158c0091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:39.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.018+0000 7f159798e700 1 -- 172.21.15.92:0/849814582 shutdown_connections 2023-09-29T23:23:39.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.018+0000 7f159798e700 1 --2- 172.21.15.92:0/849814582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f159009fd80 0x7f15900a3090 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:39.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.018+0000 7f159798e700 1 -- 172.21.15.92:0/849814582 >> 172.21.15.92:0/849814582 conn(0x7f1590068000 msgr2=0x7f15900a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:39.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.018+0000 7f159798e700 1 -- 172.21.15.92:0/849814582 shutdown_connections 2023-09-29T23:23:39.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.018+0000 7f159798e700 1 -- 172.21.15.92:0/849814582 wait complete. 2023-09-29T23:23:39.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.019+0000 7f159798e700 1 Processor -- start 2023-09-29T23:23:39.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.019+0000 7f159798e700 1 -- start start 2023-09-29T23:23:39.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.020+0000 7f159798e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f159009fd80 0x7f159013e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:39.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.020+0000 7f159798e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159011e2c0 con 0x7f159009fd80 2023-09-29T23:23:39.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.020+0000 7f159572a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f159009fd80 0x7f159013e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:39.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.020+0000 7f159572a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f159009fd80 0x7f159013e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37162/0 (socket says 172.21.15.92:37162) 2023-09-29T23:23:39.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.020+0000 7f159572a700 1 -- 172.21.15.92:0/987140196 learned_addr learned my addr 172.21.15.92:0/987140196 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:39.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.020+0000 7f159572a700 1 -- 172.21.15.92:0/987140196 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c009420 con 0x7f159009fd80 2023-09-29T23:23:39.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.020+0000 7f159572a700 1 --2- 172.21.15.92:0/987140196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f159009fd80 0x7f159013e520 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f158c0093f0 tx=0x7f158c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:39.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.020+0000 7f15857fa700 1 -- 172.21.15.92:0/987140196 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f158c01c450 con 0x7f159009fd80 2023-09-29T23:23:39.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.020+0000 7f15857fa700 1 -- 172.21.15.92:0/987140196 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c01c5b0 con 0x7f159009fd80 2023-09-29T23:23:39.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.020+0000 7f159798e700 1 -- 172.21.15.92:0/987140196 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159011c590 con 0x7f159009fd80 2023-09-29T23:23:39.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.020+0000 7f15857fa700 1 -- 172.21.15.92:0/987140196 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f158c01c760 con 0x7f159009fd80 2023-09-29T23:23:39.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.020+0000 7f159798e700 1 -- 172.21.15.92:0/987140196 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159011d1c0 con 0x7f159009fd80 2023-09-29T23:23:39.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.021+0000 7f15857fa700 1 -- 172.21.15.92:0/987140196 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 3) v1 ==== 42379+0+0 (secure 0 0 0) 0x7f158c01c990 con 0x7f159009fd80 2023-09-29T23:23:39.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.021+0000 7f159798e700 1 -- 172.21.15.92:0/987140196 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159011e410 con 0x7f159009fd80 2023-09-29T23:23:39.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.021+0000 7f15857fa700 1 --2- 172.21.15.92:0/987140196 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1574035520 0x7f15740379d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:39.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.021+0000 7f15857fa700 1 -- 172.21.15.92:0/987140196 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2197+0+0 (secure 0 0 0) 0x7f158c048ad0 con 0x7f159009fd80 2023-09-29T23:23:39.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.021+0000 7f1594f29700 1 --2- 172.21.15.92:0/987140196 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1574035520 0x7f15740379d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:39.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.022+0000 7f1594f29700 1 --2- 172.21.15.92:0/987140196 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1574035520 0x7f15740379d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f15800011e0 tx=0x7f15800079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:39.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.026+0000 7f15857fa700 1 -- 172.21.15.92:0/987140196 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f158c02dd20 con 0x7f159009fd80 2023-09-29T23:23:39.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.038+0000 7f15857fa700 1 -- 172.21.15.92:0/987140196 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f158c01b9f0 con 0x7f159009fd80 2023-09-29T23:23:39.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:39.210+0000 7f159798e700 1 -- 172.21.15.92:0/987140196 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f159011e7b0 con 0x7f159009fd80 2023-09-29T23:23:40.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.043+0000 7f15857fa700 1 -- 172.21.15.92:0/987140196 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v11) v1 ==== 109+0+0 (secure 0 0 0) 0x7f158c010c00 con 0x7f159009fd80 2023-09-29T23:23:40.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.046+0000 7f159798e700 1 -- 172.21.15.92:0/987140196 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1574035520 msgr2=0x7f15740379d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:40.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.046+0000 7f159798e700 1 --2- 172.21.15.92:0/987140196 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1574035520 0x7f15740379d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f15800011e0 tx=0x7f15800079d0 comp rx=0 tx=0).stop 2023-09-29T23:23:40.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.046+0000 7f159798e700 1 -- 172.21.15.92:0/987140196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f159009fd80 msgr2=0x7f159013e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:40.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.046+0000 7f159798e700 1 --2- 172.21.15.92:0/987140196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f159009fd80 0x7f159013e520 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f158c0093f0 tx=0x7f158c016000 comp rx=0 tx=0).stop 2023-09-29T23:23:40.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.047+0000 7f159798e700 1 -- 172.21.15.92:0/987140196 shutdown_connections 2023-09-29T23:23:40.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.047+0000 7f159798e700 1 --2- 172.21.15.92:0/987140196 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1574035520 0x7f15740379d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:40.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.047+0000 7f159798e700 1 --2- 172.21.15.92:0/987140196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f159009fd80 0x7f159013e520 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:40.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.047+0000 7f159798e700 1 -- 172.21.15.92:0/987140196 >> 172.21.15.92:0/987140196 conn(0x7f1590068000 msgr2=0x7f1590094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:40.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.047+0000 7f159798e700 1 -- 172.21.15.92:0/987140196 shutdown_connections 2023-09-29T23:23:40.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.047+0000 7f159798e700 1 -- 172.21.15.92:0/987140196 wait complete. 2023-09-29T23:23:40.048 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'rbd' created 2023-09-29T23:23:40.062 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-09-29T23:23:40.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.177+0000 7f16739a9700 1 Processor -- start 2023-09-29T23:23:40.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.177+0000 7f16739a9700 1 -- start start 2023-09-29T23:23:40.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.177+0000 7f16739a9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f166c12fef0 0x7f166c134630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:40.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.177+0000 7f16739a9700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f166c12f2a0 con 0x7f166c0a3060 2023-09-29T23:23:40.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.177+0000 7f16739a9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f166c0a3430 con 0x7f166c12fef0 2023-09-29T23:23:40.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.178+0000 7f1671745700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f166c0a3060 0x7f166c12f7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54322/0 (socket says 172.21.15.92:54322) 2023-09-29T23:23:40.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.178+0000 7f1671745700 1 -- 172.21.15.92:0/3206253748 learned_addr learned my addr 172.21.15.92:0/3206253748 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:40.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.178+0000 7f1670f44700 1 --2- 172.21.15.92:0/3206253748 >> v2:172.21.15.92:3300/0 conn(0x7f166c12fef0 0x7f166c134630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.178+0000 7f1670f44700 1 -- 172.21.15.92:0/3206253748 >> v1:172.21.15.92:6789/0 conn(0x7f166c0a3060 legacy=0x7f166c12f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.178+0000 7f1670f44700 1 -- 172.21.15.92:0/3206253748 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c099580 con 0x7f166c12fef0 2023-09-29T23:23:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.178+0000 7f1663fff700 1 -- 172.21.15.92:0/3206253748 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52889421 0 0) 0x7f166c12f2a0 con 0x7f166c0a3060 2023-09-29T23:23:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.178+0000 7f1670f44700 1 --2- 172.21.15.92:0/3206253748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c12fef0 0x7f166c134630 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f165c009860 tx=0x7f165c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e728344664d8e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.178+0000 7f1663fff700 1 -- 172.21.15.92:0/3206253748 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f165c00b680 con 0x7f166c12fef0 2023-09-29T23:23:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.178+0000 7f1663fff700 1 -- 172.21.15.92:0/3206253748 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c00b7e0 con 0x7f166c12fef0 2023-09-29T23:23:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.178+0000 7f1663fff700 1 -- 172.21.15.92:0/3206253748 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f165c00bad0 con 0x7f166c12fef0 2023-09-29T23:23:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.179+0000 7f16739a9700 1 -- 172.21.15.92:0/3206253748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c12fef0 msgr2=0x7f166c134630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.179+0000 7f16739a9700 1 --2- 172.21.15.92:0/3206253748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c12fef0 0x7f166c134630 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f165c009860 tx=0x7f165c0091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.179+0000 7f16739a9700 1 -- 172.21.15.92:0/3206253748 shutdown_connections 2023-09-29T23:23:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.179+0000 7f16739a9700 1 --2- 172.21.15.92:0/3206253748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c12fef0 0x7f166c134630 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:40.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.179+0000 7f16739a9700 1 -- 172.21.15.92:0/3206253748 >> 172.21.15.92:0/3206253748 conn(0x7f166c068040 msgr2=0x7f166c0a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:40.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.179+0000 7f16739a9700 1 -- 172.21.15.92:0/3206253748 shutdown_connections 2023-09-29T23:23:40.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.179+0000 7f16739a9700 1 -- 172.21.15.92:0/3206253748 wait complete. 2023-09-29T23:23:40.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.180+0000 7f16739a9700 1 Processor -- start 2023-09-29T23:23:40.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.180+0000 7f16739a9700 1 -- start start 2023-09-29T23:23:40.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.180+0000 7f16739a9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c0a3060 0x7f166c11de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:40.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.180+0000 7f16739a9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c11e560 con 0x7f166c0a3060 2023-09-29T23:23:40.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.180+0000 7f1671745700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c0a3060 0x7f166c11de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:40.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.180+0000 7f1671745700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c0a3060 0x7f166c11de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37170/0 (socket says 172.21.15.92:37170) 2023-09-29T23:23:40.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.180+0000 7f1671745700 1 -- 172.21.15.92:0/2115087418 learned_addr learned my addr 172.21.15.92:0/2115087418 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:40.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.181+0000 7f1671745700 1 -- 172.21.15.92:0/2115087418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c009420 con 0x7f166c0a3060 2023-09-29T23:23:40.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.181+0000 7f1671745700 1 --2- 172.21.15.92:0/2115087418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c0a3060 0x7f166c11de80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f166800c710 tx=0x7f1668007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:40.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.181+0000 7f16617fa700 1 -- 172.21.15.92:0/2115087418 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1668005d90 con 0x7f166c0a3060 2023-09-29T23:23:40.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.181+0000 7f16617fa700 1 -- 172.21.15.92:0/2115087418 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16680070d0 con 0x7f166c0a3060 2023-09-29T23:23:40.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.181+0000 7f16739a9700 1 -- 172.21.15.92:0/2115087418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f166c11c830 con 0x7f166c0a3060 2023-09-29T23:23:40.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.181+0000 7f16617fa700 1 -- 172.21.15.92:0/2115087418 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16680073c0 con 0x7f166c0a3060 2023-09-29T23:23:40.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.181+0000 7f16739a9700 1 -- 172.21.15.92:0/2115087418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166c11d730 con 0x7f166c0a3060 2023-09-29T23:23:40.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.181+0000 7f16617fa700 1 -- 172.21.15.92:0/2115087418 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f1668007520 con 0x7f166c0a3060 2023-09-29T23:23:40.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.182+0000 7f16739a9700 1 -- 172.21.15.92:0/2115087418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166c11e6b0 con 0x7f166c0a3060 2023-09-29T23:23:40.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.182+0000 7f16617fa700 1 --2- 172.21.15.92:0/2115087418 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1650035640 0x7f1650037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:40.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.182+0000 7f16617fa700 1 -- 172.21.15.92:0/2115087418 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2539+0+0 (secure 0 0 0) 0x7f1668046720 con 0x7f166c0a3060 2023-09-29T23:23:40.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.182+0000 7f1670f44700 1 --2- 172.21.15.92:0/2115087418 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1650035640 0x7f1650037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:40.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.182+0000 7f1670f44700 1 --2- 172.21.15.92:0/2115087418 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1650035640 0x7f1650037af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f165c000c00 tx=0x7f165c016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:40.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.186+0000 7f16617fa700 1 -- 172.21.15.92:0/2115087418 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f166800ec20 con 0x7f166c0a3060 2023-09-29T23:23:40.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:40.371+0000 7f16739a9700 1 -- 172.21.15.92:0/2115087418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f166c05f230 con 0x7f166c0a3060 2023-09-29T23:23:41.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.043+0000 7f16617fa700 1 -- 172.21.15.92:0/2115087418 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v12) v1 ==== 173+0+0 (secure 0 0 0) 0x7f1668017070 con 0x7f166c0a3060 2023-09-29T23:23:41.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.047+0000 7f16739a9700 1 -- 172.21.15.92:0/2115087418 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1650035640 msgr2=0x7f1650037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:41.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.047+0000 7f16739a9700 1 --2- 172.21.15.92:0/2115087418 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1650035640 0x7f1650037af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f165c000c00 tx=0x7f165c016000 comp rx=0 tx=0).stop 2023-09-29T23:23:41.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.047+0000 7f16739a9700 1 -- 172.21.15.92:0/2115087418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c0a3060 msgr2=0x7f166c11de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:41.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.047+0000 7f16739a9700 1 --2- 172.21.15.92:0/2115087418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c0a3060 0x7f166c11de80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f166800c710 tx=0x7f1668007d90 comp rx=0 tx=0).stop 2023-09-29T23:23:41.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.047+0000 7f16739a9700 1 -- 172.21.15.92:0/2115087418 shutdown_connections 2023-09-29T23:23:41.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.047+0000 7f16739a9700 1 --2- 172.21.15.92:0/2115087418 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1650035640 0x7f1650037af0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:41.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.047+0000 7f16739a9700 1 --2- 172.21.15.92:0/2115087418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c0a3060 0x7f166c11de80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:41.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.047+0000 7f16739a9700 1 -- 172.21.15.92:0/2115087418 >> 172.21.15.92:0/2115087418 conn(0x7f166c068040 msgr2=0x7f166c0a16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:41.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.047+0000 7f16739a9700 1 -- 172.21.15.92:0/2115087418 shutdown_connections 2023-09-29T23:23:41.048 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.047+0000 7f16739a9700 1 -- 172.21.15.92:0/2115087418 wait complete. 2023-09-29T23:23:41.049 INFO:teuthology.orchestra.run.smithi092.stderr:enabled application 'rbd' on pool 'rbd' 2023-09-29T23:23:41.062 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-29T23:23:41.062 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-29T23:23:41.062 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-29T23:23:41.064 INFO:tasks.ceph.mds.a:Started 2023-09-29T23:23:41.065 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-29T23:23:41.065 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:23:41.138 INFO:tasks.ceph.mds.a.smithi092.stdout:starting mds.a at 2023-09-29T23:23:41.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.184+0000 7f763759e700 1 Processor -- start 2023-09-29T23:23:41.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.184+0000 7f763759e700 1 -- start start 2023-09-29T23:23:41.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.184+0000 7f763759e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f76380a0bd0 0x7f7638097fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:41.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.184+0000 7f763759e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7638097cd0 con 0x7f7638097810 2023-09-29T23:23:41.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.184+0000 7f763759e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763809a860 con 0x7f76380a0bd0 2023-09-29T23:23:41.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.185+0000 7f763659c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f76380a0bd0 0x7f7638097fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.185+0000 7f763659c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f76380a0bd0 0x7f7638097fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36704/0 (socket says 172.21.15.92:36704) 2023-09-29T23:23:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.185+0000 7f763659c700 1 -- 172.21.15.92:0/227109508 learned_addr learned my addr 172.21.15.92:0/227109508 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.185+0000 7f7635d9b700 1 --1- 172.21.15.92:0/227109508 >> v1:172.21.15.92:6789/0 conn(0x7f7638097810 0x7f763812cd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43622/0 (socket says 172.21.15.92:43622) 2023-09-29T23:23:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.185+0000 7f763659c700 1 -- 172.21.15.92:0/227109508 >> v1:172.21.15.92:6789/0 conn(0x7f7638097810 legacy=0x7f763812cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.185+0000 7f763659c700 1 -- 172.21.15.92:0/227109508 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763809a3f0 con 0x7f76380a0bd0 2023-09-29T23:23:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.185+0000 7f763559a700 1 -- 172.21.15.92:0/227109508 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441714706 0 0) 0x7f7638097cd0 con 0x7f7638097810 2023-09-29T23:23:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.185+0000 7f763659c700 1 --2- 172.21.15.92:0/227109508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76380a0bd0 0x7f7638097fe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7620009930 tx=0x7f7620009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbf99acf1084de6 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.185+0000 7f763559a700 1 -- 172.21.15.92:0/227109508 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f762000b860 con 0x7f76380a0bd0 2023-09-29T23:23:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.185+0000 7f763559a700 1 -- 172.21.15.92:0/227109508 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762000b9c0 con 0x7f76380a0bd0 2023-09-29T23:23:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.185+0000 7f763559a700 1 -- 172.21.15.92:0/227109508 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f762000bb50 con 0x7f76380a0bd0 2023-09-29T23:23:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.186+0000 7f763759e700 1 -- 172.21.15.92:0/227109508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76380a0bd0 msgr2=0x7f7638097fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:41.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.186+0000 7f763759e700 1 --2- 172.21.15.92:0/227109508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76380a0bd0 0x7f7638097fe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7620009930 tx=0x7f7620009250 comp rx=0 tx=0).stop 2023-09-29T23:23:41.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.186+0000 7f763759e700 1 -- 172.21.15.92:0/227109508 shutdown_connections 2023-09-29T23:23:41.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.186+0000 7f763759e700 1 --2- 172.21.15.92:0/227109508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76380a0bd0 0x7f7638097fe0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:41.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.186+0000 7f763759e700 1 -- 172.21.15.92:0/227109508 >> 172.21.15.92:0/227109508 conn(0x7f7638095510 msgr2=0x7f7638095910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:41.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.186+0000 7f763759e700 1 -- 172.21.15.92:0/227109508 shutdown_connections 2023-09-29T23:23:41.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.186+0000 7f763759e700 1 -- 172.21.15.92:0/227109508 wait complete. 2023-09-29T23:23:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.186+0000 7f763759e700 1 Processor -- start 2023-09-29T23:23:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.187+0000 7f763759e700 1 -- start start 2023-09-29T23:23:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.187+0000 7f763759e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7638097810 0x7f763811feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.187+0000 7f763759e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763811eaf0 con 0x7f7638097810 2023-09-29T23:23:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.187+0000 7f763659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7638097810 0x7f763811feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.187+0000 7f763659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7638097810 0x7f763811feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36708/0 (socket says 172.21.15.92:36708) 2023-09-29T23:23:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.187+0000 7f763659c700 1 -- 172.21.15.92:0/976428247 learned_addr learned my addr 172.21.15.92:0/976428247 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:41.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.187+0000 7f763659c700 1 -- 172.21.15.92:0/976428247 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76200094f0 con 0x7f7638097810 2023-09-29T23:23:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.187+0000 7f763659c700 1 --2- 172.21.15.92:0/976428247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7638097810 0x7f763811feb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f76200094c0 tx=0x7f7620016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.187+0000 7f762e7fc700 1 -- 172.21.15.92:0/976428247 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f762000bd50 con 0x7f7638097810 2023-09-29T23:23:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.187+0000 7f762e7fc700 1 -- 172.21.15.92:0/976428247 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7620020070 con 0x7f7638097810 2023-09-29T23:23:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.187+0000 7f763759e700 1 -- 172.21.15.92:0/976428247 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763806b270 con 0x7f7638097810 2023-09-29T23:23:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.188+0000 7f762e7fc700 1 -- 172.21.15.92:0/976428247 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f762001b450 con 0x7f7638097810 2023-09-29T23:23:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.188+0000 7f763759e700 1 -- 172.21.15.92:0/976428247 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763811e700 con 0x7f7638097810 2023-09-29T23:23:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.188+0000 7f762e7fc700 1 -- 172.21.15.92:0/976428247 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f7620022030 con 0x7f7638097810 2023-09-29T23:23:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.188+0000 7f763759e700 1 -- 172.21.15.92:0/976428247 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763805f230 con 0x7f7638097810 2023-09-29T23:23:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.188+0000 7f762e7fc700 1 --2- 172.21.15.92:0/976428247 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7618035640 0x7f7618037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.188+0000 7f762e7fc700 1 -- 172.21.15.92:0/976428247 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2550+0+0 (secure 0 0 0) 0x7f7620049130 con 0x7f7638097810 2023-09-29T23:23:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.189+0000 7f7635d9b700 1 --2- 172.21.15.92:0/976428247 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7618035640 0x7f7618037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:41.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.189+0000 7f7635d9b700 1 --2- 172.21.15.92:0/976428247 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7618035640 0x7f7618037af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f76280011e0 tx=0x7f7628007990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:41.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.193+0000 7f762e7fc700 1 -- 172.21.15.92:0/976428247 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f762001b5b0 con 0x7f7638097810 2023-09-29T23:23:41.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.378+0000 7f763759e700 1 -- 172.21.15.92:0/976428247 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f763804bb40 con 0x7f7638097810 2023-09-29T23:23:41.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.379+0000 7f762e7fc700 1 -- 172.21.15.92:0/976428247 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+6245 (secure 0 0 0) 0x7f76200193f0 con 0x7f7638097810 2023-09-29T23:23:41.380 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:41.380 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":12,"fsid":"5b80eae7-9a7e-4dc0-8ff1-cd1f82a1fa33","created":"2023-09-29T23:23:30.308760+0000","modified":"2023-09-29T23:23:41.041016+0000","last_up_change":"2023-09-29T23:23:37.693186+0000","last_in_change":"2023-09-29T23:23:31.538675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-09-29T23:23:39.227674+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ea64f859-a36f-4804-810d-2fe7081c9990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":85726},{"type":"v1","addr":"172.21.15.92:6817","nonce":85726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":85726},{"type":"v1","addr":"172.21.15.92:6819","nonce":85726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":85726},{"type":"v1","addr":"172.21.15.92:6823","nonce":85726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":85726},{"type":"v1","addr":"172.21.15.92:6821","nonce":85726}]},"public_addr":"172.21.15.92:6817/85726","cluster_addr":"172.21.15.92:6819/85726","heartbeat_back_addr":"172.21.15.92:6823/85726","heartbeat_front_addr":"172.21.15.92:6821/85726","state":["exists","up"]},{"osd":1,"uuid":"2e9c0837-2887-469f-9dea-db4bde348578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":85705},{"type":"v1","addr":"172.21.15.92:6809","nonce":85705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":85705},{"type":"v1","addr":"172.21.15.92:6811","nonce":85705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":85705},{"type":"v1","addr":"172.21.15.92:6815","nonce":85705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":85705},{"type":"v1","addr":"172.21.15.92:6813","nonce":85705}]},"public_addr":"172.21.15.92:6809/85705","cluster_addr":"172.21.15.92:6811/85705","heartbeat_back_addr":"172.21.15.92:6815/85705","heartbeat_front_addr":"172.21.15.92:6813/85705","state":["exists","up"]},{"osd":2,"uuid":"81ff42a8-c905-48bb-a021-3f5734761a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":85704},{"type":"v1","addr":"172.21.15.92:6801","nonce":85704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":85704},{"type":"v1","addr":"172.21.15.92:6803","nonce":85704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":85704},{"type":"v1","addr":"172.21.15.92:6807","nonce":85704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":85704},{"type":"v1","addr":"172.21.15.92:6805","nonce":85704}]},"public_addr":"172.21.15.92:6801/85704","cluster_addr":"172.21.15.92:6803/85704","heartbeat_back_addr":"172.21.15.92:6807/85704","heartbeat_front_addr":"172.21.15.92:6805/85704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.911756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.874000+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.680977+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:23:41.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.380+0000 7f763759e700 1 -- 172.21.15.92:0/976428247 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7618035640 msgr2=0x7f7618037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:41.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.380+0000 7f763759e700 1 --2- 172.21.15.92:0/976428247 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7618035640 0x7f7618037af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f76280011e0 tx=0x7f7628007990 comp rx=0 tx=0).stop 2023-09-29T23:23:41.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.380+0000 7f763759e700 1 -- 172.21.15.92:0/976428247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7638097810 msgr2=0x7f763811feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:41.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.381+0000 7f763759e700 1 --2- 172.21.15.92:0/976428247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7638097810 0x7f763811feb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f76200094c0 tx=0x7f7620016000 comp rx=0 tx=0).stop 2023-09-29T23:23:41.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.381+0000 7f763759e700 1 -- 172.21.15.92:0/976428247 shutdown_connections 2023-09-29T23:23:41.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.381+0000 7f763759e700 1 --2- 172.21.15.92:0/976428247 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7618035640 0x7f7618037af0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:41.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.381+0000 7f763759e700 1 --2- 172.21.15.92:0/976428247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7638097810 0x7f763811feb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:41.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.381+0000 7f763759e700 1 -- 172.21.15.92:0/976428247 >> 172.21.15.92:0/976428247 conn(0x7f7638095510 msgr2=0x7f763806ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:41.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.381+0000 7f763759e700 1 -- 172.21.15.92:0/976428247 shutdown_connections 2023-09-29T23:23:41.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.381+0000 7f763759e700 1 -- 172.21.15.92:0/976428247 wait complete. 2023-09-29T23:23:41.393 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-09-29T23:23:39.227674+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-29T23:23:41.393 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-29T23:23:41.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.509+0000 7fba06517700 1 Processor -- start 2023-09-29T23:23:41.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.509+0000 7fba06517700 1 -- start start 2023-09-29T23:23:41.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.510+0000 7fba06517700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fba000a3030 0x7fba0012f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:41.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.510+0000 7fba06517700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba000997f0 con 0x7fba0012fae0 2023-09-29T23:23:41.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.510+0000 7fba06517700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba000a3400 con 0x7fba000a3030 2023-09-29T23:23:41.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.510+0000 7fb9fffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fba000a3030 0x7fba0012f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:41.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.510+0000 7fb9fffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fba000a3030 0x7fba0012f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36714/0 (socket says 172.21.15.92:36714) 2023-09-29T23:23:41.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.510+0000 7fb9ff7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fba0012fae0 0x7fba00095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43624/0 (socket says 172.21.15.92:43624) 2023-09-29T23:23:41.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.510+0000 7fb9fffff700 1 -- 172.21.15.92:0/3796735823 learned_addr learned my addr 172.21.15.92:0/3796735823 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:41.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.510+0000 7fb9fffff700 1 -- 172.21.15.92:0/3796735823 >> v1:172.21.15.92:6789/0 conn(0x7fba0012fae0 legacy=0x7fba00095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:41.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.510+0000 7fb9fffff700 1 -- 172.21.15.92:0/3796735823 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba000977a0 con 0x7fba000a3030 2023-09-29T23:23:41.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.510+0000 7fb9fffff700 1 --2- 172.21.15.92:0/3796735823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba000a3030 0x7fba0012f5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0009930 tx=0x7fb9f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c490531eac671e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:41.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.510+0000 7fb9feffd700 1 -- 172.21.15.92:0/3796735823 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9f000b8f0 con 0x7fba000a3030 2023-09-29T23:23:41.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.510+0000 7fb9feffd700 1 -- 172.21.15.92:0/3796735823 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f000ba50 con 0x7fba000a3030 2023-09-29T23:23:41.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.510+0000 7fb9feffd700 1 -- 172.21.15.92:0/3796735823 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9f000bbe0 con 0x7fba000a3030 2023-09-29T23:23:41.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.511+0000 7fba06517700 1 -- 172.21.15.92:0/3796735823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba000a3030 msgr2=0x7fba0012f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:41.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.511+0000 7fba06517700 1 --2- 172.21.15.92:0/3796735823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba000a3030 0x7fba0012f5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0009930 tx=0x7fb9f0009250 comp rx=0 tx=0).stop 2023-09-29T23:23:41.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.511+0000 7fba06517700 1 -- 172.21.15.92:0/3796735823 shutdown_connections 2023-09-29T23:23:41.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.511+0000 7fba06517700 1 --2- 172.21.15.92:0/3796735823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba000a3030 0x7fba0012f5a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:41.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.511+0000 7fba06517700 1 -- 172.21.15.92:0/3796735823 >> 172.21.15.92:0/3796735823 conn(0x7fba00067fc0 msgr2=0x7fba000a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:41.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.511+0000 7fba06517700 1 -- 172.21.15.92:0/3796735823 shutdown_connections 2023-09-29T23:23:41.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.511+0000 7fba06517700 1 -- 172.21.15.92:0/3796735823 wait complete. 2023-09-29T23:23:41.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.512+0000 7fba06517700 1 Processor -- start 2023-09-29T23:23:41.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.512+0000 7fba06517700 1 -- start start 2023-09-29T23:23:41.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.512+0000 7fba06517700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba000a3030 0x7fba0012c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:41.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.512+0000 7fba06517700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0011daa0 con 0x7fba000a3030 2023-09-29T23:23:41.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.512+0000 7fb9fffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba000a3030 0x7fba0012c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:41.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.512+0000 7fb9fffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba000a3030 0x7fba0012c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36724/0 (socket says 172.21.15.92:36724) 2023-09-29T23:23:41.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.512+0000 7fb9fffff700 1 -- 172.21.15.92:0/3206751038 learned_addr learned my addr 172.21.15.92:0/3206751038 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:41.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.512+0000 7fb9fffff700 1 -- 172.21.15.92:0/3206751038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f00094f0 con 0x7fba000a3030 2023-09-29T23:23:41.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.513+0000 7fb9fffff700 1 --2- 172.21.15.92:0/3206751038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba000a3030 0x7fba0012c400 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00094c0 tx=0x7fb9f0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:41.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.513+0000 7fb9e7fff700 1 -- 172.21.15.92:0/3206751038 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9f000bdd0 con 0x7fba000a3030 2023-09-29T23:23:41.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.513+0000 7fb9e7fff700 1 -- 172.21.15.92:0/3206751038 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f001f070 con 0x7fba000a3030 2023-09-29T23:23:41.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.513+0000 7fb9e7fff700 1 -- 172.21.15.92:0/3206751038 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9f001a580 con 0x7fba000a3030 2023-09-29T23:23:41.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.513+0000 7fba06517700 1 -- 172.21.15.92:0/3206751038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0011be40 con 0x7fba000a3030 2023-09-29T23:23:41.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.513+0000 7fba06517700 1 -- 172.21.15.92:0/3206751038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0011c6a0 con 0x7fba000a3030 2023-09-29T23:23:41.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.513+0000 7fb9e7fff700 1 -- 172.21.15.92:0/3206751038 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fb9f0021030 con 0x7fba000a3030 2023-09-29T23:23:41.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.514+0000 7fb9e7fff700 1 --2- 172.21.15.92:0/3206751038 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb9ec035640 0x7fb9ec037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:41.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.514+0000 7fb9e7fff700 1 -- 172.21.15.92:0/3206751038 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2550+0+0 (secure 0 0 0) 0x7fb9f0048c80 con 0x7fba000a3030 2023-09-29T23:23:41.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.514+0000 7fb9ff7fe700 1 --2- 172.21.15.92:0/3206751038 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb9ec035640 0x7fb9ec037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:41.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.514+0000 7fba06517700 1 -- 172.21.15.92:0/3206751038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0011bcb0 con 0x7fba000a3030 2023-09-29T23:23:41.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.514+0000 7fb9ff7fe700 1 --2- 172.21.15.92:0/3206751038 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb9ec035640 0x7fb9ec037af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb9f40016a0 tx=0x7fb9f4007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:41.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.518+0000 7fb9e7fff700 1 -- 172.21.15.92:0/3206751038 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9f0022970 con 0x7fba000a3030 2023-09-29T23:23:41.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.698+0000 7fba06517700 1 -- 172.21.15.92:0/3206751038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fba0005f230 con 0x7fba000a3030 2023-09-29T23:23:41.698 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.698+0000 7fb9e7fff700 1 -- 172.21.15.92:0/3206751038 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v12) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb9f0022380 con 0x7fba000a3030 2023-09-29T23:23:41.699 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-09-29T23:23:41.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.700+0000 7fba06517700 1 -- 172.21.15.92:0/3206751038 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb9ec035640 msgr2=0x7fb9ec037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:41.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.700+0000 7fba06517700 1 --2- 172.21.15.92:0/3206751038 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb9ec035640 0x7fb9ec037af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb9f40016a0 tx=0x7fb9f4007b30 comp rx=0 tx=0).stop 2023-09-29T23:23:41.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.700+0000 7fba06517700 1 -- 172.21.15.92:0/3206751038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba000a3030 msgr2=0x7fba0012c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:41.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.700+0000 7fba06517700 1 --2- 172.21.15.92:0/3206751038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba000a3030 0x7fba0012c400 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00094c0 tx=0x7fb9f0016000 comp rx=0 tx=0).stop 2023-09-29T23:23:41.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.700+0000 7fba06517700 1 -- 172.21.15.92:0/3206751038 shutdown_connections 2023-09-29T23:23:41.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.700+0000 7fba06517700 1 --2- 172.21.15.92:0/3206751038 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb9ec035640 0x7fb9ec037af0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:41.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.700+0000 7fba06517700 1 --2- 172.21.15.92:0/3206751038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba000a3030 0x7fba0012c400 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:41.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.700+0000 7fba06517700 1 -- 172.21.15.92:0/3206751038 >> 172.21.15.92:0/3206751038 conn(0x7fba00067fc0 msgr2=0x7fba0012d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:41.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.700+0000 7fba06517700 1 -- 172.21.15.92:0/3206751038 shutdown_connections 2023-09-29T23:23:41.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.700+0000 7fba06517700 1 -- 172.21.15.92:0/3206751038 wait complete. 2023-09-29T23:23:41.712 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-29T23:23:41.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.824+0000 7fbdbe514700 1 Processor -- start 2023-09-29T23:23:41.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.824+0000 7fbdbe514700 1 -- start start 2023-09-29T23:23:41.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.825+0000 7fbdbe514700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbdb812ffc0 0x7fbdb80a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:41.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.825+0000 7fbdbe514700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb8098710 con 0x7fbdb809fd80 2023-09-29T23:23:41.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.825+0000 7fbdbe514700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb812f340 con 0x7fbdb812ffc0 2023-09-29T23:23:41.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.825+0000 7fbdb77fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbdb812ffc0 0x7fbdb80a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:41.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.825+0000 7fbdb7fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fbdb809fd80 0x7fbdb812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43632/0 (socket says 172.21.15.92:43632) 2023-09-29T23:23:41.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.825+0000 7fbdb7fff700 1 -- 172.21.15.92:0/185079474 learned_addr learned my addr 172.21.15.92:0/185079474 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:41.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.825+0000 7fbdb77fe700 1 -- 172.21.15.92:0/185079474 >> v1:172.21.15.92:6789/0 conn(0x7fbdb809fd80 legacy=0x7fbdb812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:41.827 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.825+0000 7fbdb77fe700 1 -- 172.21.15.92:0/185079474 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb80997e0 con 0x7fbdb812ffc0 2023-09-29T23:23:41.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.825+0000 7fbdb6ffd700 1 -- 172.21.15.92:0/185079474 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556428349 0 0) 0x7fbdb8098710 con 0x7fbdb809fd80 2023-09-29T23:23:41.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.825+0000 7fbdb77fe700 1 --2- 172.21.15.92:0/185079474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdb812ffc0 0x7fbdb80a3090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbdac009860 tx=0x7fbdac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a143c7e6cce56ebc server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:41.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.825+0000 7fbdb6ffd700 1 -- 172.21.15.92:0/185079474 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdac00b680 con 0x7fbdb812ffc0 2023-09-29T23:23:41.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.825+0000 7fbdb6ffd700 1 -- 172.21.15.92:0/185079474 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac00b7e0 con 0x7fbdb812ffc0 2023-09-29T23:23:41.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.825+0000 7fbdb6ffd700 1 -- 172.21.15.92:0/185079474 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdac00b990 con 0x7fbdb812ffc0 2023-09-29T23:23:41.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.826+0000 7fbdbe514700 1 -- 172.21.15.92:0/185079474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdb812ffc0 msgr2=0x7fbdb80a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:41.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.826+0000 7fbdbe514700 1 --2- 172.21.15.92:0/185079474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdb812ffc0 0x7fbdb80a3090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbdac009860 tx=0x7fbdac0091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:41.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.826+0000 7fbdbe514700 1 -- 172.21.15.92:0/185079474 shutdown_connections 2023-09-29T23:23:41.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.826+0000 7fbdbe514700 1 --2- 172.21.15.92:0/185079474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdb812ffc0 0x7fbdb80a3090 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:41.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.826+0000 7fbdbe514700 1 -- 172.21.15.92:0/185079474 >> 172.21.15.92:0/185079474 conn(0x7fbdb8068000 msgr2=0x7fbdb80a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:41.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.826+0000 7fbdbe514700 1 -- 172.21.15.92:0/185079474 shutdown_connections 2023-09-29T23:23:41.828 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.826+0000 7fbdbe514700 1 -- 172.21.15.92:0/185079474 wait complete. 2023-09-29T23:23:41.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.827+0000 7fbdbe514700 1 Processor -- start 2023-09-29T23:23:41.830 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.827+0000 7fbdbe514700 1 -- start start 2023-09-29T23:23:41.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.827+0000 7fbdbe514700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdb809fd80 0x7fbdb813e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:41.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.827+0000 7fbdbe514700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb811e2f0 con 0x7fbdb809fd80 2023-09-29T23:23:41.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.827+0000 7fbdb7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdb809fd80 0x7fbdb813e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:41.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.827+0000 7fbdb7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdb809fd80 0x7fbdb813e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36746/0 (socket says 172.21.15.92:36746) 2023-09-29T23:23:41.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.827+0000 7fbdb7fff700 1 -- 172.21.15.92:0/1777798544 learned_addr learned my addr 172.21.15.92:0/1777798544 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:41.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.828+0000 7fbdb7fff700 1 -- 172.21.15.92:0/1777798544 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac009420 con 0x7fbdb809fd80 2023-09-29T23:23:41.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.828+0000 7fbdb7fff700 1 --2- 172.21.15.92:0/1777798544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdb809fd80 0x7fbdb813e520 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbda800c460 tx=0x7fbda8000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:41.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.828+0000 7fbd9ffff700 1 -- 172.21.15.92:0/1777798544 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbda8005c70 con 0x7fbdb809fd80 2023-09-29T23:23:41.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.828+0000 7fbd9ffff700 1 -- 172.21.15.92:0/1777798544 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda8005dd0 con 0x7fbdb809fd80 2023-09-29T23:23:41.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.828+0000 7fbdbe514700 1 -- 172.21.15.92:0/1777798544 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb811c4a0 con 0x7fbdb809fd80 2023-09-29T23:23:41.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.828+0000 7fbd9ffff700 1 -- 172.21.15.92:0/1777798544 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbda8007230 con 0x7fbdb809fd80 2023-09-29T23:23:41.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.828+0000 7fbdbe514700 1 -- 172.21.15.92:0/1777798544 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb811cff0 con 0x7fbdb809fd80 2023-09-29T23:23:41.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.829+0000 7fbd9ffff700 1 -- 172.21.15.92:0/1777798544 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fbda8007390 con 0x7fbdb809fd80 2023-09-29T23:23:41.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.829+0000 7fbdbe514700 1 -- 172.21.15.92:0/1777798544 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb80a1fc0 con 0x7fbdb809fd80 2023-09-29T23:23:41.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.829+0000 7fbd9ffff700 1 --2- 172.21.15.92:0/1777798544 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fbda4035630 0x7fbda4037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:41.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.829+0000 7fbd9ffff700 1 -- 172.21.15.92:0/1777798544 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2550+0+0 (secure 0 0 0) 0x7fbda8046700 con 0x7fbdb809fd80 2023-09-29T23:23:41.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.829+0000 7fbdb77fe700 1 --2- 172.21.15.92:0/1777798544 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fbda4035630 0x7fbda4037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:41.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.829+0000 7fbdb77fe700 1 --2- 172.21.15.92:0/1777798544 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fbda4035630 0x7fbda4037ae0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbdac009860 tx=0x7fbdac016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:41.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:41.833+0000 7fbd9ffff700 1 -- 172.21.15.92:0/1777798544 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbda80188b0 con 0x7fbdb809fd80 2023-09-29T23:23:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.056+0000 7fbdbe514700 1 -- 172.21.15.92:0/1777798544 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdb805f230 con 0x7fbdb809fd80 2023-09-29T23:23:42.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.056+0000 7fbd9ffff700 1 -- 172.21.15.92:0/1777798544 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7fbda8017070 con 0x7fbdb809fd80 2023-09-29T23:23:42.058 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:42.058 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4146,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6827/1334445094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1334445094},{"type":"v1","addr":"172.21.15.92:6827","nonce":1334445094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-09-29T23:23:42.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.058+0000 7fbdbe514700 1 -- 172.21.15.92:0/1777798544 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fbda4035630 msgr2=0x7fbda4037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:42.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.058+0000 7fbdbe514700 1 --2- 172.21.15.92:0/1777798544 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fbda4035630 0x7fbda4037ae0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbdac009860 tx=0x7fbdac016000 comp rx=0 tx=0).stop 2023-09-29T23:23:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.058+0000 7fbdbe514700 1 -- 172.21.15.92:0/1777798544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdb809fd80 msgr2=0x7fbdb813e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.058+0000 7fbdbe514700 1 --2- 172.21.15.92:0/1777798544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdb809fd80 0x7fbdb813e520 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbda800c460 tx=0x7fbda8000fe0 comp rx=0 tx=0).stop 2023-09-29T23:23:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.058+0000 7fbdbe514700 1 -- 172.21.15.92:0/1777798544 shutdown_connections 2023-09-29T23:23:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.058+0000 7fbdbe514700 1 --2- 172.21.15.92:0/1777798544 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fbda4035630 0x7fbda4037ae0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.058+0000 7fbdbe514700 1 --2- 172.21.15.92:0/1777798544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdb809fd80 0x7fbdb813e520 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.058+0000 7fbdbe514700 1 -- 172.21.15.92:0/1777798544 >> 172.21.15.92:0/1777798544 conn(0x7fbdb8068000 msgr2=0x7fbdb8094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.058+0000 7fbdbe514700 1 -- 172.21.15.92:0/1777798544 shutdown_connections 2023-09-29T23:23:42.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.058+0000 7fbdbe514700 1 -- 172.21.15.92:0/1777798544 wait complete. 2023-09-29T23:23:42.061 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 2 2023-09-29T23:23:42.072 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:23:42.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.185+0000 7f0fc48fd700 1 Processor -- start 2023-09-29T23:23:42.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.185+0000 7f0fc48fd700 1 -- start start 2023-09-29T23:23:42.187 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.185+0000 7f0fc48fd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0fc009c600 0x7f0fc00a3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:42.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.185+0000 7f0fc48fd700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc0098320 con 0x7f0fc012bc80 2023-09-29T23:23:42.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.185+0000 7f0fc48fd700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc009c9d0 con 0x7f0fc009c600 2023-09-29T23:23:42.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.185+0000 7f0fbed9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0fc009c600 0x7f0fc00a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:42.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.185+0000 7f0fb7fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f0fc012bc80 0x7f0fc012f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43648/0 (socket says 172.21.15.92:43648) 2023-09-29T23:23:42.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.185+0000 7f0fb7fff700 1 -- 172.21.15.92:0/2459747379 learned_addr learned my addr 172.21.15.92:0/2459747379 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:42.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.186+0000 7f0fbed9d700 1 -- 172.21.15.92:0/2459747379 >> v1:172.21.15.92:6789/0 conn(0x7f0fc012bc80 legacy=0x7f0fc012f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:42.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.186+0000 7f0fbed9d700 1 -- 172.21.15.92:0/2459747379 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc012c620 con 0x7f0fc009c600 2023-09-29T23:23:42.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.186+0000 7f0fbed9d700 1 --2- 172.21.15.92:0/2459747379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fc009c600 0x7f0fc00a3030 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009860 tx=0x7f0fb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91b110c3b8f0dd server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:42.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.186+0000 7f0fbe59c700 1 -- 172.21.15.92:0/2459747379 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fb000b680 con 0x7f0fc009c600 2023-09-29T23:23:42.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.186+0000 7f0fbe59c700 1 -- 172.21.15.92:0/2459747379 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb000b7e0 con 0x7f0fc009c600 2023-09-29T23:23:42.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.186+0000 7f0fbe59c700 1 -- 172.21.15.92:0/2459747379 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fb000bad0 con 0x7f0fc009c600 2023-09-29T23:23:42.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.186+0000 7f0fc48fd700 1 -- 172.21.15.92:0/2459747379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fc009c600 msgr2=0x7f0fc00a3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:42.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.186+0000 7f0fc48fd700 1 --2- 172.21.15.92:0/2459747379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fc009c600 0x7f0fc00a3030 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009860 tx=0x7f0fb00091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:42.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.186+0000 7f0fc48fd700 1 -- 172.21.15.92:0/2459747379 shutdown_connections 2023-09-29T23:23:42.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.186+0000 7f0fc48fd700 1 --2- 172.21.15.92:0/2459747379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fc009c600 0x7f0fc00a3030 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:42.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.186+0000 7f0fc48fd700 1 -- 172.21.15.92:0/2459747379 >> 172.21.15.92:0/2459747379 conn(0x7f0fc0068080 msgr2=0x7f0fc0096a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:42.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.187+0000 7f0fc48fd700 1 -- 172.21.15.92:0/2459747379 shutdown_connections 2023-09-29T23:23:42.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.187+0000 7f0fc48fd700 1 -- 172.21.15.92:0/2459747379 wait complete. 2023-09-29T23:23:42.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.187+0000 7f0fc48fd700 1 Processor -- start 2023-09-29T23:23:42.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.187+0000 7f0fc48fd700 1 -- start start 2023-09-29T23:23:42.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.188+0000 7f0fc48fd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fc009c600 0x7f0fc013e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:42.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.188+0000 7f0fc48fd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc0118df0 con 0x7f0fc009c600 2023-09-29T23:23:42.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.188+0000 7f0fbed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fc009c600 0x7f0fc013e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:42.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.188+0000 7f0fbed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fc009c600 0x7f0fc013e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36766/0 (socket says 172.21.15.92:36766) 2023-09-29T23:23:42.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.188+0000 7f0fbed9d700 1 -- 172.21.15.92:0/1156304536 learned_addr learned my addr 172.21.15.92:0/1156304536 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:42.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.188+0000 7f0fbed9d700 1 -- 172.21.15.92:0/1156304536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb0009420 con 0x7f0fc009c600 2023-09-29T23:23:42.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.188+0000 7f0fbed9d700 1 --2- 172.21.15.92:0/1156304536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fc009c600 0x7f0fc013e870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0000c00 tx=0x7f0fb0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:42.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.188+0000 7f0fb6ffd700 1 -- 172.21.15.92:0/1156304536 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fb0024470 con 0x7f0fc009c600 2023-09-29T23:23:42.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.188+0000 7f0fb6ffd700 1 -- 172.21.15.92:0/1156304536 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb00245d0 con 0x7f0fc009c600 2023-09-29T23:23:42.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.188+0000 7f0fb6ffd700 1 -- 172.21.15.92:0/1156304536 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fb0024880 con 0x7f0fc009c600 2023-09-29T23:23:42.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.188+0000 7f0fc48fd700 1 -- 172.21.15.92:0/1156304536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc0119220 con 0x7f0fc009c600 2023-09-29T23:23:42.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.188+0000 7f0fc48fd700 1 -- 172.21.15.92:0/1156304536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc00a2840 con 0x7f0fc009c600 2023-09-29T23:23:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.189+0000 7f0fb6ffd700 1 -- 172.21.15.92:0/1156304536 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f0fb0021070 con 0x7f0fc009c600 2023-09-29T23:23:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.189+0000 7f0fc48fd700 1 -- 172.21.15.92:0/1156304536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc0068b80 con 0x7f0fc009c600 2023-09-29T23:23:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.189+0000 7f0fb6ffd700 1 --2- 172.21.15.92:0/1156304536 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0fa0035640 0x7f0fa0037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.189+0000 7f0fb6ffd700 1 -- 172.21.15.92:0/1156304536 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2550+0+0 (secure 0 0 0) 0x7f0fb0048e00 con 0x7f0fc009c600 2023-09-29T23:23:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.190+0000 7f0fb7fff700 1 --2- 172.21.15.92:0/1156304536 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0fa0035640 0x7f0fa0037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:42.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.190+0000 7f0fb7fff700 1 --2- 172.21.15.92:0/1156304536 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0fa0035640 0x7f0fa0037af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8007fd0 tx=0x7f0fa8007b90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:42.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.194+0000 7f0fb6ffd700 1 -- 172.21.15.92:0/1156304536 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0fb001a460 con 0x7f0fc009c600 2023-09-29T23:23:42.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.380+0000 7f0fc48fd700 1 -- 172.21.15.92:0/1156304536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fc005f230 con 0x7f0fc009c600 2023-09-29T23:23:42.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.381+0000 7f0fb6ffd700 1 -- 172.21.15.92:0/1156304536 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+6232 (secure 0 0 0) 0x7f0fb002c3a0 con 0x7f0fc009c600 2023-09-29T23:23:42.382 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:42.382 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":13,"fsid":"5b80eae7-9a7e-4dc0-8ff1-cd1f82a1fa33","created":"2023-09-29T23:23:30.308760+0000","modified":"2023-09-29T23:23:42.043590+0000","last_up_change":"2023-09-29T23:23:37.693186+0000","last_in_change":"2023-09-29T23:23:31.538675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-09-29T23:23:39.227674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ea64f859-a36f-4804-810d-2fe7081c9990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":85726},{"type":"v1","addr":"172.21.15.92:6817","nonce":85726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":85726},{"type":"v1","addr":"172.21.15.92:6819","nonce":85726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":85726},{"type":"v1","addr":"172.21.15.92:6823","nonce":85726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":85726},{"type":"v1","addr":"172.21.15.92:6821","nonce":85726}]},"public_addr":"172.21.15.92:6817/85726","cluster_addr":"172.21.15.92:6819/85726","heartbeat_back_addr":"172.21.15.92:6823/85726","heartbeat_front_addr":"172.21.15.92:6821/85726","state":["exists","up"]},{"osd":1,"uuid":"2e9c0837-2887-469f-9dea-db4bde348578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":85705},{"type":"v1","addr":"172.21.15.92:6809","nonce":85705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":85705},{"type":"v1","addr":"172.21.15.92:6811","nonce":85705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":85705},{"type":"v1","addr":"172.21.15.92:6815","nonce":85705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":85705},{"type":"v1","addr":"172.21.15.92:6813","nonce":85705}]},"public_addr":"172.21.15.92:6809/85705","cluster_addr":"172.21.15.92:6811/85705","heartbeat_back_addr":"172.21.15.92:6815/85705","heartbeat_front_addr":"172.21.15.92:6813/85705","state":["exists","up"]},{"osd":2,"uuid":"81ff42a8-c905-48bb-a021-3f5734761a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":85704},{"type":"v1","addr":"172.21.15.92:6801","nonce":85704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":85704},{"type":"v1","addr":"172.21.15.92:6803","nonce":85704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":85704},{"type":"v1","addr":"172.21.15.92:6807","nonce":85704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":85704},{"type":"v1","addr":"172.21.15.92:6805","nonce":85704}]},"public_addr":"172.21.15.92:6801/85704","cluster_addr":"172.21.15.92:6803/85704","heartbeat_back_addr":"172.21.15.92:6807/85704","heartbeat_front_addr":"172.21.15.92:6805/85704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.911756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.874000+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.680977+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:23:42.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.383+0000 7f0fc48fd700 1 -- 172.21.15.92:0/1156304536 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0fa0035640 msgr2=0x7f0fa0037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:42.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.383+0000 7f0fc48fd700 1 --2- 172.21.15.92:0/1156304536 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0fa0035640 0x7f0fa0037af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8007fd0 tx=0x7f0fa8007b90 comp rx=0 tx=0).stop 2023-09-29T23:23:42.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.383+0000 7f0fc48fd700 1 -- 172.21.15.92:0/1156304536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fc009c600 msgr2=0x7f0fc013e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:42.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.383+0000 7f0fc48fd700 1 --2- 172.21.15.92:0/1156304536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fc009c600 0x7f0fc013e870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0000c00 tx=0x7f0fb0016000 comp rx=0 tx=0).stop 2023-09-29T23:23:42.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.383+0000 7f0fc48fd700 1 -- 172.21.15.92:0/1156304536 shutdown_connections 2023-09-29T23:23:42.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.383+0000 7f0fc48fd700 1 --2- 172.21.15.92:0/1156304536 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0fa0035640 0x7f0fa0037af0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:42.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.383+0000 7f0fc48fd700 1 --2- 172.21.15.92:0/1156304536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fc009c600 0x7f0fc013e870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:42.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.383+0000 7f0fc48fd700 1 -- 172.21.15.92:0/1156304536 >> 172.21.15.92:0/1156304536 conn(0x7f0fc0068080 msgr2=0x7f0fc012db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:42.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.383+0000 7f0fc48fd700 1 -- 172.21.15.92:0/1156304536 shutdown_connections 2023-09-29T23:23:42.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.383+0000 7f0fc48fd700 1 -- 172.21.15.92:0/1156304536 wait complete. 2023-09-29T23:23:42.396 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-09-29T23:23:39.227674+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-29T23:23:42.396 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-29T23:23:42.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.511+0000 7fb03d6ba700 1 Processor -- start 2023-09-29T23:23:42.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.511+0000 7fb03d6ba700 1 -- start start 2023-09-29T23:23:42.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.511+0000 7fb03d6ba700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb03806d190 0x7fb03806d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:42.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.511+0000 7fb03d6ba700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03809dd40 con 0x7fb03809cec0 2023-09-29T23:23:42.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.511+0000 7fb03d6ba700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03806efa0 con 0x7fb03806d190 2023-09-29T23:23:42.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.511+0000 7fb037fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb03806d190 0x7fb03806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:42.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.511+0000 7fb0377fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fb03809cec0 0x7fb03812cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43664/0 (socket says 172.21.15.92:43664) 2023-09-29T23:23:42.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.511+0000 7fb0377fe700 1 -- 172.21.15.92:0/1739532661 learned_addr learned my addr 172.21.15.92:0/1739532661 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:42.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.512+0000 7fb037fff700 1 -- 172.21.15.92:0/1739532661 >> v1:172.21.15.92:6789/0 conn(0x7fb03809cec0 legacy=0x7fb03812cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:42.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.512+0000 7fb037fff700 1 -- 172.21.15.92:0/1739532661 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03806e9e0 con 0x7fb03806d190 2023-09-29T23:23:42.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.512+0000 7fb037fff700 1 --2- 172.21.15.92:0/1739532661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb03806d190 0x7fb03806d560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb028009860 tx=0x7fb0280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a9c0e26ac70877 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:42.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.512+0000 7fb036ffd700 1 -- 172.21.15.92:0/1739532661 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb02800b680 con 0x7fb03806d190 2023-09-29T23:23:42.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.512+0000 7fb036ffd700 1 -- 172.21.15.92:0/1739532661 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02800b7e0 con 0x7fb03806d190 2023-09-29T23:23:42.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.512+0000 7fb036ffd700 1 -- 172.21.15.92:0/1739532661 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb02800b990 con 0x7fb03806d190 2023-09-29T23:23:42.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.512+0000 7fb03d6ba700 1 -- 172.21.15.92:0/1739532661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb03806d190 msgr2=0x7fb03806d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:42.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.512+0000 7fb03d6ba700 1 --2- 172.21.15.92:0/1739532661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb03806d190 0x7fb03806d560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb028009860 tx=0x7fb0280091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:42.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.512+0000 7fb03d6ba700 1 -- 172.21.15.92:0/1739532661 shutdown_connections 2023-09-29T23:23:42.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.512+0000 7fb03d6ba700 1 --2- 172.21.15.92:0/1739532661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb03806d190 0x7fb03806d560 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:42.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.512+0000 7fb03d6ba700 1 -- 172.21.15.92:0/1739532661 >> 172.21.15.92:0/1739532661 conn(0x7fb03809f2a0 msgr2=0x7fb03809b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:42.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.512+0000 7fb03d6ba700 1 -- 172.21.15.92:0/1739532661 shutdown_connections 2023-09-29T23:23:42.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.512+0000 7fb03d6ba700 1 -- 172.21.15.92:0/1739532661 wait complete. 2023-09-29T23:23:42.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.513+0000 7fb03d6ba700 1 Processor -- start 2023-09-29T23:23:42.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.513+0000 7fb03d6ba700 1 -- start start 2023-09-29T23:23:42.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.514+0000 7fb03d6ba700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb03806d190 0x7fb03811b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:42.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.514+0000 7fb03d6ba700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03811e640 con 0x7fb03806d190 2023-09-29T23:23:42.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.514+0000 7fb037fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb03806d190 0x7fb03811b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:42.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.514+0000 7fb037fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb03806d190 0x7fb03811b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36782/0 (socket says 172.21.15.92:36782) 2023-09-29T23:23:42.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.514+0000 7fb037fff700 1 -- 172.21.15.92:0/2684476072 learned_addr learned my addr 172.21.15.92:0/2684476072 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:42.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.514+0000 7fb037fff700 1 -- 172.21.15.92:0/2684476072 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb028009420 con 0x7fb03806d190 2023-09-29T23:23:42.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.514+0000 7fb037fff700 1 --2- 172.21.15.92:0/2684476072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb03806d190 0x7fb03811b900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb028000c00 tx=0x7fb028016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:42.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.514+0000 7fb01ffff700 1 -- 172.21.15.92:0/2684476072 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb028024470 con 0x7fb03806d190 2023-09-29T23:23:42.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.514+0000 7fb01ffff700 1 -- 172.21.15.92:0/2684476072 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0280245d0 con 0x7fb03806d190 2023-09-29T23:23:42.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.514+0000 7fb03d6ba700 1 -- 172.21.15.92:0/2684476072 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03811f6a0 con 0x7fb03806d190 2023-09-29T23:23:42.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.514+0000 7fb01ffff700 1 -- 172.21.15.92:0/2684476072 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb028024880 con 0x7fb03806d190 2023-09-29T23:23:42.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.514+0000 7fb03d6ba700 1 -- 172.21.15.92:0/2684476072 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03811f230 con 0x7fb03806d190 2023-09-29T23:23:42.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.515+0000 7fb01ffff700 1 -- 172.21.15.92:0/2684476072 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fb028021070 con 0x7fb03806d190 2023-09-29T23:23:42.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.515+0000 7fb01ffff700 1 --2- 172.21.15.92:0/2684476072 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb024035640 0x7fb024037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:42.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.515+0000 7fb01ffff700 1 -- 172.21.15.92:0/2684476072 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2550+0+0 (secure 0 0 0) 0x7fb028048ea0 con 0x7fb03806d190 2023-09-29T23:23:42.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.515+0000 7fb03d6ba700 1 -- 172.21.15.92:0/2684476072 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03811d870 con 0x7fb03806d190 2023-09-29T23:23:42.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.515+0000 7fb0377fe700 1 --2- 172.21.15.92:0/2684476072 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb024035640 0x7fb024037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:42.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.516+0000 7fb0377fe700 1 --2- 172.21.15.92:0/2684476072 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb024035640 0x7fb024037af0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0016a0 tx=0x7fb02c007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:42.521 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.521+0000 7fb01ffff700 1 -- 172.21.15.92:0/2684476072 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb02801a460 con 0x7fb03806d190 2023-09-29T23:23:42.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.700+0000 7fb03d6ba700 1 -- 172.21.15.92:0/2684476072 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb03805f230 con 0x7fb03806d190 2023-09-29T23:23:42.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.701+0000 7fb01ffff700 1 -- 172.21.15.92:0/2684476072 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v13) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb02802c3a0 con 0x7fb03806d190 2023-09-29T23:23:42.702 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 8 2023-09-29T23:23:42.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.703+0000 7fb03d6ba700 1 -- 172.21.15.92:0/2684476072 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb024035640 msgr2=0x7fb024037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:42.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.703+0000 7fb03d6ba700 1 --2- 172.21.15.92:0/2684476072 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb024035640 0x7fb024037af0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0016a0 tx=0x7fb02c007b30 comp rx=0 tx=0).stop 2023-09-29T23:23:42.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.703+0000 7fb03d6ba700 1 -- 172.21.15.92:0/2684476072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb03806d190 msgr2=0x7fb03811b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:42.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.703+0000 7fb03d6ba700 1 --2- 172.21.15.92:0/2684476072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb03806d190 0x7fb03811b900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb028000c00 tx=0x7fb028016000 comp rx=0 tx=0).stop 2023-09-29T23:23:42.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.703+0000 7fb03d6ba700 1 -- 172.21.15.92:0/2684476072 shutdown_connections 2023-09-29T23:23:42.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.703+0000 7fb03d6ba700 1 --2- 172.21.15.92:0/2684476072 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb024035640 0x7fb024037af0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:42.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.703+0000 7fb03d6ba700 1 --2- 172.21.15.92:0/2684476072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb03806d190 0x7fb03811b900 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:42.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.703+0000 7fb03d6ba700 1 -- 172.21.15.92:0/2684476072 >> 172.21.15.92:0/2684476072 conn(0x7fb03809f2a0 msgr2=0x7fb038114e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:42.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.703+0000 7fb03d6ba700 1 -- 172.21.15.92:0/2684476072 shutdown_connections 2023-09-29T23:23:42.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.703+0000 7fb03d6ba700 1 -- 172.21.15.92:0/2684476072 wait complete. 2023-09-29T23:23:42.716 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-29T23:23:42.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.828+0000 7f901279f700 1 Processor -- start 2023-09-29T23:23:42.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.828+0000 7f901279f700 1 -- start start 2023-09-29T23:23:42.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.829+0000 7f901279f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f900c09ec80 0x7f900c12f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:42.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.829+0000 7f901279f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f900c0952c0 con 0x7f900c12f9e0 2023-09-29T23:23:42.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.829+0000 7f901279f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f900c09f050 con 0x7f900c09ec80 2023-09-29T23:23:42.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.829+0000 7f901179d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f900c09ec80 0x7f900c12f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:42.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.829+0000 7f9010f9c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f900c12f9e0 0x7f900c09b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43668/0 (socket says 172.21.15.92:43668) 2023-09-29T23:23:42.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.829+0000 7f9010f9c700 1 -- 172.21.15.92:0/2728543095 learned_addr learned my addr 172.21.15.92:0/2728543095 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:42.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.829+0000 7f9003fff700 1 -- 172.21.15.92:0/2728543095 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641739857 0 0) 0x7f900c0952c0 con 0x7f900c12f9e0 2023-09-29T23:23:42.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.829+0000 7f9003fff700 1 -- 172.21.15.92:0/2728543095 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ff8003570 con 0x7f900c12f9e0 2023-09-29T23:23:42.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.829+0000 7f901179d700 1 -- 172.21.15.92:0/2728543095 >> v1:172.21.15.92:6789/0 conn(0x7f900c12f9e0 legacy=0x7f900c09b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:42.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.829+0000 7f901179d700 1 -- 172.21.15.92:0/2728543095 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c09f360 con 0x7f900c09ec80 2023-09-29T23:23:42.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.829+0000 7f901179d700 1 --2- 172.21.15.92:0/2728543095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f900c09ec80 0x7f900c12f4a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9008009860 tx=0x7f90080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f77ba4b5d13be8 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:42.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.829+0000 7f9003fff700 1 -- 172.21.15.92:0/2728543095 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9008011630 con 0x7f900c09ec80 2023-09-29T23:23:42.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.829+0000 7f9003fff700 1 -- 172.21.15.92:0/2728543095 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9008011790 con 0x7f900c09ec80 2023-09-29T23:23:42.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.829+0000 7f9003fff700 1 -- 172.21.15.92:0/2728543095 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9008011a60 con 0x7f900c09ec80 2023-09-29T23:23:42.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.830+0000 7f901279f700 1 -- 172.21.15.92:0/2728543095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f900c09ec80 msgr2=0x7f900c12f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:42.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.830+0000 7f901279f700 1 --2- 172.21.15.92:0/2728543095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f900c09ec80 0x7f900c12f4a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9008009860 tx=0x7f90080091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:42.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.830+0000 7f901279f700 1 -- 172.21.15.92:0/2728543095 shutdown_connections 2023-09-29T23:23:42.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.830+0000 7f901279f700 1 --2- 172.21.15.92:0/2728543095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f900c09ec80 0x7f900c12f4a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:42.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.830+0000 7f901279f700 1 -- 172.21.15.92:0/2728543095 >> 172.21.15.92:0/2728543095 conn(0x7f900c067c80 msgr2=0x7f900c09e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:42.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.830+0000 7f901279f700 1 -- 172.21.15.92:0/2728543095 shutdown_connections 2023-09-29T23:23:42.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.830+0000 7f901279f700 1 -- 172.21.15.92:0/2728543095 wait complete. 2023-09-29T23:23:42.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.831+0000 7f901279f700 1 Processor -- start 2023-09-29T23:23:42.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.831+0000 7f901279f700 1 -- start start 2023-09-29T23:23:42.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.831+0000 7f901279f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f900c09ec80 0x7f900c12bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:42.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.831+0000 7f901279f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c11e9d0 con 0x7f900c09ec80 2023-09-29T23:23:42.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.831+0000 7f901179d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f900c09ec80 0x7f900c12bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:42.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.831+0000 7f901179d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f900c09ec80 0x7f900c12bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36814/0 (socket says 172.21.15.92:36814) 2023-09-29T23:23:42.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.831+0000 7f901179d700 1 -- 172.21.15.92:0/2429385769 learned_addr learned my addr 172.21.15.92:0/2429385769 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:42.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.832+0000 7f901179d700 1 -- 172.21.15.92:0/2429385769 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9008009420 con 0x7f900c09ec80 2023-09-29T23:23:42.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.832+0000 7f901179d700 1 --2- 172.21.15.92:0/2429385769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f900c09ec80 0x7f900c12bed0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9008000c00 tx=0x7f9008016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:42.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.832+0000 7f90017fa700 1 -- 172.21.15.92:0/2429385769 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9008011a80 con 0x7f900c09ec80 2023-09-29T23:23:42.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.832+0000 7f90017fa700 1 -- 172.21.15.92:0/2429385769 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900801f070 con 0x7f900c09ec80 2023-09-29T23:23:42.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.832+0000 7f901279f700 1 -- 172.21.15.92:0/2429385769 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900c11e6c0 con 0x7f900c09ec80 2023-09-29T23:23:42.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.832+0000 7f90017fa700 1 -- 172.21.15.92:0/2429385769 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9008011e60 con 0x7f900c09ec80 2023-09-29T23:23:42.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.832+0000 7f901279f700 1 -- 172.21.15.92:0/2429385769 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900c11ddc0 con 0x7f900c09ec80 2023-09-29T23:23:42.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.833+0000 7f90017fa700 1 -- 172.21.15.92:0/2429385769 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f9008026480 con 0x7f900c09ec80 2023-09-29T23:23:42.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.833+0000 7f901279f700 1 -- 172.21.15.92:0/2429385769 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900c05f230 con 0x7f900c09ec80 2023-09-29T23:23:42.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.833+0000 7f90017fa700 1 --2- 172.21.15.92:0/2429385769 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8ff0035640 0x7f8ff0037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:42.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.833+0000 7f90017fa700 1 -- 172.21.15.92:0/2429385769 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2550+0+0 (secure 0 0 0) 0x7f9008021070 con 0x7f900c09ec80 2023-09-29T23:23:42.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.833+0000 7f9010f9c700 1 --2- 172.21.15.92:0/2429385769 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8ff0035640 0x7f8ff0037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:42.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.833+0000 7f9010f9c700 1 --2- 172.21.15.92:0/2429385769 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8ff0035640 0x7f8ff0037af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0058d0 tx=0x7f8ffc0079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:42.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:42.838+0000 7f90017fa700 1 -- 172.21.15.92:0/2429385769 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f900804ae60 con 0x7f900c09ec80 2023-09-29T23:23:43.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.021+0000 7f901279f700 1 -- 172.21.15.92:0/2429385769 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f900c04bb40 con 0x7f900c09ec80 2023-09-29T23:23:43.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.022+0000 7f90017fa700 1 -- 172.21.15.92:0/2429385769 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v13) v1 ==== 84+0+64 (secure 0 0 0) 0x7f9008034050 con 0x7f900c09ec80 2023-09-29T23:23:43.023 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:43.023 INFO:teuthology.orchestra.run.smithi092.stdout:[ 2023-09-29T23:23:43.023 INFO:teuthology.orchestra.run.smithi092.stdout: { 2023-09-29T23:23:43.024 INFO:teuthology.orchestra.run.smithi092.stdout: "poolnum": 1, 2023-09-29T23:23:43.024 INFO:teuthology.orchestra.run.smithi092.stdout: "poolname": "rbd" 2023-09-29T23:23:43.024 INFO:teuthology.orchestra.run.smithi092.stdout: } 2023-09-29T23:23:43.024 INFO:teuthology.orchestra.run.smithi092.stdout:] 2023-09-29T23:23:43.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.024+0000 7f901279f700 1 -- 172.21.15.92:0/2429385769 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8ff0035640 msgr2=0x7f8ff0037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:43.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.024+0000 7f901279f700 1 --2- 172.21.15.92:0/2429385769 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8ff0035640 0x7f8ff0037af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0058d0 tx=0x7f8ffc0079d0 comp rx=0 tx=0).stop 2023-09-29T23:23:43.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.024+0000 7f901279f700 1 -- 172.21.15.92:0/2429385769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f900c09ec80 msgr2=0x7f900c12bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:43.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.024+0000 7f901279f700 1 --2- 172.21.15.92:0/2429385769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f900c09ec80 0x7f900c12bed0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9008000c00 tx=0x7f9008016000 comp rx=0 tx=0).stop 2023-09-29T23:23:43.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.024+0000 7f901279f700 1 -- 172.21.15.92:0/2429385769 shutdown_connections 2023-09-29T23:23:43.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.024+0000 7f901279f700 1 --2- 172.21.15.92:0/2429385769 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8ff0035640 0x7f8ff0037af0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:43.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.024+0000 7f901279f700 1 --2- 172.21.15.92:0/2429385769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f900c09ec80 0x7f900c12bed0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:43.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.024+0000 7f901279f700 1 -- 172.21.15.92:0/2429385769 >> 172.21.15.92:0/2429385769 conn(0x7f900c067c80 msgr2=0x7f900c12cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:43.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.024+0000 7f901279f700 1 -- 172.21.15.92:0/2429385769 shutdown_connections 2023-09-29T23:23:43.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.024+0000 7f901279f700 1 -- 172.21.15.92:0/2429385769 wait complete. 2023-09-29T23:23:43.037 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-29T23:23:43.037 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-29T23:23:43.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.152+0000 7f6cd73a5700 1 Processor -- start 2023-09-29T23:23:43.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.152+0000 7f6cd73a5700 1 -- start start 2023-09-29T23:23:43.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.153+0000 7f6cd73a5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6cd006a040 0x7f6cd0134560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:43.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.153+0000 7f6cd73a5700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd00a1580 con 0x7f6cd006f210 2023-09-29T23:23:43.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.153+0000 7f6cd73a5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd006f5e0 con 0x7f6cd006a040 2023-09-29T23:23:43.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.153+0000 7f6cd4940700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6cd006a040 0x7f6cd0134560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:43.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.153+0000 7f6cd5141700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f6cd006f210 0x7f6cd0069930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43670/0 (socket says 172.21.15.92:43670) 2023-09-29T23:23:43.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.153+0000 7f6cd5141700 1 -- 172.21.15.92:0/1006002098 learned_addr learned my addr 172.21.15.92:0/1006002098 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:43.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.153+0000 7f6cd4940700 1 -- 172.21.15.92:0/1006002098 >> v1:172.21.15.92:6789/0 conn(0x7f6cd006f210 legacy=0x7f6cd0069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:43.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.153+0000 7f6cd4940700 1 -- 172.21.15.92:0/1006002098 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd009bdd0 con 0x7f6cd006a040 2023-09-29T23:23:43.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.153+0000 7f6ccffff700 1 -- 172.21.15.92:0/1006002098 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304916031 0 0) 0x7f6cd00a1580 con 0x7f6cd006f210 2023-09-29T23:23:43.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.153+0000 7f6cd4940700 1 --2- 172.21.15.92:0/1006002098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd006a040 0x7f6cd0134560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009860 tx=0x7f6cc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0ebd20f30dee4a server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:43.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.153+0000 7f6ccffff700 1 -- 172.21.15.92:0/1006002098 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6cc400b680 con 0x7f6cd006a040 2023-09-29T23:23:43.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.153+0000 7f6ccffff700 1 -- 172.21.15.92:0/1006002098 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc400b7e0 con 0x7f6cd006a040 2023-09-29T23:23:43.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.153+0000 7f6ccffff700 1 -- 172.21.15.92:0/1006002098 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6cc400bad0 con 0x7f6cd006a040 2023-09-29T23:23:43.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.154+0000 7f6cd73a5700 1 -- 172.21.15.92:0/1006002098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd006a040 msgr2=0x7f6cd0134560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:43.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.154+0000 7f6cd73a5700 1 --2- 172.21.15.92:0/1006002098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd006a040 0x7f6cd0134560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009860 tx=0x7f6cc40091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:43.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.154+0000 7f6cd73a5700 1 -- 172.21.15.92:0/1006002098 shutdown_connections 2023-09-29T23:23:43.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.154+0000 7f6cd73a5700 1 --2- 172.21.15.92:0/1006002098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd006a040 0x7f6cd0134560 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:43.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.154+0000 7f6cd73a5700 1 -- 172.21.15.92:0/1006002098 >> 172.21.15.92:0/1006002098 conn(0x7f6cd0094a70 msgr2=0x7f6cd006eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:43.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.154+0000 7f6cd73a5700 1 -- 172.21.15.92:0/1006002098 shutdown_connections 2023-09-29T23:23:43.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.154+0000 7f6cd73a5700 1 -- 172.21.15.92:0/1006002098 wait complete. 2023-09-29T23:23:43.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.155+0000 7f6cd73a5700 1 Processor -- start 2023-09-29T23:23:43.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.155+0000 7f6cd73a5700 1 -- start start 2023-09-29T23:23:43.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.155+0000 7f6cd73a5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd006a040 0x7f6cd011aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:43.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.155+0000 7f6cd73a5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd012ca70 con 0x7f6cd006a040 2023-09-29T23:23:43.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.155+0000 7f6cd5141700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd006a040 0x7f6cd011aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:43.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.156+0000 7f6cd5141700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd006a040 0x7f6cd011aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36846/0 (socket says 172.21.15.92:36846) 2023-09-29T23:23:43.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.156+0000 7f6cd5141700 1 -- 172.21.15.92:0/1883254584 learned_addr learned my addr 172.21.15.92:0/1883254584 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:43.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.156+0000 7f6cd5141700 1 -- 172.21.15.92:0/1883254584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc4009420 con 0x7f6cd006a040 2023-09-29T23:23:43.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.156+0000 7f6cd5141700 1 --2- 172.21.15.92:0/1883254584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd006a040 0x7f6cd011aaf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000cc80 tx=0x7f6cc0001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:43.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.156+0000 7f6ccd7fa700 1 -- 172.21.15.92:0/1883254584 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6cc000ce30 con 0x7f6cd006a040 2023-09-29T23:23:43.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.156+0000 7f6ccd7fa700 1 -- 172.21.15.92:0/1883254584 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc000ab70 con 0x7f6cd006a040 2023-09-29T23:23:43.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.156+0000 7f6cd73a5700 1 -- 172.21.15.92:0/1883254584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd0119430 con 0x7f6cd006a040 2023-09-29T23:23:43.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.156+0000 7f6ccd7fa700 1 -- 172.21.15.92:0/1883254584 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6cc000ae60 con 0x7f6cd006a040 2023-09-29T23:23:43.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.156+0000 7f6cd73a5700 1 -- 172.21.15.92:0/1883254584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd0133780 con 0x7f6cd006a040 2023-09-29T23:23:43.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.157+0000 7f6ccd7fa700 1 -- 172.21.15.92:0/1883254584 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f6cc00070f0 con 0x7f6cd006a040 2023-09-29T23:23:43.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.157+0000 7f6cd73a5700 1 -- 172.21.15.92:0/1883254584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd005f230 con 0x7f6cd006a040 2023-09-29T23:23:43.160 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.157+0000 7f6ccd7fa700 1 --2- 172.21.15.92:0/1883254584 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6cbc0355e0 0x7f6cbc037a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:43.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.157+0000 7f6ccd7fa700 1 -- 172.21.15.92:0/1883254584 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2550+0+0 (secure 0 0 0) 0x7f6cc0047630 con 0x7f6cd006a040 2023-09-29T23:23:43.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.157+0000 7f6cd4940700 1 --2- 172.21.15.92:0/1883254584 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6cbc0355e0 0x7f6cbc037a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:43.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.157+0000 7f6cd4940700 1 --2- 172.21.15.92:0/1883254584 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6cbc0355e0 0x7f6cbc037a90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4006eb0 tx=0x7f6cc4016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:43.163 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.163+0000 7f6ccd7fa700 1 -- 172.21.15.92:0/1883254584 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cc00108f0 con 0x7f6cd006a040 2023-09-29T23:23:43.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:43.345+0000 7f6cd73a5700 1 -- 172.21.15.92:0/1883254584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6cd00a0fc0 con 0x7f6cd006a040 2023-09-29T23:23:44.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.056+0000 7f6ccd7fa700 1 -- 172.21.15.92:0/1883254584 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v14) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6cc0010300 con 0x7f6cd006a040 2023-09-29T23:23:44.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.059+0000 7f6cd73a5700 1 -- 172.21.15.92:0/1883254584 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6cbc0355e0 msgr2=0x7f6cbc037a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:44.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.059+0000 7f6cd73a5700 1 --2- 172.21.15.92:0/1883254584 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6cbc0355e0 0x7f6cbc037a90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4006eb0 tx=0x7f6cc4016000 comp rx=0 tx=0).stop 2023-09-29T23:23:44.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.059+0000 7f6cd73a5700 1 -- 172.21.15.92:0/1883254584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd006a040 msgr2=0x7f6cd011aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:44.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.059+0000 7f6cd73a5700 1 --2- 172.21.15.92:0/1883254584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd006a040 0x7f6cd011aaf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000cc80 tx=0x7f6cc0001aa0 comp rx=0 tx=0).stop 2023-09-29T23:23:44.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.059+0000 7f6cd73a5700 1 -- 172.21.15.92:0/1883254584 shutdown_connections 2023-09-29T23:23:44.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.059+0000 7f6cd73a5700 1 --2- 172.21.15.92:0/1883254584 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6cbc0355e0 0x7f6cbc037a90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:44.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.059+0000 7f6cd73a5700 1 --2- 172.21.15.92:0/1883254584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cd006a040 0x7f6cd011aaf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:44.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.059+0000 7f6cd73a5700 1 -- 172.21.15.92:0/1883254584 >> 172.21.15.92:0/1883254584 conn(0x7f6cd0094a70 msgr2=0x7f6cd0132340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:44.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.060+0000 7f6cd73a5700 1 -- 172.21.15.92:0/1883254584 shutdown_connections 2023-09-29T23:23:44.061 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.061+0000 7f6cd73a5700 1 -- 172.21.15.92:0/1883254584 wait complete. 2023-09-29T23:23:44.062 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_metadata' created 2023-09-29T23:23:44.076 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-29T23:23:44.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.198+0000 7f3f9a7c0700 1 Processor -- start 2023-09-29T23:23:44.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.198+0000 7f3f9a7c0700 1 -- start start 2023-09-29T23:23:44.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.199+0000 7f3f9a7c0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3f940a0fd0 0x7f3f94097ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:44.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.199+0000 7f3f9a7c0700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f94098410 con 0x7f3f9406f210 2023-09-29T23:23:44.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.199+0000 7f3f9a7c0700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9406f5e0 con 0x7f3f940a0fd0 2023-09-29T23:23:44.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.199+0000 7f3f937fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3f940a0fd0 0x7f3f94097ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:44.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.199+0000 7f3f93fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f3f9406f210 0x7f3f940977c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43674/0 (socket says 172.21.15.92:43674) 2023-09-29T23:23:44.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.199+0000 7f3f93fff700 1 -- 172.21.15.92:0/1368307374 learned_addr learned my addr 172.21.15.92:0/1368307374 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:44.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.199+0000 7f3f937fe700 1 -- 172.21.15.92:0/1368307374 >> v1:172.21.15.92:6789/0 conn(0x7f3f9406f210 legacy=0x7f3f940977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:44.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.199+0000 7f3f937fe700 1 -- 172.21.15.92:0/1368307374 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f940974b0 con 0x7f3f940a0fd0 2023-09-29T23:23:44.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.199+0000 7f3f92ffd700 1 -- 172.21.15.92:0/1368307374 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583061602 0 0) 0x7f3f94098410 con 0x7f3f9406f210 2023-09-29T23:23:44.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.199+0000 7f3f937fe700 1 --2- 172.21.15.92:0/1368307374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f940a0fd0 0x7f3f94097ed0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f88009860 tx=0x7f3f880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7de8ab3476cd0b server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:44.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.199+0000 7f3f92ffd700 1 -- 172.21.15.92:0/1368307374 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3f8800b680 con 0x7f3f940a0fd0 2023-09-29T23:23:44.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.199+0000 7f3f92ffd700 1 -- 172.21.15.92:0/1368307374 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8800b7e0 con 0x7f3f940a0fd0 2023-09-29T23:23:44.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.199+0000 7f3f92ffd700 1 -- 172.21.15.92:0/1368307374 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3f8800bad0 con 0x7f3f940a0fd0 2023-09-29T23:23:44.203 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.200+0000 7f3f9a7c0700 1 -- 172.21.15.92:0/1368307374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f940a0fd0 msgr2=0x7f3f94097ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:44.203 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.200+0000 7f3f9a7c0700 1 --2- 172.21.15.92:0/1368307374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f940a0fd0 0x7f3f94097ed0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f88009860 tx=0x7f3f880091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:44.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.200+0000 7f3f9a7c0700 1 -- 172.21.15.92:0/1368307374 shutdown_connections 2023-09-29T23:23:44.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.200+0000 7f3f9a7c0700 1 --2- 172.21.15.92:0/1368307374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f940a0fd0 0x7f3f94097ed0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:44.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.200+0000 7f3f9a7c0700 1 -- 172.21.15.92:0/1368307374 >> 172.21.15.92:0/1368307374 conn(0x7f3f94094a70 msgr2=0x7f3f9406eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:44.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.200+0000 7f3f9a7c0700 1 -- 172.21.15.92:0/1368307374 shutdown_connections 2023-09-29T23:23:44.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.200+0000 7f3f9a7c0700 1 -- 172.21.15.92:0/1368307374 wait complete. 2023-09-29T23:23:44.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.201+0000 7f3f9a7c0700 1 Processor -- start 2023-09-29T23:23:44.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.201+0000 7f3f9a7c0700 1 -- start start 2023-09-29T23:23:44.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.201+0000 7f3f9a7c0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f9406f210 0x7f3f9411e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:44.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.201+0000 7f3f9a7c0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9411d970 con 0x7f3f9406f210 2023-09-29T23:23:44.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.201+0000 7f3f93fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f9406f210 0x7f3f9411e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:44.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.201+0000 7f3f93fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f9406f210 0x7f3f9411e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36862/0 (socket says 172.21.15.92:36862) 2023-09-29T23:23:44.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.201+0000 7f3f93fff700 1 -- 172.21.15.92:0/3467402952 learned_addr learned my addr 172.21.15.92:0/3467402952 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:44.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.202+0000 7f3f93fff700 1 -- 172.21.15.92:0/3467402952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f88009420 con 0x7f3f9406f210 2023-09-29T23:23:44.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.202+0000 7f3f93fff700 1 --2- 172.21.15.92:0/3467402952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f9406f210 0x7f3f9411e130 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400c710 tx=0x7f3f84007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:44.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.202+0000 7f3f7bfff700 1 -- 172.21.15.92:0/3467402952 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3f84005c50 con 0x7f3f9406f210 2023-09-29T23:23:44.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.202+0000 7f3f7bfff700 1 -- 172.21.15.92:0/3467402952 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f84005db0 con 0x7f3f9406f210 2023-09-29T23:23:44.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.202+0000 7f3f9a7c0700 1 -- 172.21.15.92:0/3467402952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f94069ce0 con 0x7f3f9406f210 2023-09-29T23:23:44.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.202+0000 7f3f7bfff700 1 -- 172.21.15.92:0/3467402952 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3f84007230 con 0x7f3f9406f210 2023-09-29T23:23:44.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.202+0000 7f3f9a7c0700 1 -- 172.21.15.92:0/3467402952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9406b110 con 0x7f3f9406f210 2023-09-29T23:23:44.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.203+0000 7f3f7bfff700 1 -- 172.21.15.92:0/3467402952 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f3f84007390 con 0x7f3f9406f210 2023-09-29T23:23:44.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.203+0000 7f3f7bfff700 1 --2- 172.21.15.92:0/3467402952 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3f80035640 0x7f3f80037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:44.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.203+0000 7f3f9a7c0700 1 -- 172.21.15.92:0/3467402952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9405f230 con 0x7f3f9406f210 2023-09-29T23:23:44.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.203+0000 7f3f7bfff700 1 -- 172.21.15.92:0/3467402952 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2920+0+0 (secure 0 0 0) 0x7f3f840467c0 con 0x7f3f9406f210 2023-09-29T23:23:44.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.203+0000 7f3f937fe700 1 --2- 172.21.15.92:0/3467402952 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3f80035640 0x7f3f80037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:44.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.203+0000 7f3f937fe700 1 --2- 172.21.15.92:0/3467402952 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3f80035640 0x7f3f80037af0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3f940a1410 tx=0x7f3f88016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:44.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.208+0000 7f3f7bfff700 1 -- 172.21.15.92:0/3467402952 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f84017020 con 0x7f3f9406f210 2023-09-29T23:23:44.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:44.388+0000 7f3f9a7c0700 1 -- 172.21.15.92:0/3467402952 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3f9409aa20 con 0x7f3f9406f210 2023-09-29T23:23:45.058 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.058+0000 7f3f7bfff700 1 -- 172.21.15.92:0/3467402952 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v15) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3f840430d0 con 0x7f3f9406f210 2023-09-29T23:23:45.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.061+0000 7f3f9a7c0700 1 -- 172.21.15.92:0/3467402952 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3f80035640 msgr2=0x7f3f80037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:45.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.061+0000 7f3f9a7c0700 1 --2- 172.21.15.92:0/3467402952 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3f80035640 0x7f3f80037af0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3f940a1410 tx=0x7f3f88016000 comp rx=0 tx=0).stop 2023-09-29T23:23:45.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.062+0000 7f3f9a7c0700 1 -- 172.21.15.92:0/3467402952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f9406f210 msgr2=0x7f3f9411e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:45.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.062+0000 7f3f9a7c0700 1 --2- 172.21.15.92:0/3467402952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f9406f210 0x7f3f9411e130 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400c710 tx=0x7f3f84007d90 comp rx=0 tx=0).stop 2023-09-29T23:23:45.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.062+0000 7f3f9a7c0700 1 -- 172.21.15.92:0/3467402952 shutdown_connections 2023-09-29T23:23:45.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.062+0000 7f3f9a7c0700 1 --2- 172.21.15.92:0/3467402952 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3f80035640 0x7f3f80037af0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:45.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.062+0000 7f3f9a7c0700 1 --2- 172.21.15.92:0/3467402952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f9406f210 0x7f3f9411e130 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:45.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.062+0000 7f3f9a7c0700 1 -- 172.21.15.92:0/3467402952 >> 172.21.15.92:0/3467402952 conn(0x7f3f94094a70 msgr2=0x7f3f9412c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:45.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.062+0000 7f3f9a7c0700 1 -- 172.21.15.92:0/3467402952 shutdown_connections 2023-09-29T23:23:45.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.062+0000 7f3f9a7c0700 1 -- 172.21.15.92:0/3467402952 wait complete. 2023-09-29T23:23:45.063 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data' created 2023-09-29T23:23:45.087 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-29T23:23:45.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.205+0000 7fcb24855700 1 Processor -- start 2023-09-29T23:23:45.205 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.205+0000 7fcb24855700 1 -- start start 2023-09-29T23:23:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.205+0000 7fcb24855700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcb2009fd80 0x7fcb200a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.205+0000 7fcb24855700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb20098710 con 0x7fcb2012f8b0 2023-09-29T23:23:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.205+0000 7fcb24855700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb2012f340 con 0x7fcb2009fd80 2023-09-29T23:23:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.205+0000 7fcb1e59c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcb2009fd80 0x7fcb200a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.205+0000 7fcb1dd9b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fcb2012f8b0 0x7fcb20095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43690/0 (socket says 172.21.15.92:43690) 2023-09-29T23:23:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.205+0000 7fcb1dd9b700 1 -- 172.21.15.92:0/505915728 learned_addr learned my addr 172.21.15.92:0/505915728 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.206+0000 7fcb1e59c700 1 -- 172.21.15.92:0/505915728 >> v1:172.21.15.92:6789/0 conn(0x7fcb2012f8b0 legacy=0x7fcb20095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.206+0000 7fcb1e59c700 1 -- 172.21.15.92:0/505915728 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb200997e0 con 0x7fcb2009fd80 2023-09-29T23:23:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.206+0000 7fcb1d59a700 1 -- 172.21.15.92:0/505915728 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634992043 0 0) 0x7fcb20098710 con 0x7fcb2012f8b0 2023-09-29T23:23:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.206+0000 7fcb1e59c700 1 --2- 172.21.15.92:0/505915728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb2009fd80 0x7fcb200a3090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009de0 tx=0x7fcb10009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe720133e3b0b94 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:45.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.206+0000 7fcb1d59a700 1 -- 172.21.15.92:0/505915728 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb1000e070 con 0x7fcb2009fd80 2023-09-29T23:23:45.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.206+0000 7fcb1d59a700 1 -- 172.21.15.92:0/505915728 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1000bc80 con 0x7fcb2009fd80 2023-09-29T23:23:45.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.206+0000 7fcb1d59a700 1 -- 172.21.15.92:0/505915728 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb10012430 con 0x7fcb2009fd80 2023-09-29T23:23:45.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.206+0000 7fcb24855700 1 -- 172.21.15.92:0/505915728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb2009fd80 msgr2=0x7fcb200a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:45.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.206+0000 7fcb24855700 1 --2- 172.21.15.92:0/505915728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb2009fd80 0x7fcb200a3090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009de0 tx=0x7fcb10009780 comp rx=0 tx=0).stop 2023-09-29T23:23:45.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.206+0000 7fcb24855700 1 -- 172.21.15.92:0/505915728 shutdown_connections 2023-09-29T23:23:45.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.206+0000 7fcb24855700 1 --2- 172.21.15.92:0/505915728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb2009fd80 0x7fcb200a3090 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:45.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.206+0000 7fcb24855700 1 -- 172.21.15.92:0/505915728 >> 172.21.15.92:0/505915728 conn(0x7fcb20068000 msgr2=0x7fcb200a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:45.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.206+0000 7fcb24855700 1 -- 172.21.15.92:0/505915728 shutdown_connections 2023-09-29T23:23:45.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.207+0000 7fcb24855700 1 -- 172.21.15.92:0/505915728 wait complete. 2023-09-29T23:23:45.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.207+0000 7fcb24855700 1 Processor -- start 2023-09-29T23:23:45.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.207+0000 7fcb24855700 1 -- start start 2023-09-29T23:23:45.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.208+0000 7fcb24855700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb2009fd80 0x7fcb2013e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:45.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.208+0000 7fcb24855700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2011e2c0 con 0x7fcb2009fd80 2023-09-29T23:23:45.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.208+0000 7fcb1e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb2009fd80 0x7fcb2013e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:45.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.208+0000 7fcb1e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb2009fd80 0x7fcb2013e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36874/0 (socket says 172.21.15.92:36874) 2023-09-29T23:23:45.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.208+0000 7fcb1e59c700 1 -- 172.21.15.92:0/1512670214 learned_addr learned my addr 172.21.15.92:0/1512670214 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:45.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.208+0000 7fcb1e59c700 1 -- 172.21.15.92:0/1512670214 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb10009a20 con 0x7fcb2009fd80 2023-09-29T23:23:45.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.208+0000 7fcb1e59c700 1 --2- 172.21.15.92:0/1512670214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb2009fd80 0x7fcb2013e520 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcb100097c0 tx=0x7fcb10018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:45.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.208+0000 7fcb167fc700 1 -- 172.21.15.92:0/1512670214 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb100275b0 con 0x7fcb2009fd80 2023-09-29T23:23:45.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.208+0000 7fcb167fc700 1 -- 172.21.15.92:0/1512670214 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb10027710 con 0x7fcb2009fd80 2023-09-29T23:23:45.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.208+0000 7fcb24855700 1 -- 172.21.15.92:0/1512670214 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2011c590 con 0x7fcb2009fd80 2023-09-29T23:23:45.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.208+0000 7fcb167fc700 1 -- 172.21.15.92:0/1512670214 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb10027a00 con 0x7fcb2009fd80 2023-09-29T23:23:45.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.208+0000 7fcb24855700 1 -- 172.21.15.92:0/1512670214 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2011d1c0 con 0x7fcb2009fd80 2023-09-29T23:23:45.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.209+0000 7fcb167fc700 1 -- 172.21.15.92:0/1512670214 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fcb10024070 con 0x7fcb2009fd80 2023-09-29T23:23:45.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.209+0000 7fcb24855700 1 -- 172.21.15.92:0/1512670214 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2011e410 con 0x7fcb2009fd80 2023-09-29T23:23:45.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.209+0000 7fcb167fc700 1 --2- 172.21.15.92:0/1512670214 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fcb00035640 0x7fcb00037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:45.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.209+0000 7fcb167fc700 1 -- 172.21.15.92:0/1512670214 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3302+0+0 (secure 0 0 0) 0x7fcb1004a160 con 0x7fcb2009fd80 2023-09-29T23:23:45.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.209+0000 7fcb1dd9b700 1 --2- 172.21.15.92:0/1512670214 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fcb00035640 0x7fcb00037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:45.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.210+0000 7fcb1dd9b700 1 --2- 172.21.15.92:0/1512670214 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fcb00035640 0x7fcb00037af0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcb080011e0 tx=0x7fcb080079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:45.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.214+0000 7fcb167fc700 1 -- 172.21.15.92:0/1512670214 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb1001cd80 con 0x7fcb2009fd80 2023-09-29T23:23:45.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.439+0000 7fcb24855700 1 -- 172.21.15.92:0/1512670214 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcb2005f230 con 0x7fcb2009fd80 2023-09-29T23:23:45.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.444+0000 7fcb167fc700 1 -- 172.21.15.92:0/1512670214 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v3) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcb1001cba0 con 0x7fcb2009fd80 2023-09-29T23:23:45.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.450+0000 7fcb24855700 1 -- 172.21.15.92:0/1512670214 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fcb00035640 msgr2=0x7fcb00037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:45.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.450+0000 7fcb24855700 1 --2- 172.21.15.92:0/1512670214 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fcb00035640 0x7fcb00037af0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcb080011e0 tx=0x7fcb080079d0 comp rx=0 tx=0).stop 2023-09-29T23:23:45.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.450+0000 7fcb24855700 1 -- 172.21.15.92:0/1512670214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb2009fd80 msgr2=0x7fcb2013e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:45.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.450+0000 7fcb24855700 1 --2- 172.21.15.92:0/1512670214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb2009fd80 0x7fcb2013e520 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcb100097c0 tx=0x7fcb10018000 comp rx=0 tx=0).stop 2023-09-29T23:23:45.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.450+0000 7fcb24855700 1 -- 172.21.15.92:0/1512670214 shutdown_connections 2023-09-29T23:23:45.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.450+0000 7fcb24855700 1 --2- 172.21.15.92:0/1512670214 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fcb00035640 0x7fcb00037af0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcb080011e0 tx=0x7fcb080079d0 comp rx=0 tx=0).stop 2023-09-29T23:23:45.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.451+0000 7fcb24855700 1 --2- 172.21.15.92:0/1512670214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb2009fd80 0x7fcb2013e520 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:45.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.451+0000 7fcb24855700 1 -- 172.21.15.92:0/1512670214 >> 172.21.15.92:0/1512670214 conn(0x7fcb20068000 msgr2=0x7fcb20094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:45.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.451+0000 7fcb24855700 1 -- 172.21.15.92:0/1512670214 shutdown_connections 2023-09-29T23:23:45.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.451+0000 7fcb24855700 1 -- 172.21.15.92:0/1512670214 wait complete. 2023-09-29T23:23:45.455 INFO:teuthology.orchestra.run.smithi092.stderr:new fs with metadata pool 2 and data pool 3 2023-09-29T23:23:45.473 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:23:45.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.587+0000 7f37904f5700 1 Processor -- start 2023-09-29T23:23:45.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.588+0000 7f37904f5700 1 -- start start 2023-09-29T23:23:45.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.588+0000 7f37904f5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f378812ffc0 0x7f37880a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:45.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.588+0000 7f37904f5700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3788098710 con 0x7f378809fd80 2023-09-29T23:23:45.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.588+0000 7f37904f5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378812f340 con 0x7f378812ffc0 2023-09-29T23:23:45.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.588+0000 7f378da90700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f378812ffc0 0x7f37880a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:45.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.588+0000 7f378e291700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f378809fd80 0x7f378812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43706/0 (socket says 172.21.15.92:43706) 2023-09-29T23:23:45.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.588+0000 7f378e291700 1 -- 172.21.15.92:0/1999625705 learned_addr learned my addr 172.21.15.92:0/1999625705 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:45.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.588+0000 7f378da90700 1 -- 172.21.15.92:0/1999625705 >> v1:172.21.15.92:6789/0 conn(0x7f378809fd80 legacy=0x7f378812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:45.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.589+0000 7f378da90700 1 -- 172.21.15.92:0/1999625705 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37880997e0 con 0x7f378812ffc0 2023-09-29T23:23:45.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.589+0000 7f378da90700 1 --2- 172.21.15.92:0/1999625705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f378812ffc0 0x7f37880a3090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3778009860 tx=0x7f37780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a6bd9e1d3e0901 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:45.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.589+0000 7f378d28f700 1 -- 172.21.15.92:0/1999625705 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f377800b680 con 0x7f378812ffc0 2023-09-29T23:23:45.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.589+0000 7f378d28f700 1 -- 172.21.15.92:0/1999625705 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377800b7e0 con 0x7f378812ffc0 2023-09-29T23:23:45.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.589+0000 7f378d28f700 1 -- 172.21.15.92:0/1999625705 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f377800b990 con 0x7f378812ffc0 2023-09-29T23:23:45.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.589+0000 7f37904f5700 1 -- 172.21.15.92:0/1999625705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f378812ffc0 msgr2=0x7f37880a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:45.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.589+0000 7f37904f5700 1 --2- 172.21.15.92:0/1999625705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f378812ffc0 0x7f37880a3090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3778009860 tx=0x7f37780091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:45.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.589+0000 7f37904f5700 1 -- 172.21.15.92:0/1999625705 shutdown_connections 2023-09-29T23:23:45.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.589+0000 7f37904f5700 1 --2- 172.21.15.92:0/1999625705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f378812ffc0 0x7f37880a3090 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:45.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.589+0000 7f37904f5700 1 -- 172.21.15.92:0/1999625705 >> 172.21.15.92:0/1999625705 conn(0x7f3788068000 msgr2=0x7f37880a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:45.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.589+0000 7f37904f5700 1 -- 172.21.15.92:0/1999625705 shutdown_connections 2023-09-29T23:23:45.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.589+0000 7f37904f5700 1 -- 172.21.15.92:0/1999625705 wait complete. 2023-09-29T23:23:45.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.590+0000 7f37904f5700 1 Processor -- start 2023-09-29T23:23:45.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.590+0000 7f37904f5700 1 -- start start 2023-09-29T23:23:45.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.591+0000 7f37904f5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f378809fd80 0x7f378811def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:45.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.591+0000 7f37904f5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378811cb30 con 0x7f378809fd80 2023-09-29T23:23:45.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.591+0000 7f378e291700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f378809fd80 0x7f378811def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:45.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.591+0000 7f378e291700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f378809fd80 0x7f378811def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36894/0 (socket says 172.21.15.92:36894) 2023-09-29T23:23:45.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.591+0000 7f378e291700 1 -- 172.21.15.92:0/3928133067 learned_addr learned my addr 172.21.15.92:0/3928133067 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:45.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.591+0000 7f378e291700 1 -- 172.21.15.92:0/3928133067 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778009420 con 0x7f378809fd80 2023-09-29T23:23:45.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.591+0000 7f378e291700 1 --2- 172.21.15.92:0/3928133067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f378809fd80 0x7f378811def0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f378400c460 tx=0x7f3784001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:45.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.591+0000 7f377e7fc700 1 -- 172.21.15.92:0/3928133067 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3784005b30 con 0x7f378809fd80 2023-09-29T23:23:45.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.591+0000 7f377e7fc700 1 -- 172.21.15.92:0/3928133067 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3784005c90 con 0x7f378809fd80 2023-09-29T23:23:45.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.591+0000 7f37904f5700 1 -- 172.21.15.92:0/3928133067 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378811da60 con 0x7f378809fd80 2023-09-29T23:23:45.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.591+0000 7f377e7fc700 1 -- 172.21.15.92:0/3928133067 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37840070d0 con 0x7f378809fd80 2023-09-29T23:23:45.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.591+0000 7f37904f5700 1 -- 172.21.15.92:0/3928133067 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378811a750 con 0x7f378809fd80 2023-09-29T23:23:45.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.592+0000 7f377e7fc700 1 -- 172.21.15.92:0/3928133067 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f3784007230 con 0x7f378809fd80 2023-09-29T23:23:45.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.592+0000 7f37904f5700 1 -- 172.21.15.92:0/3928133067 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37880a30e0 con 0x7f378809fd80 2023-09-29T23:23:45.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.592+0000 7f377e7fc700 1 --2- 172.21.15.92:0/3928133067 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f376c035630 0x7f376c037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:45.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.592+0000 7f377e7fc700 1 -- 172.21.15.92:0/3928133067 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f37840467f0 con 0x7f378809fd80 2023-09-29T23:23:45.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.592+0000 7f378da90700 1 --2- 172.21.15.92:0/3928133067 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f376c035630 0x7f376c037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:45.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.592+0000 7f378da90700 1 --2- 172.21.15.92:0/3928133067 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f376c035630 0x7f376c037ae0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3778009860 tx=0x7f3778016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:45.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.597+0000 7f377e7fc700 1 -- 172.21.15.92:0/3928133067 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f378400f850 con 0x7f378809fd80 2023-09-29T23:23:45.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.778+0000 7f37904f5700 1 -- 172.21.15.92:0/3928133067 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37880a1ba0 con 0x7f378809fd80 2023-09-29T23:23:45.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.778+0000 7f377e7fc700 1 -- 172.21.15.92:0/3928133067 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+9461 (secure 0 0 0) 0x7f3784017030 con 0x7f378809fd80 2023-09-29T23:23:45.779 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:45.779 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":16,"fsid":"5b80eae7-9a7e-4dc0-8ff1-cd1f82a1fa33","created":"2023-09-29T23:23:30.308760+0000","modified":"2023-09-29T23:23:45.440887+0000","last_up_change":"2023-09-29T23:23:37.693186+0000","last_in_change":"2023-09-29T23:23:31.538675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-09-29T23:23:39.227674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-29T23:23:43.363869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-29T23:23:44.406215+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea64f859-a36f-4804-810d-2fe7081c9990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":85726},{"type":"v1","addr":"172.21.15.92:6817","nonce":85726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":85726},{"type":"v1","addr":"172.21.15.92:6819","nonce":85726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":85726},{"type":"v1","addr":"172.21.15.92:6823","nonce":85726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":85726},{"type":"v1","addr":"172.21.15.92:6821","nonce":85726}]},"public_addr":"172.21.15.92:6817/85726","cluster_addr":"172.21.15.92:6819/85726","heartbeat_back_addr":"172.21.15.92:6823/85726","heartbeat_front_addr":"172.21.15.92:6821/85726","state":["exists","up"]},{"osd":1,"uuid":"2e9c0837-2887-469f-9dea-db4bde348578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":85705},{"type":"v1","addr":"172.21.15.92:6809","nonce":85705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":85705},{"type":"v1","addr":"172.21.15.92:6811","nonce":85705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":85705},{"type":"v1","addr":"172.21.15.92:6815","nonce":85705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":85705},{"type":"v1","addr":"172.21.15.92:6813","nonce":85705}]},"public_addr":"172.21.15.92:6809/85705","cluster_addr":"172.21.15.92:6811/85705","heartbeat_back_addr":"172.21.15.92:6815/85705","heartbeat_front_addr":"172.21.15.92:6813/85705","state":["exists","up"]},{"osd":2,"uuid":"81ff42a8-c905-48bb-a021-3f5734761a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":85704},{"type":"v1","addr":"172.21.15.92:6801","nonce":85704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":85704},{"type":"v1","addr":"172.21.15.92:6803","nonce":85704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":85704},{"type":"v1","addr":"172.21.15.92:6807","nonce":85704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":85704},{"type":"v1","addr":"172.21.15.92:6805","nonce":85704}]},"public_addr":"172.21.15.92:6801/85704","cluster_addr":"172.21.15.92:6803/85704","heartbeat_back_addr":"172.21.15.92:6807/85704","heartbeat_front_addr":"172.21.15.92:6805/85704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.911756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.874000+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.680977+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:23:45.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.780+0000 7f37904f5700 1 -- 172.21.15.92:0/3928133067 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f376c035630 msgr2=0x7f376c037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:45.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.780+0000 7f37904f5700 1 --2- 172.21.15.92:0/3928133067 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f376c035630 0x7f376c037ae0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3778009860 tx=0x7f3778016000 comp rx=0 tx=0).stop 2023-09-29T23:23:45.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.780+0000 7f37904f5700 1 -- 172.21.15.92:0/3928133067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f378809fd80 msgr2=0x7f378811def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:45.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.780+0000 7f37904f5700 1 --2- 172.21.15.92:0/3928133067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f378809fd80 0x7f378811def0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f378400c460 tx=0x7f3784001020 comp rx=0 tx=0).stop 2023-09-29T23:23:45.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.781+0000 7f37904f5700 1 -- 172.21.15.92:0/3928133067 shutdown_connections 2023-09-29T23:23:45.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.781+0000 7f37904f5700 1 --2- 172.21.15.92:0/3928133067 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f376c035630 0x7f376c037ae0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:45.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.781+0000 7f37904f5700 1 --2- 172.21.15.92:0/3928133067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f378809fd80 0x7f378811def0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:45.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.781+0000 7f37904f5700 1 -- 172.21.15.92:0/3928133067 >> 172.21.15.92:0/3928133067 conn(0x7f3788068000 msgr2=0x7f378812def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:45.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.781+0000 7f37904f5700 1 -- 172.21.15.92:0/3928133067 shutdown_connections 2023-09-29T23:23:45.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.781+0000 7f37904f5700 1 -- 172.21.15.92:0/3928133067 wait complete. 2023-09-29T23:23:45.792 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:23:45.905 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.905+0000 7f7082e07700 1 Processor -- start 2023-09-29T23:23:45.905 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.905+0000 7f7082e07700 1 -- start start 2023-09-29T23:23:45.907 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.905+0000 7f7082e07700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f707c12fd40 0x7f707c134530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:45.907 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.905+0000 7f7082e07700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707c09ca80 con 0x7f707c06b0c0 2023-09-29T23:23:45.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.905+0000 7f7082e07700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f707c06b490 con 0x7f707c12fd40 2023-09-29T23:23:45.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.905+0000 7f7081e05700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f707c06b0c0 0x7f707c12f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43710/0 (socket says 172.21.15.92:43710) 2023-09-29T23:23:45.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.905+0000 7f7081e05700 1 -- 172.21.15.92:0/4216064551 learned_addr learned my addr 172.21.15.92:0/4216064551 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:45.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.906+0000 7f7081604700 1 --2- 172.21.15.92:0/4216064551 >> v2:172.21.15.92:3300/0 conn(0x7f707c12fd40 0x7f707c134530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:45.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.906+0000 7f7080e03700 1 -- 172.21.15.92:0/4216064551 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4225342954 0 0) 0x7f7078001110 con 0x7f707c06b0c0 2023-09-29T23:23:45.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.906+0000 7f7080e03700 1 -- 172.21.15.92:0/4216064551 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7068003570 con 0x7f707c06b0c0 2023-09-29T23:23:45.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.906+0000 7f7081604700 1 -- 172.21.15.92:0/4216064551 >> v1:172.21.15.92:6789/0 conn(0x7f707c06b0c0 legacy=0x7f707c12f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:45.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.906+0000 7f7081604700 1 -- 172.21.15.92:0/4216064551 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c09be20 con 0x7f707c12fd40 2023-09-29T23:23:45.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.906+0000 7f7081604700 1 --2- 172.21.15.92:0/4216064551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f707c12fd40 0x7f707c134530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f706c009860 tx=0x7f706c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac813dda000b54c server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:45.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.906+0000 7f7080e03700 1 -- 172.21.15.92:0/4216064551 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f706c011630 con 0x7f707c12fd40 2023-09-29T23:23:45.908 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.906+0000 7f7080e03700 1 -- 172.21.15.92:0/4216064551 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c011790 con 0x7f707c12fd40 2023-09-29T23:23:45.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.906+0000 7f7080e03700 1 -- 172.21.15.92:0/4216064551 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f706c011a60 con 0x7f707c12fd40 2023-09-29T23:23:45.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.907+0000 7f7082e07700 1 -- 172.21.15.92:0/4216064551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f707c12fd40 msgr2=0x7f707c134530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:45.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.907+0000 7f7082e07700 1 --2- 172.21.15.92:0/4216064551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f707c12fd40 0x7f707c134530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f706c009860 tx=0x7f706c0091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:45.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.907+0000 7f7082e07700 1 -- 172.21.15.92:0/4216064551 shutdown_connections 2023-09-29T23:23:45.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.907+0000 7f7082e07700 1 --2- 172.21.15.92:0/4216064551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f707c12fd40 0x7f707c134530 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:45.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.907+0000 7f7082e07700 1 -- 172.21.15.92:0/4216064551 >> 172.21.15.92:0/4216064551 conn(0x7f707c06a5b0 msgr2=0x7f707c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:45.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.907+0000 7f7082e07700 1 -- 172.21.15.92:0/4216064551 shutdown_connections 2023-09-29T23:23:45.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.907+0000 7f7082e07700 1 -- 172.21.15.92:0/4216064551 wait complete. 2023-09-29T23:23:45.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.907+0000 7f7082e07700 1 Processor -- start 2023-09-29T23:23:45.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.908+0000 7f7082e07700 1 -- start start 2023-09-29T23:23:45.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.908+0000 7f7082e07700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f707c06b0c0 0x7f707c11a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:45.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.908+0000 7f7082e07700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c11e000 con 0x7f707c06b0c0 2023-09-29T23:23:45.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.908+0000 7f7081e05700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f707c06b0c0 0x7f707c11a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:45.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.908+0000 7f7081e05700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f707c06b0c0 0x7f707c11a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36914/0 (socket says 172.21.15.92:36914) 2023-09-29T23:23:45.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.908+0000 7f7081e05700 1 -- 172.21.15.92:0/2928583466 learned_addr learned my addr 172.21.15.92:0/2928583466 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:45.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.908+0000 7f7081e05700 1 -- 172.21.15.92:0/2928583466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c009420 con 0x7f707c06b0c0 2023-09-29T23:23:45.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.908+0000 7f7081e05700 1 --2- 172.21.15.92:0/2928583466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f707c06b0c0 0x7f707c11a6e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f707800c490 tx=0x7f7078007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:45.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.908+0000 7f7071ffb700 1 -- 172.21.15.92:0/2928583466 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7078005c70 con 0x7f707c06b0c0 2023-09-29T23:23:45.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.908+0000 7f7071ffb700 1 -- 172.21.15.92:0/2928583466 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7078005df0 con 0x7f707c06b0c0 2023-09-29T23:23:45.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.908+0000 7f7071ffb700 1 -- 172.21.15.92:0/2928583466 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7078007250 con 0x7f707c06b0c0 2023-09-29T23:23:45.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.908+0000 7f7082e07700 1 -- 172.21.15.92:0/2928583466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707c11c3a0 con 0x7f707c06b0c0 2023-09-29T23:23:45.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.909+0000 7f7082e07700 1 -- 172.21.15.92:0/2928583466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707c11cc00 con 0x7f707c06b0c0 2023-09-29T23:23:45.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.909+0000 7f7071ffb700 1 -- 172.21.15.92:0/2928583466 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f70780073b0 con 0x7f707c06b0c0 2023-09-29T23:23:45.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.909+0000 7f7071ffb700 1 --2- 172.21.15.92:0/2928583466 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7060035640 0x7f7060037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:45.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.909+0000 7f7071ffb700 1 -- 172.21.15.92:0/2928583466 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f7078046920 con 0x7f707c06b0c0 2023-09-29T23:23:45.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.909+0000 7f7081604700 1 --2- 172.21.15.92:0/2928583466 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7060035640 0x7f7060037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:45.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.910+0000 7f7082e07700 1 -- 172.21.15.92:0/2928583466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707c09ca80 con 0x7f707c06b0c0 2023-09-29T23:23:45.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.910+0000 7f7081604700 1 --2- 172.21.15.92:0/2928583466 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7060035640 0x7f7060037af0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f706c009860 tx=0x7f706c016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:45.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:45.914+0000 7f7071ffb700 1 -- 172.21.15.92:0/2928583466 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f707c09ca80 con 0x7f707c06b0c0 2023-09-29T23:23:46.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.099+0000 7f7082e07700 1 -- 172.21.15.92:0/2928583466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f707c09ca80 con 0x7f707c06b0c0 2023-09-29T23:23:46.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.100+0000 7f7071ffb700 1 -- 172.21.15.92:0/2928583466 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+9461 (secure 0 0 0) 0x7f707c09ca80 con 0x7f707c06b0c0 2023-09-29T23:23:46.100 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:46.101 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":16,"fsid":"5b80eae7-9a7e-4dc0-8ff1-cd1f82a1fa33","created":"2023-09-29T23:23:30.308760+0000","modified":"2023-09-29T23:23:45.440887+0000","last_up_change":"2023-09-29T23:23:37.693186+0000","last_in_change":"2023-09-29T23:23:31.538675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-09-29T23:23:39.227674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-29T23:23:43.363869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-29T23:23:44.406215+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea64f859-a36f-4804-810d-2fe7081c9990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":85726},{"type":"v1","addr":"172.21.15.92:6817","nonce":85726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":85726},{"type":"v1","addr":"172.21.15.92:6819","nonce":85726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":85726},{"type":"v1","addr":"172.21.15.92:6823","nonce":85726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":85726},{"type":"v1","addr":"172.21.15.92:6821","nonce":85726}]},"public_addr":"172.21.15.92:6817/85726","cluster_addr":"172.21.15.92:6819/85726","heartbeat_back_addr":"172.21.15.92:6823/85726","heartbeat_front_addr":"172.21.15.92:6821/85726","state":["exists","up"]},{"osd":1,"uuid":"2e9c0837-2887-469f-9dea-db4bde348578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":85705},{"type":"v1","addr":"172.21.15.92:6809","nonce":85705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":85705},{"type":"v1","addr":"172.21.15.92:6811","nonce":85705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":85705},{"type":"v1","addr":"172.21.15.92:6815","nonce":85705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":85705},{"type":"v1","addr":"172.21.15.92:6813","nonce":85705}]},"public_addr":"172.21.15.92:6809/85705","cluster_addr":"172.21.15.92:6811/85705","heartbeat_back_addr":"172.21.15.92:6815/85705","heartbeat_front_addr":"172.21.15.92:6813/85705","state":["exists","up"]},{"osd":2,"uuid":"81ff42a8-c905-48bb-a021-3f5734761a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":85704},{"type":"v1","addr":"172.21.15.92:6801","nonce":85704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":85704},{"type":"v1","addr":"172.21.15.92:6803","nonce":85704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":85704},{"type":"v1","addr":"172.21.15.92:6807","nonce":85704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":85704},{"type":"v1","addr":"172.21.15.92:6805","nonce":85704}]},"public_addr":"172.21.15.92:6801/85704","cluster_addr":"172.21.15.92:6803/85704","heartbeat_back_addr":"172.21.15.92:6807/85704","heartbeat_front_addr":"172.21.15.92:6805/85704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.911756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.874000+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.680977+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:23:46.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.102+0000 7f7082e07700 1 -- 172.21.15.92:0/2928583466 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7060035640 msgr2=0x7f7060037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:46.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.102+0000 7f7082e07700 1 --2- 172.21.15.92:0/2928583466 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7060035640 0x7f7060037af0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f706c009860 tx=0x7f706c016000 comp rx=0 tx=0).stop 2023-09-29T23:23:46.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.102+0000 7f7082e07700 1 -- 172.21.15.92:0/2928583466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f707c06b0c0 msgr2=0x7f707c11a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:46.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.102+0000 7f7082e07700 1 --2- 172.21.15.92:0/2928583466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f707c06b0c0 0x7f707c11a6e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f707800c490 tx=0x7f7078007c70 comp rx=0 tx=0).stop 2023-09-29T23:23:46.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.102+0000 7f7082e07700 1 -- 172.21.15.92:0/2928583466 shutdown_connections 2023-09-29T23:23:46.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.102+0000 7f7082e07700 1 --2- 172.21.15.92:0/2928583466 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7060035640 0x7f7060037af0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:46.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.102+0000 7f7082e07700 1 --2- 172.21.15.92:0/2928583466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f707c06b0c0 0x7f707c11a6e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:46.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.102+0000 7f7082e07700 1 -- 172.21.15.92:0/2928583466 >> 172.21.15.92:0/2928583466 conn(0x7f707c06a5b0 msgr2=0x7f707c12ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:46.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.102+0000 7f7082e07700 1 -- 172.21.15.92:0/2928583466 shutdown_connections 2023-09-29T23:23:46.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.102+0000 7f7082e07700 1 -- 172.21.15.92:0/2928583466 wait complete. 2023-09-29T23:23:46.114 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-29T23:23:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.230+0000 7f41f59d5700 1 Processor -- start 2023-09-29T23:23:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.230+0000 7f41f59d5700 1 -- start start 2023-09-29T23:23:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.230+0000 7f41f59d5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f41f012ffc0 0x7f41f00a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.230+0000 7f41f59d5700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f0098710 con 0x7f41f009fd80 2023-09-29T23:23:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.230+0000 7f41f59d5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f012f340 con 0x7f41f012ffc0 2023-09-29T23:23:46.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.230+0000 7f41ee7fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f41f012ffc0 0x7f41f00a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:46.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.230+0000 7f41eeffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f41f009fd80 0x7f41f012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43716/0 (socket says 172.21.15.92:43716) 2023-09-29T23:23:46.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.230+0000 7f41eeffd700 1 -- 172.21.15.92:0/4248209890 learned_addr learned my addr 172.21.15.92:0/4248209890 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:46.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.230+0000 7f41ee7fc700 1 -- 172.21.15.92:0/4248209890 >> v1:172.21.15.92:6789/0 conn(0x7f41f009fd80 legacy=0x7f41f012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:46.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.230+0000 7f41edffb700 1 -- 172.21.15.92:0/4248209890 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788081472 0 0) 0x7f41f0098710 con 0x7f41f009fd80 2023-09-29T23:23:46.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.230+0000 7f41ee7fc700 1 -- 172.21.15.92:0/4248209890 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f00997e0 con 0x7f41f012ffc0 2023-09-29T23:23:46.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.231+0000 7f41ee7fc700 1 --2- 172.21.15.92:0/4248209890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41f012ffc0 0x7f41f00a3090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009860 tx=0x7f41e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5943f2e892f292de server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:46.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.231+0000 7f41edffb700 1 -- 172.21.15.92:0/4248209890 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41e400b680 con 0x7f41f012ffc0 2023-09-29T23:23:46.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.231+0000 7f41edffb700 1 -- 172.21.15.92:0/4248209890 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e400b7e0 con 0x7f41f012ffc0 2023-09-29T23:23:46.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.231+0000 7f41edffb700 1 -- 172.21.15.92:0/4248209890 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41e400b990 con 0x7f41f012ffc0 2023-09-29T23:23:46.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.231+0000 7f41f59d5700 1 -- 172.21.15.92:0/4248209890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41f012ffc0 msgr2=0x7f41f00a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:46.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.231+0000 7f41f59d5700 1 --2- 172.21.15.92:0/4248209890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41f012ffc0 0x7f41f00a3090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009860 tx=0x7f41e40091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:46.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.231+0000 7f41f59d5700 1 -- 172.21.15.92:0/4248209890 shutdown_connections 2023-09-29T23:23:46.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.231+0000 7f41f59d5700 1 --2- 172.21.15.92:0/4248209890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41f012ffc0 0x7f41f00a3090 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:46.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.231+0000 7f41f59d5700 1 -- 172.21.15.92:0/4248209890 >> 172.21.15.92:0/4248209890 conn(0x7f41f0068000 msgr2=0x7f41f00a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:46.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.231+0000 7f41f59d5700 1 -- 172.21.15.92:0/4248209890 shutdown_connections 2023-09-29T23:23:46.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.231+0000 7f41f59d5700 1 -- 172.21.15.92:0/4248209890 wait complete. 2023-09-29T23:23:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.232+0000 7f41f59d5700 1 Processor -- start 2023-09-29T23:23:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.232+0000 7f41f59d5700 1 -- start start 2023-09-29T23:23:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.233+0000 7f41f59d5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41f009fd80 0x7f41f013e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.233+0000 7f41f59d5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f011e360 con 0x7f41f009fd80 2023-09-29T23:23:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.233+0000 7f41eeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41f009fd80 0x7f41f013e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.233+0000 7f41eeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41f009fd80 0x7f41f013e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36920/0 (socket says 172.21.15.92:36920) 2023-09-29T23:23:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.233+0000 7f41eeffd700 1 -- 172.21.15.92:0/1112567248 learned_addr learned my addr 172.21.15.92:0/1112567248 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.233+0000 7f41eeffd700 1 -- 172.21.15.92:0/1112567248 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e4009420 con 0x7f41f009fd80 2023-09-29T23:23:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.233+0000 7f41eeffd700 1 --2- 172.21.15.92:0/1112567248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41f009fd80 0x7f41f013e4f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f41e000c460 tx=0x7f41e0000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.233+0000 7f41d6ffd700 1 -- 172.21.15.92:0/1112567248 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41e0005c70 con 0x7f41f009fd80 2023-09-29T23:23:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.233+0000 7f41d6ffd700 1 -- 172.21.15.92:0/1112567248 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e0005dd0 con 0x7f41f009fd80 2023-09-29T23:23:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.233+0000 7f41f59d5700 1 -- 172.21.15.92:0/1112567248 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f011c510 con 0x7f41f009fd80 2023-09-29T23:23:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.233+0000 7f41d6ffd700 1 -- 172.21.15.92:0/1112567248 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41e0007230 con 0x7f41f009fd80 2023-09-29T23:23:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.233+0000 7f41f59d5700 1 -- 172.21.15.92:0/1112567248 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f011d060 con 0x7f41f009fd80 2023-09-29T23:23:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.234+0000 7f41d6ffd700 1 -- 172.21.15.92:0/1112567248 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f41e0007390 con 0x7f41f009fd80 2023-09-29T23:23:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.234+0000 7f41d6ffd700 1 --2- 172.21.15.92:0/1112567248 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f41dc035630 0x7f41dc037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.234+0000 7f41d6ffd700 1 -- 172.21.15.92:0/1112567248 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f41e0046b10 con 0x7f41f009fd80 2023-09-29T23:23:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.234+0000 7f41ee7fc700 1 --2- 172.21.15.92:0/1112567248 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f41dc035630 0x7f41dc037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.234+0000 7f41f59d5700 1 -- 172.21.15.92:0/1112567248 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f00a19f0 con 0x7f41f009fd80 2023-09-29T23:23:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.235+0000 7f41ee7fc700 1 --2- 172.21.15.92:0/1112567248 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f41dc035630 0x7f41dc037ae0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009860 tx=0x7f41e4016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:46.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.239+0000 7f41d6ffd700 1 -- 172.21.15.92:0/1112567248 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41e0017020 con 0x7f41f009fd80 2023-09-29T23:23:46.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:46.464+0000 7f41f59d5700 1 -- 172.21.15.92:0/1112567248 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f41f005f230 con 0x7f41f009fd80 2023-09-29T23:23:47.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.445+0000 7f41d6ffd700 1 -- 172.21.15.92:0/1112567248 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f41e00188b0 con 0x7f41f009fd80 2023-09-29T23:23:47.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.448+0000 7f41f59d5700 1 -- 172.21.15.92:0/1112567248 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f41dc035630 msgr2=0x7f41dc037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:47.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.448+0000 7f41f59d5700 1 --2- 172.21.15.92:0/1112567248 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f41dc035630 0x7f41dc037ae0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009860 tx=0x7f41e4016000 comp rx=0 tx=0).stop 2023-09-29T23:23:47.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.448+0000 7f41f59d5700 1 -- 172.21.15.92:0/1112567248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41f009fd80 msgr2=0x7f41f013e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:47.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.448+0000 7f41f59d5700 1 --2- 172.21.15.92:0/1112567248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41f009fd80 0x7f41f013e4f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f41e000c460 tx=0x7f41e0000fe0 comp rx=0 tx=0).stop 2023-09-29T23:23:47.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.448+0000 7f41f59d5700 1 -- 172.21.15.92:0/1112567248 shutdown_connections 2023-09-29T23:23:47.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.448+0000 7f41f59d5700 1 --2- 172.21.15.92:0/1112567248 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f41dc035630 0x7f41dc037ae0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:47.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.448+0000 7f41f59d5700 1 --2- 172.21.15.92:0/1112567248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41f009fd80 0x7f41f013e4f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:47.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.448+0000 7f41f59d5700 1 -- 172.21.15.92:0/1112567248 >> 172.21.15.92:0/1112567248 conn(0x7f41f0068000 msgr2=0x7f41f0094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:47.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.448+0000 7f41f59d5700 1 -- 172.21.15.92:0/1112567248 shutdown_connections 2023-09-29T23:23:47.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.448+0000 7f41f59d5700 1 -- 172.21.15.92:0/1112567248 wait complete. 2023-09-29T23:23:47.461 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-29T23:23:47.462 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-29T23:23:47.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.581+0000 7fb6fc236700 1 Processor -- start 2023-09-29T23:23:47.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.582+0000 7fb6fc236700 1 -- start start 2023-09-29T23:23:47.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.582+0000 7fb6fc236700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb6f4067eb0 0x7fb6f412f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:47.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.582+0000 7fb6fc236700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f409cee0 con 0x7fb6f412fc50 2023-09-29T23:23:47.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.582+0000 7fb6fc236700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f4068280 con 0x7fb6f4067eb0 2023-09-29T23:23:47.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.582+0000 7fb6f9fd2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb6f4067eb0 0x7fb6f412f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:47.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.582+0000 7fb6f97d1700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fb6f412fc50 0x7fb6f4096310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43730/0 (socket says 172.21.15.92:43730) 2023-09-29T23:23:47.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.582+0000 7fb6f9fd2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb6f4067eb0 0x7fb6f412f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36928/0 (socket says 172.21.15.92:36928) 2023-09-29T23:23:47.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.582+0000 7fb6f97d1700 1 -- 172.21.15.92:0/2035159483 learned_addr learned my addr 172.21.15.92:0/2035159483 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:47.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.583+0000 7fb6f9fd2700 1 -- 172.21.15.92:0/2035159483 >> v1:172.21.15.92:6789/0 conn(0x7fb6f412fc50 legacy=0x7fb6f4096310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:47.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.583+0000 7fb6f9fd2700 1 -- 172.21.15.92:0/2035159483 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f40685e0 con 0x7fb6f4067eb0 2023-09-29T23:23:47.586 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.583+0000 7fb6f9fd2700 1 --2- 172.21.15.92:0/2035159483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6f4067eb0 0x7fb6f412f710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009e30 tx=0x7fb6e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35643998387269a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:47.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.583+0000 7fb6f8fd0700 1 -- 172.21.15.92:0/2035159483 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6e400e070 con 0x7fb6f4067eb0 2023-09-29T23:23:47.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.583+0000 7fb6f8fd0700 1 -- 172.21.15.92:0/2035159483 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e400bd70 con 0x7fb6f4067eb0 2023-09-29T23:23:47.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.583+0000 7fb6f8fd0700 1 -- 172.21.15.92:0/2035159483 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6e40125b0 con 0x7fb6f4067eb0 2023-09-29T23:23:47.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.583+0000 7fb6fc236700 1 -- 172.21.15.92:0/2035159483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6f4067eb0 msgr2=0x7fb6f412f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:47.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.583+0000 7fb6fc236700 1 --2- 172.21.15.92:0/2035159483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6f4067eb0 0x7fb6f412f710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009e30 tx=0x7fb6e4009780 comp rx=0 tx=0).stop 2023-09-29T23:23:47.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.583+0000 7fb6fc236700 1 -- 172.21.15.92:0/2035159483 shutdown_connections 2023-09-29T23:23:47.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.583+0000 7fb6fc236700 1 --2- 172.21.15.92:0/2035159483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6f4067eb0 0x7fb6f412f710 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:47.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.583+0000 7fb6fc236700 1 -- 172.21.15.92:0/2035159483 >> 172.21.15.92:0/2035159483 conn(0x7fb6f406bbd0 msgr2=0x7fb6f406dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:47.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.583+0000 7fb6fc236700 1 -- 172.21.15.92:0/2035159483 shutdown_connections 2023-09-29T23:23:47.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.583+0000 7fb6fc236700 1 -- 172.21.15.92:0/2035159483 wait complete. 2023-09-29T23:23:47.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.584+0000 7fb6fc236700 1 Processor -- start 2023-09-29T23:23:47.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.584+0000 7fb6fc236700 1 -- start start 2023-09-29T23:23:47.587 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.585+0000 7fb6fc236700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6f4067eb0 0x7fb6f4117930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:47.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.585+0000 7fb6fc236700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f411b610 con 0x7fb6f4067eb0 2023-09-29T23:23:47.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.585+0000 7fb6f9fd2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6f4067eb0 0x7fb6f4117930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:47.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.585+0000 7fb6f9fd2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6f4067eb0 0x7fb6f4117930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36934/0 (socket says 172.21.15.92:36934) 2023-09-29T23:23:47.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.585+0000 7fb6f9fd2700 1 -- 172.21.15.92:0/2822736324 learned_addr learned my addr 172.21.15.92:0/2822736324 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:47.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.585+0000 7fb6f9fd2700 1 -- 172.21.15.92:0/2822736324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e4009a20 con 0x7fb6f4067eb0 2023-09-29T23:23:47.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.585+0000 7fb6f9fd2700 1 --2- 172.21.15.92:0/2822736324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6f4067eb0 0x7fb6f4117930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40097c0 tx=0x7fb6e4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:47.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.585+0000 7fb6f1ffb700 1 -- 172.21.15.92:0/2822736324 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6e4012e00 con 0x7fb6f4067eb0 2023-09-29T23:23:47.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.585+0000 7fb6f1ffb700 1 -- 172.21.15.92:0/2822736324 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e401e640 con 0x7fb6f4067eb0 2023-09-29T23:23:47.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.585+0000 7fb6f1ffb700 1 -- 172.21.15.92:0/2822736324 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6e401e7f0 con 0x7fb6f4067eb0 2023-09-29T23:23:47.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.585+0000 7fb6fc236700 1 -- 172.21.15.92:0/2822736324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f411a770 con 0x7fb6f4067eb0 2023-09-29T23:23:47.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.585+0000 7fb6fc236700 1 -- 172.21.15.92:0/2822736324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f4119ae0 con 0x7fb6f4067eb0 2023-09-29T23:23:47.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.586+0000 7fb6f1ffb700 1 -- 172.21.15.92:0/2822736324 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fb6e401e950 con 0x7fb6f4067eb0 2023-09-29T23:23:47.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.586+0000 7fb6f1ffb700 1 --2- 172.21.15.92:0/2822736324 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb6e0035640 0x7fb6e0037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:47.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.586+0000 7fb6fc236700 1 -- 172.21.15.92:0/2822736324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f411b750 con 0x7fb6f4067eb0 2023-09-29T23:23:47.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.586+0000 7fb6f1ffb700 1 -- 172.21.15.92:0/2822736324 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7fb6e4049ac0 con 0x7fb6f4067eb0 2023-09-29T23:23:47.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.586+0000 7fb6f97d1700 1 --2- 172.21.15.92:0/2822736324 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb6e0035640 0x7fb6e0037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:47.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.587+0000 7fb6f97d1700 1 --2- 172.21.15.92:0/2822736324 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb6e0035640 0x7fb6e0037af0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8007fd0 tx=0x7fb6e8007b00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:47.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.591+0000 7fb6f1ffb700 1 -- 172.21.15.92:0/2822736324 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6e401b340 con 0x7fb6f4067eb0 2023-09-29T23:23:47.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:47.821+0000 7fb6fc236700 1 -- 172.21.15.92:0/2822736324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb6f405f230 con 0x7fb6f4067eb0 2023-09-29T23:23:48.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.448+0000 7fb6f1ffb700 1 -- 172.21.15.92:0/2822736324 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb6e4011b80 con 0x7fb6f4067eb0 2023-09-29T23:23:48.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.450+0000 7fb6fc236700 1 -- 172.21.15.92:0/2822736324 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb6e0035640 msgr2=0x7fb6e0037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:48.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.450+0000 7fb6fc236700 1 --2- 172.21.15.92:0/2822736324 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb6e0035640 0x7fb6e0037af0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8007fd0 tx=0x7fb6e8007b00 comp rx=0 tx=0).stop 2023-09-29T23:23:48.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.450+0000 7fb6fc236700 1 -- 172.21.15.92:0/2822736324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6f4067eb0 msgr2=0x7fb6f4117930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:48.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.450+0000 7fb6fc236700 1 --2- 172.21.15.92:0/2822736324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6f4067eb0 0x7fb6f4117930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40097c0 tx=0x7fb6e4018000 comp rx=0 tx=0).stop 2023-09-29T23:23:48.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.450+0000 7fb6fc236700 1 -- 172.21.15.92:0/2822736324 shutdown_connections 2023-09-29T23:23:48.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.450+0000 7fb6fc236700 1 --2- 172.21.15.92:0/2822736324 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb6e0035640 0x7fb6e0037af0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:48.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.450+0000 7fb6fc236700 1 --2- 172.21.15.92:0/2822736324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6f4067eb0 0x7fb6f4117930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:48.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.450+0000 7fb6fc236700 1 -- 172.21.15.92:0/2822736324 >> 172.21.15.92:0/2822736324 conn(0x7fb6f406bbd0 msgr2=0x7fb6f412e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:48.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.450+0000 7fb6fc236700 1 -- 172.21.15.92:0/2822736324 shutdown_connections 2023-09-29T23:23:48.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.450+0000 7fb6fc236700 1 -- 172.21.15.92:0/2822736324 wait complete. 2023-09-29T23:23:48.462 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-29T23:23:48.462 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-29T23:23:48.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.575+0000 7f9496e0b700 1 Processor -- start 2023-09-29T23:23:48.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.575+0000 7f9496e0b700 1 -- start start 2023-09-29T23:23:48.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.576+0000 7f9496e0b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f949012ffc0 0x7f94900a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:48.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.576+0000 7f9496e0b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9490098710 con 0x7f949009fd80 2023-09-29T23:23:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.576+0000 7f9496e0b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949012f340 con 0x7f949012ffc0 2023-09-29T23:23:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.576+0000 7f948ffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f949012ffc0 0x7f94900a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.576+0000 7f948ffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f949012ffc0 0x7f94900a3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36944/0 (socket says 172.21.15.92:36944) 2023-09-29T23:23:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.576+0000 7f9494ba7700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f949009fd80 0x7f949012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43746/0 (socket says 172.21.15.92:43746) 2023-09-29T23:23:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.576+0000 7f948ffff700 1 -- 172.21.15.92:0/470621788 learned_addr learned my addr 172.21.15.92:0/470621788 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.576+0000 7f948ffff700 1 -- 172.21.15.92:0/470621788 >> v1:172.21.15.92:6789/0 conn(0x7f949009fd80 legacy=0x7f949012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.576+0000 7f948ffff700 1 -- 172.21.15.92:0/470621788 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94900997e0 con 0x7f949012ffc0 2023-09-29T23:23:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.576+0000 7f948ffff700 1 --2- 172.21.15.92:0/470621788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f949012ffc0 0x7f94900a3090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9484009930 tx=0x7f9484009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed698844213ff551 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.576+0000 7f948f7fe700 1 -- 172.21.15.92:0/470621788 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f948400b860 con 0x7f949012ffc0 2023-09-29T23:23:48.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.576+0000 7f948f7fe700 1 -- 172.21.15.92:0/470621788 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948400b9c0 con 0x7f949012ffc0 2023-09-29T23:23:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.576+0000 7f948f7fe700 1 -- 172.21.15.92:0/470621788 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f948400bb50 con 0x7f949012ffc0 2023-09-29T23:23:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.577+0000 7f9496e0b700 1 -- 172.21.15.92:0/470621788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f949012ffc0 msgr2=0x7f94900a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.577+0000 7f9496e0b700 1 --2- 172.21.15.92:0/470621788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f949012ffc0 0x7f94900a3090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9484009930 tx=0x7f9484009250 comp rx=0 tx=0).stop 2023-09-29T23:23:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.577+0000 7f9496e0b700 1 -- 172.21.15.92:0/470621788 shutdown_connections 2023-09-29T23:23:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.577+0000 7f9496e0b700 1 --2- 172.21.15.92:0/470621788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f949012ffc0 0x7f94900a3090 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.577+0000 7f9496e0b700 1 -- 172.21.15.92:0/470621788 >> 172.21.15.92:0/470621788 conn(0x7f9490068000 msgr2=0x7f94900a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.577+0000 7f9496e0b700 1 -- 172.21.15.92:0/470621788 shutdown_connections 2023-09-29T23:23:48.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.577+0000 7f9496e0b700 1 -- 172.21.15.92:0/470621788 wait complete. 2023-09-29T23:23:48.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.578+0000 7f9496e0b700 1 Processor -- start 2023-09-29T23:23:48.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.578+0000 7f9496e0b700 1 -- start start 2023-09-29T23:23:48.581 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.578+0000 7f9496e0b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f949009fd80 0x7f949011def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:48.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.578+0000 7f9496e0b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949011cb30 con 0x7f949009fd80 2023-09-29T23:23:48.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.578+0000 7f9494ba7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f949009fd80 0x7f949011def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:48.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.578+0000 7f9494ba7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f949009fd80 0x7f949011def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36960/0 (socket says 172.21.15.92:36960) 2023-09-29T23:23:48.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.578+0000 7f9494ba7700 1 -- 172.21.15.92:0/2620167767 learned_addr learned my addr 172.21.15.92:0/2620167767 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:48.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.578+0000 7f9494ba7700 1 -- 172.21.15.92:0/2620167767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94840094f0 con 0x7f949009fd80 2023-09-29T23:23:48.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.579+0000 7f9494ba7700 1 --2- 172.21.15.92:0/2620167767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f949009fd80 0x7f949011def0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f948000cc30 tx=0x7f9480001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:48.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.579+0000 7f948cff9700 1 -- 172.21.15.92:0/2620167767 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9480005df0 con 0x7f949009fd80 2023-09-29T23:23:48.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.579+0000 7f948cff9700 1 -- 172.21.15.92:0/2620167767 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948000a7b0 con 0x7f949009fd80 2023-09-29T23:23:48.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.579+0000 7f948cff9700 1 -- 172.21.15.92:0/2620167767 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f948000aa60 con 0x7f949009fd80 2023-09-29T23:23:48.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.579+0000 7f9496e0b700 1 -- 172.21.15.92:0/2620167767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949011da60 con 0x7f949009fd80 2023-09-29T23:23:48.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.579+0000 7f9496e0b700 1 -- 172.21.15.92:0/2620167767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949011a750 con 0x7f949009fd80 2023-09-29T23:23:48.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.579+0000 7f948cff9700 1 -- 172.21.15.92:0/2620167767 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f948000ac50 con 0x7f949009fd80 2023-09-29T23:23:48.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.580+0000 7f9496e0b700 1 -- 172.21.15.92:0/2620167767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94900a30e0 con 0x7f949009fd80 2023-09-29T23:23:48.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.580+0000 7f948cff9700 1 --2- 172.21.15.92:0/2620167767 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f947c035640 0x7f947c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:48.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.580+0000 7f948cff9700 1 -- 172.21.15.92:0/2620167767 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f9480047570 con 0x7f949009fd80 2023-09-29T23:23:48.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.580+0000 7f948ffff700 1 --2- 172.21.15.92:0/2620167767 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f947c035640 0x7f947c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:48.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.580+0000 7f948ffff700 1 --2- 172.21.15.92:0/2620167767 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f947c035640 0x7f947c037af0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f94900a0170 tx=0x7f9484016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:48.584 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.584+0000 7f948cff9700 1 -- 172.21.15.92:0/2620167767 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f948001a360 con 0x7f949009fd80 2023-09-29T23:23:48.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.808+0000 7f9496e0b700 1 -- 172.21.15.92:0/2620167767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94900a1ba0 con 0x7f949009fd80 2023-09-29T23:23:48.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.809+0000 7f948cff9700 1 -- 172.21.15.92:0/2620167767 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2324 (secure 0 0 0) 0x7f94800113a0 con 0x7f949009fd80 2023-09-29T23:23:48.809 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:48.809 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-29T23:23:45.441190+0000","modified":"2023-09-29T23:23:48.445809+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4146},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4146":{"gid":4146,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6827/1334445094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1334445094},{"type":"v1","addr":"172.21.15.92:6827","nonce":1334445094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-29T23:23:48.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.811+0000 7f9496e0b700 1 -- 172.21.15.92:0/2620167767 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f947c035640 msgr2=0x7f947c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:48.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.811+0000 7f9496e0b700 1 --2- 172.21.15.92:0/2620167767 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f947c035640 0x7f947c037af0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f94900a0170 tx=0x7f9484016000 comp rx=0 tx=0).stop 2023-09-29T23:23:48.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.811+0000 7f9496e0b700 1 -- 172.21.15.92:0/2620167767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f949009fd80 msgr2=0x7f949011def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:48.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.811+0000 7f9496e0b700 1 --2- 172.21.15.92:0/2620167767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f949009fd80 0x7f949011def0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f948000cc30 tx=0x7f9480001af0 comp rx=0 tx=0).stop 2023-09-29T23:23:48.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.811+0000 7f9496e0b700 1 -- 172.21.15.92:0/2620167767 shutdown_connections 2023-09-29T23:23:48.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.811+0000 7f9496e0b700 1 --2- 172.21.15.92:0/2620167767 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f947c035640 0x7f947c037af0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:48.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.811+0000 7f9496e0b700 1 --2- 172.21.15.92:0/2620167767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f949009fd80 0x7f949011def0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:48.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.811+0000 7f9496e0b700 1 -- 172.21.15.92:0/2620167767 >> 172.21.15.92:0/2620167767 conn(0x7f9490068000 msgr2=0x7f949012def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:48.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.811+0000 7f9496e0b700 1 -- 172.21.15.92:0/2620167767 shutdown_connections 2023-09-29T23:23:48.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.811+0000 7f9496e0b700 1 -- 172.21.15.92:0/2620167767 wait complete. 2023-09-29T23:23:48.813 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 6 2023-09-29T23:23:48.823 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:23:48.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.936+0000 7f24a37a6700 1 Processor -- start 2023-09-29T23:23:48.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.936+0000 7f24a37a6700 1 -- start start 2023-09-29T23:23:48.943 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.936+0000 7f24a37a6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f249c09fd80 0x7f249c0a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:48.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.936+0000 7f24a37a6700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f249c098710 con 0x7f249c12f8b0 2023-09-29T23:23:48.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.936+0000 7f24a37a6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f249c12f340 con 0x7f249c09fd80 2023-09-29T23:23:48.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.936+0000 7f24a1542700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f249c09fd80 0x7f249c0a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:48.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.936+0000 7f24a0d41700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f249c12f8b0 0x7f249c095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43750/0 (socket says 172.21.15.92:43750) 2023-09-29T23:23:48.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.936+0000 7f24a0d41700 1 -- 172.21.15.92:0/2869405254 learned_addr learned my addr 172.21.15.92:0/2869405254 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:48.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.937+0000 7f24a1542700 1 -- 172.21.15.92:0/2869405254 >> v1:172.21.15.92:6789/0 conn(0x7f249c12f8b0 legacy=0x7f249c095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:48.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.937+0000 7f24a1542700 1 -- 172.21.15.92:0/2869405254 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c0997e0 con 0x7f249c09fd80 2023-09-29T23:23:48.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.937+0000 7f2493fff700 1 -- 172.21.15.92:0/2869405254 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787675597 0 0) 0x7f249c098710 con 0x7f249c12f8b0 2023-09-29T23:23:48.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.937+0000 7f24a1542700 1 --2- 172.21.15.92:0/2869405254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f249c09fd80 0x7f249c0a3090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2498009860 tx=0x7f24980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8aa18e76bed7a9f server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:48.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.937+0000 7f2493fff700 1 -- 172.21.15.92:0/2869405254 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f249800b680 con 0x7f249c09fd80 2023-09-29T23:23:48.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.937+0000 7f2493fff700 1 -- 172.21.15.92:0/2869405254 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249800b7e0 con 0x7f249c09fd80 2023-09-29T23:23:48.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.937+0000 7f2493fff700 1 -- 172.21.15.92:0/2869405254 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f249800b990 con 0x7f249c09fd80 2023-09-29T23:23:48.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.937+0000 7f24a37a6700 1 -- 172.21.15.92:0/2869405254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f249c09fd80 msgr2=0x7f249c0a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:48.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.937+0000 7f24a37a6700 1 --2- 172.21.15.92:0/2869405254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f249c09fd80 0x7f249c0a3090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2498009860 tx=0x7f24980091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:48.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.937+0000 7f24a37a6700 1 -- 172.21.15.92:0/2869405254 shutdown_connections 2023-09-29T23:23:48.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.937+0000 7f24a37a6700 1 --2- 172.21.15.92:0/2869405254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f249c09fd80 0x7f249c0a3090 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:48.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.937+0000 7f24a37a6700 1 -- 172.21.15.92:0/2869405254 >> 172.21.15.92:0/2869405254 conn(0x7f249c068000 msgr2=0x7f249c0a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:48.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.938+0000 7f24a37a6700 1 -- 172.21.15.92:0/2869405254 shutdown_connections 2023-09-29T23:23:48.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.938+0000 7f24a37a6700 1 -- 172.21.15.92:0/2869405254 wait complete. 2023-09-29T23:23:48.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.938+0000 7f24a37a6700 1 Processor -- start 2023-09-29T23:23:48.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.938+0000 7f24a37a6700 1 -- start start 2023-09-29T23:23:48.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.939+0000 7f24a37a6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f249c09fd80 0x7f249c11da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:48.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.939+0000 7f24a37a6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c11e1b0 con 0x7f249c09fd80 2023-09-29T23:23:48.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.939+0000 7f24a1542700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f249c09fd80 0x7f249c11da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:48.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.939+0000 7f24a1542700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f249c09fd80 0x7f249c11da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36976/0 (socket says 172.21.15.92:36976) 2023-09-29T23:23:48.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.939+0000 7f24a1542700 1 -- 172.21.15.92:0/1982469335 learned_addr learned my addr 172.21.15.92:0/1982469335 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:48.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.939+0000 7f24a1542700 1 -- 172.21.15.92:0/1982469335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2498009420 con 0x7f249c09fd80 2023-09-29T23:23:48.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.939+0000 7f24a1542700 1 --2- 172.21.15.92:0/1982469335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f249c09fd80 0x7f249c11da60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2498000c00 tx=0x7f2498016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:48.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.939+0000 7f24917fa700 1 -- 172.21.15.92:0/1982469335 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2498011d30 con 0x7f249c09fd80 2023-09-29T23:23:48.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.940+0000 7f24917fa700 1 -- 172.21.15.92:0/1982469335 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2498020070 con 0x7f249c09fd80 2023-09-29T23:23:48.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.940+0000 7f24a37a6700 1 -- 172.21.15.92:0/1982469335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249c11ec00 con 0x7f249c09fd80 2023-09-29T23:23:48.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.940+0000 7f24917fa700 1 -- 172.21.15.92:0/1982469335 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f249801b450 con 0x7f249c09fd80 2023-09-29T23:23:48.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.940+0000 7f24a37a6700 1 -- 172.21.15.92:0/1982469335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249c11c2f0 con 0x7f249c09fd80 2023-09-29T23:23:48.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.940+0000 7f24917fa700 1 -- 172.21.15.92:0/1982469335 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f2498022030 con 0x7f249c09fd80 2023-09-29T23:23:48.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.940+0000 7f24917fa700 1 --2- 172.21.15.92:0/1982469335 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2480035640 0x7f2480037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:48.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.940+0000 7f24a37a6700 1 -- 172.21.15.92:0/1982469335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c05f230 con 0x7f249c09fd80 2023-09-29T23:23:48.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.941+0000 7f24917fa700 1 -- 172.21.15.92:0/1982469335 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f2498049180 con 0x7f249c09fd80 2023-09-29T23:23:48.949 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.941+0000 7f24a0d41700 1 --2- 172.21.15.92:0/1982469335 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2480035640 0x7f2480037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:48.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.941+0000 7f24a0d41700 1 --2- 172.21.15.92:0/1982469335 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2480035640 0x7f2480037af0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f248c0011e0 tx=0x7f248c0079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:48.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:48.945+0000 7f24917fa700 1 -- 172.21.15.92:0/1982469335 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24980249c0 con 0x7f249c09fd80 2023-09-29T23:23:49.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.129+0000 7f24a37a6700 1 -- 172.21.15.92:0/1982469335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f249c04bb40 con 0x7f249c09fd80 2023-09-29T23:23:49.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.129+0000 7f24917fa700 1 -- 172.21.15.92:0/1982469335 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+9448 (secure 0 0 0) 0x7f24980193f0 con 0x7f249c09fd80 2023-09-29T23:23:49.130 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:49.130 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":17,"fsid":"5b80eae7-9a7e-4dc0-8ff1-cd1f82a1fa33","created":"2023-09-29T23:23:30.308760+0000","modified":"2023-09-29T23:23:46.442906+0000","last_up_change":"2023-09-29T23:23:37.693186+0000","last_in_change":"2023-09-29T23:23:31.538675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-09-29T23:23:39.227674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-29T23:23:43.363869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-29T23:23:44.406215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea64f859-a36f-4804-810d-2fe7081c9990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":85726},{"type":"v1","addr":"172.21.15.92:6817","nonce":85726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":85726},{"type":"v1","addr":"172.21.15.92:6819","nonce":85726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":85726},{"type":"v1","addr":"172.21.15.92:6823","nonce":85726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":85726},{"type":"v1","addr":"172.21.15.92:6821","nonce":85726}]},"public_addr":"172.21.15.92:6817/85726","cluster_addr":"172.21.15.92:6819/85726","heartbeat_back_addr":"172.21.15.92:6823/85726","heartbeat_front_addr":"172.21.15.92:6821/85726","state":["exists","up"]},{"osd":1,"uuid":"2e9c0837-2887-469f-9dea-db4bde348578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":85705},{"type":"v1","addr":"172.21.15.92:6809","nonce":85705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":85705},{"type":"v1","addr":"172.21.15.92:6811","nonce":85705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":85705},{"type":"v1","addr":"172.21.15.92:6815","nonce":85705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":85705},{"type":"v1","addr":"172.21.15.92:6813","nonce":85705}]},"public_addr":"172.21.15.92:6809/85705","cluster_addr":"172.21.15.92:6811/85705","heartbeat_back_addr":"172.21.15.92:6815/85705","heartbeat_front_addr":"172.21.15.92:6813/85705","state":["exists","up"]},{"osd":2,"uuid":"81ff42a8-c905-48bb-a021-3f5734761a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":85704},{"type":"v1","addr":"172.21.15.92:6801","nonce":85704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":85704},{"type":"v1","addr":"172.21.15.92:6803","nonce":85704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":85704},{"type":"v1","addr":"172.21.15.92:6807","nonce":85704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":85704},{"type":"v1","addr":"172.21.15.92:6805","nonce":85704}]},"public_addr":"172.21.15.92:6801/85704","cluster_addr":"172.21.15.92:6803/85704","heartbeat_back_addr":"172.21.15.92:6807/85704","heartbeat_front_addr":"172.21.15.92:6805/85704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.911756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.874000+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.680977+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:23:49.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.131+0000 7f24a37a6700 1 -- 172.21.15.92:0/1982469335 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2480035640 msgr2=0x7f2480037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:49.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.131+0000 7f24a37a6700 1 --2- 172.21.15.92:0/1982469335 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2480035640 0x7f2480037af0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f248c0011e0 tx=0x7f248c0079d0 comp rx=0 tx=0).stop 2023-09-29T23:23:49.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.131+0000 7f24a37a6700 1 -- 172.21.15.92:0/1982469335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f249c09fd80 msgr2=0x7f249c11da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:49.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.131+0000 7f24a37a6700 1 --2- 172.21.15.92:0/1982469335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f249c09fd80 0x7f249c11da60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2498000c00 tx=0x7f2498016000 comp rx=0 tx=0).stop 2023-09-29T23:23:49.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.132+0000 7f24a37a6700 1 -- 172.21.15.92:0/1982469335 shutdown_connections 2023-09-29T23:23:49.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.132+0000 7f24a37a6700 1 --2- 172.21.15.92:0/1982469335 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2480035640 0x7f2480037af0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:49.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.132+0000 7f24a37a6700 1 --2- 172.21.15.92:0/1982469335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f249c09fd80 0x7f249c11da60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:49.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.132+0000 7f24a37a6700 1 -- 172.21.15.92:0/1982469335 >> 172.21.15.92:0/1982469335 conn(0x7f249c068000 msgr2=0x7f249c094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:49.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.132+0000 7f24a37a6700 1 -- 172.21.15.92:0/1982469335 shutdown_connections 2023-09-29T23:23:49.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.132+0000 7f24a37a6700 1 -- 172.21.15.92:0/1982469335 wait complete. 2023-09-29T23:23:49.143 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-29T23:23:49.143 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:23:49.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.258+0000 7f4685aa5700 1 Processor -- start 2023-09-29T23:23:49.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.258+0000 7f4685aa5700 1 -- start start 2023-09-29T23:23:49.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.258+0000 7f4685aa5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f468009fd80 0x7f46800a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:49.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.258+0000 7f4685aa5700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4680098710 con 0x7f468012f8b0 2023-09-29T23:23:49.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.258+0000 7f4685aa5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f468012f340 con 0x7f468009fd80 2023-09-29T23:23:49.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.258+0000 7f467f7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f468009fd80 0x7f46800a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:49.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.258+0000 7f467effd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f468012f8b0 0x7f4680095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43764/0 (socket says 172.21.15.92:43764) 2023-09-29T23:23:49.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.258+0000 7f467effd700 1 -- 172.21.15.92:0/130654484 learned_addr learned my addr 172.21.15.92:0/130654484 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:49.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.258+0000 7f467f7fe700 1 -- 172.21.15.92:0/130654484 >> v1:172.21.15.92:6789/0 conn(0x7f468012f8b0 legacy=0x7f4680095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.259+0000 7f467f7fe700 1 -- 172.21.15.92:0/130654484 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46800997e0 con 0x7f468009fd80 2023-09-29T23:23:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.258+0000 7f467e7fc700 1 -- 172.21.15.92:0/130654484 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242576224 0 0) 0x7f4680098710 con 0x7f468012f8b0 2023-09-29T23:23:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.259+0000 7f467f7fe700 1 --2- 172.21.15.92:0/130654484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f468009fd80 0x7f46800a3090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4670009de0 tx=0x7f4670009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3914cce2a4dc2078 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.259+0000 7f467e7fc700 1 -- 172.21.15.92:0/130654484 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f467000e070 con 0x7f468009fd80 2023-09-29T23:23:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.259+0000 7f467e7fc700 1 -- 172.21.15.92:0/130654484 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467000bc80 con 0x7f468009fd80 2023-09-29T23:23:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.259+0000 7f467e7fc700 1 -- 172.21.15.92:0/130654484 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4670012430 con 0x7f468009fd80 2023-09-29T23:23:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.259+0000 7f4685aa5700 1 -- 172.21.15.92:0/130654484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f468009fd80 msgr2=0x7f46800a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.259+0000 7f4685aa5700 1 --2- 172.21.15.92:0/130654484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f468009fd80 0x7f46800a3090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4670009de0 tx=0x7f4670009780 comp rx=0 tx=0).stop 2023-09-29T23:23:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.259+0000 7f4685aa5700 1 -- 172.21.15.92:0/130654484 shutdown_connections 2023-09-29T23:23:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.259+0000 7f4685aa5700 1 --2- 172.21.15.92:0/130654484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f468009fd80 0x7f46800a3090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.259+0000 7f4685aa5700 1 -- 172.21.15.92:0/130654484 >> 172.21.15.92:0/130654484 conn(0x7f4680068000 msgr2=0x7f46800a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:49.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.259+0000 7f4685aa5700 1 -- 172.21.15.92:0/130654484 shutdown_connections 2023-09-29T23:23:49.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.259+0000 7f4685aa5700 1 -- 172.21.15.92:0/130654484 wait complete. 2023-09-29T23:23:49.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.260+0000 7f4685aa5700 1 Processor -- start 2023-09-29T23:23:49.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.260+0000 7f4685aa5700 1 -- start start 2023-09-29T23:23:49.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.261+0000 7f4685aa5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f468009fd80 0x7f468011da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:49.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.261+0000 7f4685aa5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468011e1b0 con 0x7f468009fd80 2023-09-29T23:23:49.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.261+0000 7f467f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f468009fd80 0x7f468011da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:49.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.261+0000 7f467f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f468009fd80 0x7f468011da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37006/0 (socket says 172.21.15.92:37006) 2023-09-29T23:23:49.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.261+0000 7f467f7fe700 1 -- 172.21.15.92:0/3701060286 learned_addr learned my addr 172.21.15.92:0/3701060286 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:49.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.261+0000 7f467f7fe700 1 -- 172.21.15.92:0/3701060286 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4670009a20 con 0x7f468009fd80 2023-09-29T23:23:49.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.261+0000 7f467f7fe700 1 --2- 172.21.15.92:0/3701060286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f468009fd80 0x7f468011da60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f46700097c0 tx=0x7f4670018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:49.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.261+0000 7f46677fe700 1 -- 172.21.15.92:0/3701060286 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4670027470 con 0x7f468009fd80 2023-09-29T23:23:49.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.261+0000 7f46677fe700 1 -- 172.21.15.92:0/3701060286 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46700275d0 con 0x7f468009fd80 2023-09-29T23:23:49.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.261+0000 7f4685aa5700 1 -- 172.21.15.92:0/3701060286 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468011ec00 con 0x7f468009fd80 2023-09-29T23:23:49.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.261+0000 7f46677fe700 1 -- 172.21.15.92:0/3701060286 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46700278c0 con 0x7f468009fd80 2023-09-29T23:23:49.264 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.261+0000 7f4685aa5700 1 -- 172.21.15.92:0/3701060286 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468011c2f0 con 0x7f468009fd80 2023-09-29T23:23:49.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.262+0000 7f46677fe700 1 -- 172.21.15.92:0/3701060286 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f4670024070 con 0x7f468009fd80 2023-09-29T23:23:49.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.262+0000 7f46677fe700 1 --2- 172.21.15.92:0/3701060286 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f466c035640 0x7f466c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:49.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.262+0000 7f4685aa5700 1 -- 172.21.15.92:0/3701060286 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468005f230 con 0x7f468009fd80 2023-09-29T23:23:49.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.262+0000 7f46677fe700 1 -- 172.21.15.92:0/3701060286 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f467004a080 con 0x7f468009fd80 2023-09-29T23:23:49.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.262+0000 7f467effd700 1 --2- 172.21.15.92:0/3701060286 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f466c035640 0x7f466c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:49.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.263+0000 7f467effd700 1 --2- 172.21.15.92:0/3701060286 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f466c035640 0x7f466c037af0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f46740011e0 tx=0x7f46740079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:49.267 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.267+0000 7f46677fe700 1 -- 172.21.15.92:0/3701060286 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f467002f3a0 con 0x7f468009fd80 2023-09-29T23:23:49.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.444+0000 7f4685aa5700 1 -- 172.21.15.92:0/3701060286 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f468004bb40 con 0x7f466c035640 2023-09-29T23:23:49.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.451+0000 7f46677fe700 1 -- 172.21.15.92:0/3701060286 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253632 (secure 0 0 0) 0x7f468004bb40 con 0x7f466c035640 2023-09-29T23:23:49.454 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:49.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.454+0000 7f4685aa5700 1 -- 172.21.15.92:0/3701060286 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f466c035640 msgr2=0x7f466c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:49.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.454+0000 7f4685aa5700 1 --2- 172.21.15.92:0/3701060286 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f466c035640 0x7f466c037af0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f46740011e0 tx=0x7f46740079d0 comp rx=0 tx=0).stop 2023-09-29T23:23:49.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.454+0000 7f4685aa5700 1 -- 172.21.15.92:0/3701060286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f468009fd80 msgr2=0x7f468011da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:49.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.454+0000 7f4685aa5700 1 --2- 172.21.15.92:0/3701060286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f468009fd80 0x7f468011da60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f46700097c0 tx=0x7f4670018000 comp rx=0 tx=0).stop 2023-09-29T23:23:49.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.454+0000 7f4685aa5700 1 -- 172.21.15.92:0/3701060286 shutdown_connections 2023-09-29T23:23:49.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.454+0000 7f4685aa5700 1 --2- 172.21.15.92:0/3701060286 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f466c035640 0x7f466c037af0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:49.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.454+0000 7f4685aa5700 1 --2- 172.21.15.92:0/3701060286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f468009fd80 0x7f468011da60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:49.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.454+0000 7f4685aa5700 1 -- 172.21.15.92:0/3701060286 >> 172.21.15.92:0/3701060286 conn(0x7f4680068000 msgr2=0x7f4680094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:49.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.454+0000 7f4685aa5700 1 -- 172.21.15.92:0/3701060286 shutdown_connections 2023-09-29T23:23:49.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.454+0000 7f4685aa5700 1 -- 172.21.15.92:0/3701060286 wait complete. 2023-09-29T23:23:49.458 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-09-29T23:23:49.466 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-09-29T23:23:48.035447+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1536,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":70,"acting":70,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":15636,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":15232,"kb_avail":314557164,"statfs":{"total":322122547200,"available":322106535936,"internally_reserved":0,"allocated":389120,"data_stored":99651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15597568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471200+0000","last_change":"2023-09-29T23:23:45.471200+0000","last_active":"2023-09-29T23:23:45.471200+0000","last_peered":"2023-09-29T23:23:45.471200+0000","last_clean":"2023-09-29T23:23:45.471200+0000","last_became_active":"2023-09-29T23:23:45.470971+0000","last_became_peered":"2023-09-29T23:23:45.470971+0000","last_unstale":"2023-09-29T23:23:45.471200+0000","last_undegraded":"2023-09-29T23:23:45.471200+0000","last_fullsized":"2023-09-29T23:23:45.471200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:29:34.531515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470583+0000","last_change":"2023-09-29T23:23:45.470583+0000","last_active":"2023-09-29T23:23:45.470583+0000","last_peered":"2023-09-29T23:23:45.470583+0000","last_clean":"2023-09-29T23:23:45.470583+0000","last_became_active":"2023-09-29T23:23:45.470349+0000","last_became_peered":"2023-09-29T23:23:45.470349+0000","last_unstale":"2023-09-29T23:23:45.470583+0000","last_undegraded":"2023-09-29T23:23:45.470583+0000","last_fullsized":"2023-09-29T23:23:45.470583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:50:32.868236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.463286+0000","last_change":"2023-09-29T23:23:45.463286+0000","last_active":"2023-09-29T23:23:45.463286+0000","last_peered":"2023-09-29T23:23:45.463286+0000","last_clean":"2023-09-29T23:23:45.463286+0000","last_became_active":"2023-09-29T23:23:45.462888+0000","last_became_peered":"2023-09-29T23:23:45.462888+0000","last_unstale":"2023-09-29T23:23:45.463286+0000","last_undegraded":"2023-09-29T23:23:45.463286+0000","last_fullsized":"2023-09-29T23:23:45.463286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471536+0000","last_change":"2023-09-29T23:23:45.471536+0000","last_active":"2023-09-29T23:23:45.471536+0000","last_peered":"2023-09-29T23:23:45.471536+0000","last_clean":"2023-09-29T23:23:45.471536+0000","last_became_active":"2023-09-29T23:23:45.471334+0000","last_became_peered":"2023-09-29T23:23:45.471334+0000","last_unstale":"2023-09-29T23:23:45.471536+0000","last_undegraded":"2023-09-29T23:23:45.471536+0000","last_fullsized":"2023-09-29T23:23:45.471536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467819+0000","last_change":"2023-09-29T23:23:45.467819+0000","last_active":"2023-09-29T23:23:45.467819+0000","last_peered":"2023-09-29T23:23:45.467819+0000","last_clean":"2023-09-29T23:23:45.467819+0000","last_became_active":"2023-09-29T23:23:45.467434+0000","last_became_peered":"2023-09-29T23:23:45.467434+0000","last_unstale":"2023-09-29T23:23:45.467819+0000","last_undegraded":"2023-09-29T23:23:45.467819+0000","last_fullsized":"2023-09-29T23:23:45.467819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.458032+0000","last_change":"2023-09-29T23:23:45.458032+0000","last_active":"2023-09-29T23:23:45.458032+0000","last_peered":"2023-09-29T23:23:45.458032+0000","last_clean":"2023-09-29T23:23:45.458032+0000","last_became_active":"2023-09-29T23:23:45.457799+0000","last_became_peered":"2023-09-29T23:23:45.457799+0000","last_unstale":"2023-09-29T23:23:45.458032+0000","last_undegraded":"2023-09-29T23:23:45.458032+0000","last_fullsized":"2023-09-29T23:23:45.458032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:21:07.207937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467967+0000","last_change":"2023-09-29T23:23:45.467967+0000","last_active":"2023-09-29T23:23:45.467967+0000","last_peered":"2023-09-29T23:23:45.467967+0000","last_clean":"2023-09-29T23:23:45.467967+0000","last_became_active":"2023-09-29T23:23:45.467730+0000","last_became_peered":"2023-09-29T23:23:45.467730+0000","last_unstale":"2023-09-29T23:23:45.467967+0000","last_undegraded":"2023-09-29T23:23:45.467967+0000","last_fullsized":"2023-09-29T23:23:45.467967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:23:19.840400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.451173+0000","last_change":"2023-09-29T23:23:45.092553+0000","last_active":"2023-09-29T23:23:45.451173+0000","last_peered":"2023-09-29T23:23:45.451173+0000","last_clean":"2023-09-29T23:23:45.451173+0000","last_became_active":"2023-09-29T23:23:45.092273+0000","last_became_peered":"2023-09-29T23:23:45.092273+0000","last_unstale":"2023-09-29T23:23:45.451173+0000","last_undegraded":"2023-09-29T23:23:45.451173+0000","last_fullsized":"2023-09-29T23:23:45.451173+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471459+0000","last_change":"2023-09-29T23:23:45.471459+0000","last_active":"2023-09-29T23:23:45.471459+0000","last_peered":"2023-09-29T23:23:45.471459+0000","last_clean":"2023-09-29T23:23:45.471459+0000","last_became_active":"2023-09-29T23:23:45.470917+0000","last_became_peered":"2023-09-29T23:23:45.470917+0000","last_unstale":"2023-09-29T23:23:45.471459+0000","last_undegraded":"2023-09-29T23:23:45.471459+0000","last_fullsized":"2023-09-29T23:23:45.471459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:29:34.889615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.458805+0000","last_change":"2023-09-29T23:23:45.458805+0000","last_active":"2023-09-29T23:23:45.458805+0000","last_peered":"2023-09-29T23:23:45.458805+0000","last_clean":"2023-09-29T23:23:45.458805+0000","last_became_active":"2023-09-29T23:23:45.458585+0000","last_became_peered":"2023-09-29T23:23:45.458585+0000","last_unstale":"2023-09-29T23:23:45.458805+0000","last_undegraded":"2023-09-29T23:23:45.458805+0000","last_fullsized":"2023-09-29T23:23:45.458805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:05:18.350431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"16'6","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.476072+0000","last_change":"2023-09-29T23:23:45.093720+0000","last_active":"2023-09-29T23:23:45.476072+0000","last_peered":"2023-09-29T23:23:45.476072+0000","last_clean":"2023-09-29T23:23:45.476072+0000","last_became_active":"2023-09-29T23:23:45.093487+0000","last_became_peered":"2023-09-29T23:23:45.093487+0000","last_unstale":"2023-09-29T23:23:45.476072+0000","last_undegraded":"2023-09-29T23:23:45.476072+0000","last_fullsized":"2023-09-29T23:23:45.476072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.096689+0000","last_change":"2023-09-29T23:23:45.093148+0000","last_active":"2023-09-29T23:23:45.096689+0000","last_peered":"2023-09-29T23:23:45.096689+0000","last_clean":"2023-09-29T23:23:45.096689+0000","last_became_active":"2023-09-29T23:23:45.092902+0000","last_became_peered":"2023-09-29T23:23:45.092902+0000","last_unstale":"2023-09-29T23:23:45.096689+0000","last_undegraded":"2023-09-29T23:23:45.096689+0000","last_fullsized":"2023-09-29T23:23:45.096689+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"16'8","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475600+0000","last_change":"2023-09-29T23:23:45.091762+0000","last_active":"2023-09-29T23:23:45.475600+0000","last_peered":"2023-09-29T23:23:45.475600+0000","last_clean":"2023-09-29T23:23:45.475600+0000","last_became_active":"2023-09-29T23:23:45.091386+0000","last_became_peered":"2023-09-29T23:23:45.091386+0000","last_unstale":"2023-09-29T23:23:45.475600+0000","last_undegraded":"2023-09-29T23:23:45.475600+0000","last_fullsized":"2023-09-29T23:23:45.475600+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.461421+0000","last_change":"2023-09-29T23:23:45.461421+0000","last_active":"2023-09-29T23:23:45.461421+0000","last_peered":"2023-09-29T23:23:45.461421+0000","last_clean":"2023-09-29T23:23:45.461421+0000","last_became_active":"2023-09-29T23:23:45.460643+0000","last_became_peered":"2023-09-29T23:23:45.460643+0000","last_unstale":"2023-09-29T23:23:45.461421+0000","last_undegraded":"2023-09-29T23:23:45.461421+0000","last_fullsized":"2023-09-29T23:23:45.461421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:12:32.105911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467950+0000","last_change":"2023-09-29T23:23:45.467950+0000","last_active":"2023-09-29T23:23:45.467950+0000","last_peered":"2023-09-29T23:23:45.467950+0000","last_clean":"2023-09-29T23:23:45.467950+0000","last_became_active":"2023-09-29T23:23:45.467555+0000","last_became_peered":"2023-09-29T23:23:45.467555+0000","last_unstale":"2023-09-29T23:23:45.467950+0000","last_undegraded":"2023-09-29T23:23:45.467950+0000","last_fullsized":"2023-09-29T23:23:45.467950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"16'2","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467306+0000","last_change":"2023-09-29T23:23:45.092471+0000","last_active":"2023-09-29T23:23:45.467306+0000","last_peered":"2023-09-29T23:23:45.467306+0000","last_clean":"2023-09-29T23:23:45.467306+0000","last_became_active":"2023-09-29T23:23:45.092185+0000","last_became_peered":"2023-09-29T23:23:45.092185+0000","last_unstale":"2023-09-29T23:23:45.467306+0000","last_undegraded":"2023-09-29T23:23:45.467306+0000","last_fullsized":"2023-09-29T23:23:45.467306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.096676+0000","last_change":"2023-09-29T23:23:45.092714+0000","last_active":"2023-09-29T23:23:45.096676+0000","last_peered":"2023-09-29T23:23:45.096676+0000","last_clean":"2023-09-29T23:23:45.096676+0000","last_became_active":"2023-09-29T23:23:45.092476+0000","last_became_peered":"2023-09-29T23:23:45.092476+0000","last_unstale":"2023-09-29T23:23:45.096676+0000","last_undegraded":"2023-09-29T23:23:45.096676+0000","last_fullsized":"2023-09-29T23:23:45.096676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:20:23.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.463124+0000","last_change":"2023-09-29T23:23:45.463124+0000","last_active":"2023-09-29T23:23:45.463124+0000","last_peered":"2023-09-29T23:23:45.463124+0000","last_clean":"2023-09-29T23:23:45.463124+0000","last_became_active":"2023-09-29T23:23:45.462583+0000","last_became_peered":"2023-09-29T23:23:45.462583+0000","last_unstale":"2023-09-29T23:23:45.463124+0000","last_undegraded":"2023-09-29T23:23:45.463124+0000","last_fullsized":"2023-09-29T23:23:45.463124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:01:57.571277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.085622+0000","last_change":"2023-09-29T23:23:41.047954+0000","last_active":"2023-09-29T23:23:45.085622+0000","last_peered":"2023-09-29T23:23:45.085622+0000","last_clean":"2023-09-29T23:23:45.085622+0000","last_became_active":"2023-09-29T23:23:41.047701+0000","last_became_peered":"2023-09-29T23:23:41.047701+0000","last_unstale":"2023-09-29T23:23:45.085622+0000","last_undegraded":"2023-09-29T23:23:45.085622+0000","last_fullsized":"2023-09-29T23:23:45.085622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:08:35.252580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.460164+0000","last_change":"2023-09-29T23:23:45.460164+0000","last_active":"2023-09-29T23:23:45.460164+0000","last_peered":"2023-09-29T23:23:45.460164+0000","last_clean":"2023-09-29T23:23:45.460164+0000","last_became_active":"2023-09-29T23:23:45.459933+0000","last_became_peered":"2023-09-29T23:23:45.459933+0000","last_unstale":"2023-09-29T23:23:45.460164+0000","last_undegraded":"2023-09-29T23:23:45.460164+0000","last_fullsized":"2023-09-29T23:23:45.460164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:25:22.017530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-29T23:23:41.052188+0000","last_change":"2023-09-29T23:23:41.051640+0000","last_active":"2023-09-29T23:23:41.052188+0000","last_peered":"2023-09-29T23:23:41.052188+0000","last_clean":"2023-09-29T23:23:41.052188+0000","last_became_active":"2023-09-29T23:23:41.051398+0000","last_became_peered":"2023-09-29T23:23:41.051398+0000","last_unstale":"2023-09-29T23:23:41.052188+0000","last_undegraded":"2023-09-29T23:23:41.052188+0000","last_fullsized":"2023-09-29T23:23:41.052188+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:49:47.548120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-29T23:23:41.051480+0000","last_change":"2023-09-29T23:23:41.050066+0000","last_active":"2023-09-29T23:23:41.051480+0000","last_peered":"2023-09-29T23:23:41.051480+0000","last_clean":"2023-09-29T23:23:41.051480+0000","last_became_active":"2023-09-29T23:23:41.049786+0000","last_became_peered":"2023-09-29T23:23:41.049786+0000","last_unstale":"2023-09-29T23:23:41.051480+0000","last_undegraded":"2023-09-29T23:23:41.051480+0000","last_fullsized":"2023-09-29T23:23:41.051480+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:22:54.699446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.096616+0000","last_change":"2023-09-29T23:23:45.091590+0000","last_active":"2023-09-29T23:23:45.096616+0000","last_peered":"2023-09-29T23:23:45.096616+0000","last_clean":"2023-09-29T23:23:45.096616+0000","last_became_active":"2023-09-29T23:23:45.091162+0000","last_became_peered":"2023-09-29T23:23:45.091162+0000","last_unstale":"2023-09-29T23:23:45.096616+0000","last_undegraded":"2023-09-29T23:23:45.096616+0000","last_fullsized":"2023-09-29T23:23:45.096616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:29:38.240697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-29T23:23:41.051835+0000","last_change":"2023-09-29T23:23:41.049685+0000","last_active":"2023-09-29T23:23:41.051835+0000","last_peered":"2023-09-29T23:23:41.051835+0000","last_clean":"2023-09-29T23:23:41.051835+0000","last_became_active":"2023-09-29T23:23:41.049442+0000","last_became_peered":"2023-09-29T23:23:41.049442+0000","last_unstale":"2023-09-29T23:23:41.051835+0000","last_undegraded":"2023-09-29T23:23:41.051835+0000","last_fullsized":"2023-09-29T23:23:41.051835+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:52:33.065724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.096707+0000","last_change":"2023-09-29T23:23:45.092293+0000","last_active":"2023-09-29T23:23:45.096707+0000","last_peered":"2023-09-29T23:23:45.096707+0000","last_clean":"2023-09-29T23:23:45.096707+0000","last_became_active":"2023-09-29T23:23:45.092042+0000","last_became_peered":"2023-09-29T23:23:45.092042+0000","last_unstale":"2023-09-29T23:23:45.096707+0000","last_undegraded":"2023-09-29T23:23:45.096707+0000","last_fullsized":"2023-09-29T23:23:45.096707+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:07:16.838088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-29T23:23:41.052007+0000","last_change":"2023-09-29T23:23:41.051041+0000","last_active":"2023-09-29T23:23:41.052007+0000","last_peered":"2023-09-29T23:23:41.052007+0000","last_clean":"2023-09-29T23:23:41.052007+0000","last_became_active":"2023-09-29T23:23:41.050731+0000","last_became_peered":"2023-09-29T23:23:41.050731+0000","last_unstale":"2023-09-29T23:23:41.052007+0000","last_undegraded":"2023-09-29T23:23:41.052007+0000","last_fullsized":"2023-09-29T23:23:41.052007+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:20.303147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.084530+0000","last_change":"2023-09-29T23:23:41.047062+0000","last_active":"2023-09-29T23:23:45.084530+0000","last_peered":"2023-09-29T23:23:45.084530+0000","last_clean":"2023-09-29T23:23:45.084530+0000","last_became_active":"2023-09-29T23:23:41.046803+0000","last_became_peered":"2023-09-29T23:23:41.046803+0000","last_unstale":"2023-09-29T23:23:45.084530+0000","last_undegraded":"2023-09-29T23:23:45.084530+0000","last_fullsized":"2023-09-29T23:23:45.084530+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:22:14.657466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-29T23:23:41.052000+0000","last_change":"2023-09-29T23:23:41.050883+0000","last_active":"2023-09-29T23:23:41.052000+0000","last_peered":"2023-09-29T23:23:41.052000+0000","last_clean":"2023-09-29T23:23:41.052000+0000","last_became_active":"2023-09-29T23:23:41.050639+0000","last_became_peered":"2023-09-29T23:23:41.050639+0000","last_unstale":"2023-09-29T23:23:41.052000+0000","last_undegraded":"2023-09-29T23:23:41.052000+0000","last_fullsized":"2023-09-29T23:23:41.052000+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:35:26.897753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-29T23:23:41.051456+0000","last_change":"2023-09-29T23:23:41.050074+0000","last_active":"2023-09-29T23:23:41.051456+0000","last_peered":"2023-09-29T23:23:41.051456+0000","last_clean":"2023-09-29T23:23:41.051456+0000","last_became_active":"2023-09-29T23:23:41.049783+0000","last_became_peered":"2023-09-29T23:23:41.049783+0000","last_unstale":"2023-09-29T23:23:41.051456+0000","last_undegraded":"2023-09-29T23:23:41.051456+0000","last_fullsized":"2023-09-29T23:23:41.051456+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:37:01.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.459071+0000","last_change":"2023-09-29T23:23:45.459071+0000","last_active":"2023-09-29T23:23:45.459071+0000","last_peered":"2023-09-29T23:23:45.459071+0000","last_clean":"2023-09-29T23:23:45.459071+0000","last_became_active":"2023-09-29T23:23:45.458250+0000","last_became_peered":"2023-09-29T23:23:45.458250+0000","last_unstale":"2023-09-29T23:23:45.459071+0000","last_undegraded":"2023-09-29T23:23:45.459071+0000","last_fullsized":"2023-09-29T23:23:45.459071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471332+0000","last_change":"2023-09-29T23:23:45.471332+0000","last_active":"2023-09-29T23:23:45.471332+0000","last_peered":"2023-09-29T23:23:45.471332+0000","last_clean":"2023-09-29T23:23:45.471332+0000","last_became_active":"2023-09-29T23:23:45.471013+0000","last_became_peered":"2023-09-29T23:23:45.471013+0000","last_unstale":"2023-09-29T23:23:45.471332+0000","last_undegraded":"2023-09-29T23:23:45.471332+0000","last_fullsized":"2023-09-29T23:23:45.471332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.448700+0000","last_change":"2023-09-29T23:23:45.092434+0000","last_active":"2023-09-29T23:23:45.448700+0000","last_peered":"2023-09-29T23:23:45.448700+0000","last_clean":"2023-09-29T23:23:45.448700+0000","last_became_active":"2023-09-29T23:23:45.092203+0000","last_became_peered":"2023-09-29T23:23:45.092203+0000","last_unstale":"2023-09-29T23:23:45.448700+0000","last_undegraded":"2023-09-29T23:23:45.448700+0000","last_fullsized":"2023-09-29T23:23:45.448700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.460786+0000","last_change":"2023-09-29T23:23:45.460786+0000","last_active":"2023-09-29T23:23:45.460786+0000","last_peered":"2023-09-29T23:23:45.460786+0000","last_clean":"2023-09-29T23:23:45.460786+0000","last_became_active":"2023-09-29T23:23:45.460548+0000","last_became_peered":"2023-09-29T23:23:45.460548+0000","last_unstale":"2023-09-29T23:23:45.460786+0000","last_undegraded":"2023-09-29T23:23:45.460786+0000","last_fullsized":"2023-09-29T23:23:45.460786+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:09:25.160546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471512+0000","last_change":"2023-09-29T23:23:45.471512+0000","last_active":"2023-09-29T23:23:45.471512+0000","last_peered":"2023-09-29T23:23:45.471512+0000","last_clean":"2023-09-29T23:23:45.471512+0000","last_became_active":"2023-09-29T23:23:45.471294+0000","last_became_peered":"2023-09-29T23:23:45.471294+0000","last_unstale":"2023-09-29T23:23:45.471512+0000","last_undegraded":"2023-09-29T23:23:45.471512+0000","last_fullsized":"2023-09-29T23:23:45.471512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:29:14.066786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.462314+0000","last_change":"2023-09-29T23:23:45.462314+0000","last_active":"2023-09-29T23:23:45.462314+0000","last_peered":"2023-09-29T23:23:45.462314+0000","last_clean":"2023-09-29T23:23:45.462314+0000","last_became_active":"2023-09-29T23:23:45.461188+0000","last_became_peered":"2023-09-29T23:23:45.461188+0000","last_unstale":"2023-09-29T23:23:45.462314+0000","last_undegraded":"2023-09-29T23:23:45.462314+0000","last_fullsized":"2023-09-29T23:23:45.462314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:01:06.913634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1536,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":18,"acting":18,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5112,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":104852488,"statfs":{"total":107374182400,"available":107368947712,"internally_reserved":0,"allocated":114688,"data_stored":28723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]}]},{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5412,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":104852188,"statfs":{"total":107374182400,"available":107368640512,"internally_reserved":0,"allocated":159744,"data_stored":42205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5112,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":104852488,"statfs":{"total":107374182400,"available":107368947712,"internally_reserved":0,"allocated":114688,"data_stored":28723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-29T23:23:49.474 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:23:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.619+0000 7fd141b74700 1 Processor -- start 2023-09-29T23:23:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.620+0000 7fd141b74700 1 -- start start 2023-09-29T23:23:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.620+0000 7fd141b74700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd13c0a3030 0x7fd13c12f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.620+0000 7fd141b74700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13c0997f0 con 0x7fd13c12fae0 2023-09-29T23:23:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.620+0000 7fd141b74700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13c0a3400 con 0x7fd13c0a3030 2023-09-29T23:23:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.620+0000 7fd13b7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd13c0a3030 0x7fd13c12f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.620+0000 7fd13affd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fd13c12fae0 0x7fd13c095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43770/0 (socket says 172.21.15.92:43770) 2023-09-29T23:23:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.620+0000 7fd13affd700 1 -- 172.21.15.92:0/2902061064 learned_addr learned my addr 172.21.15.92:0/2902061064 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.620+0000 7fd13b7fe700 1 -- 172.21.15.92:0/2902061064 >> v1:172.21.15.92:6789/0 conn(0x7fd13c12fae0 legacy=0x7fd13c095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:49.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.620+0000 7fd13b7fe700 1 -- 172.21.15.92:0/2902061064 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c0977a0 con 0x7fd13c0a3030 2023-09-29T23:23:49.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.620+0000 7fd13b7fe700 1 --2- 172.21.15.92:0/2902061064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd13c0a3030 0x7fd13c12f5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009de0 tx=0x7fd12c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d584e73dbac2fd6e server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:49.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.621+0000 7fd13a7fc700 1 -- 172.21.15.92:0/2902061064 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd12c00e070 con 0x7fd13c0a3030 2023-09-29T23:23:49.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.621+0000 7fd13a7fc700 1 -- 172.21.15.92:0/2902061064 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c00bd10 con 0x7fd13c0a3030 2023-09-29T23:23:49.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.621+0000 7fd13a7fc700 1 -- 172.21.15.92:0/2902061064 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd12c012430 con 0x7fd13c0a3030 2023-09-29T23:23:49.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.621+0000 7fd141b74700 1 -- 172.21.15.92:0/2902061064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd13c0a3030 msgr2=0x7fd13c12f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:49.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.621+0000 7fd141b74700 1 --2- 172.21.15.92:0/2902061064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd13c0a3030 0x7fd13c12f5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009de0 tx=0x7fd12c009780 comp rx=0 tx=0).stop 2023-09-29T23:23:49.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.621+0000 7fd141b74700 1 -- 172.21.15.92:0/2902061064 shutdown_connections 2023-09-29T23:23:49.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.621+0000 7fd141b74700 1 --2- 172.21.15.92:0/2902061064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd13c0a3030 0x7fd13c12f5a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:49.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.621+0000 7fd141b74700 1 -- 172.21.15.92:0/2902061064 >> 172.21.15.92:0/2902061064 conn(0x7fd13c067fc0 msgr2=0x7fd13c0a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:49.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.621+0000 7fd141b74700 1 -- 172.21.15.92:0/2902061064 shutdown_connections 2023-09-29T23:23:49.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.621+0000 7fd141b74700 1 -- 172.21.15.92:0/2902061064 wait complete. 2023-09-29T23:23:49.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.622+0000 7fd141b74700 1 Processor -- start 2023-09-29T23:23:49.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.622+0000 7fd141b74700 1 -- start start 2023-09-29T23:23:49.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.622+0000 7fd141b74700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd13c0a3030 0x7fd13c12c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:49.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.622+0000 7fd141b74700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c11daa0 con 0x7fd13c0a3030 2023-09-29T23:23:49.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.623+0000 7fd13b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd13c0a3030 0x7fd13c12c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:49.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.623+0000 7fd13b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd13c0a3030 0x7fd13c12c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37024/0 (socket says 172.21.15.92:37024) 2023-09-29T23:23:49.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.623+0000 7fd13b7fe700 1 -- 172.21.15.92:0/1724785729 learned_addr learned my addr 172.21.15.92:0/1724785729 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:49.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.623+0000 7fd13b7fe700 1 -- 172.21.15.92:0/1724785729 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c009a20 con 0x7fd13c0a3030 2023-09-29T23:23:49.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.623+0000 7fd13b7fe700 1 --2- 172.21.15.92:0/1724785729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd13c0a3030 0x7fd13c12c400 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0099f0 tx=0x7fd12c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:49.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.623+0000 7fd1237fe700 1 -- 172.21.15.92:0/1724785729 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd12c01d640 con 0x7fd13c0a3030 2023-09-29T23:23:49.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.623+0000 7fd1237fe700 1 -- 172.21.15.92:0/1724785729 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c01d7a0 con 0x7fd13c0a3030 2023-09-29T23:23:49.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.623+0000 7fd141b74700 1 -- 172.21.15.92:0/1724785729 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13c11be40 con 0x7fd13c0a3030 2023-09-29T23:23:49.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.623+0000 7fd1237fe700 1 -- 172.21.15.92:0/1724785729 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd12c01da90 con 0x7fd13c0a3030 2023-09-29T23:23:49.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.623+0000 7fd141b74700 1 -- 172.21.15.92:0/1724785729 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13c11c6a0 con 0x7fd13c0a3030 2023-09-29T23:23:49.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.624+0000 7fd1237fe700 1 -- 172.21.15.92:0/1724785729 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fd12c024070 con 0x7fd13c0a3030 2023-09-29T23:23:49.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.624+0000 7fd141b74700 1 -- 172.21.15.92:0/1724785729 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13c11bcb0 con 0x7fd13c0a3030 2023-09-29T23:23:49.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.624+0000 7fd1237fe700 1 --2- 172.21.15.92:0/1724785729 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd128035640 0x7fd128037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:49.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.624+0000 7fd1237fe700 1 -- 172.21.15.92:0/1724785729 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7fd12c04a290 con 0x7fd13c0a3030 2023-09-29T23:23:49.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.624+0000 7fd13affd700 1 --2- 172.21.15.92:0/1724785729 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd128035640 0x7fd128037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:49.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.625+0000 7fd13affd700 1 --2- 172.21.15.92:0/1724785729 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd128035640 0x7fd128037af0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd1300016a0 tx=0x7fd130007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:49.629 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.629+0000 7fd1237fe700 1 -- 172.21.15.92:0/1724785729 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd12c01cd80 con 0x7fd13c0a3030 2023-09-29T23:23:49.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.806+0000 7fd141b74700 1 -- 172.21.15.92:0/1724785729 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd13c05f230 con 0x7fd128035640 2023-09-29T23:23:49.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.812+0000 7fd1237fe700 1 -- 172.21.15.92:0/1724785729 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253632 (secure 0 0 0) 0x7fd13c05f230 con 0x7fd128035640 2023-09-29T23:23:49.815 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:49.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.815+0000 7fd141b74700 1 -- 172.21.15.92:0/1724785729 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd128035640 msgr2=0x7fd128037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:49.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.815+0000 7fd141b74700 1 --2- 172.21.15.92:0/1724785729 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd128035640 0x7fd128037af0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd1300016a0 tx=0x7fd130007b30 comp rx=0 tx=0).stop 2023-09-29T23:23:49.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.815+0000 7fd141b74700 1 -- 172.21.15.92:0/1724785729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd13c0a3030 msgr2=0x7fd13c12c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:49.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.815+0000 7fd141b74700 1 --2- 172.21.15.92:0/1724785729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd13c0a3030 0x7fd13c12c400 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0099f0 tx=0x7fd12c018000 comp rx=0 tx=0).stop 2023-09-29T23:23:49.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.815+0000 7fd141b74700 1 -- 172.21.15.92:0/1724785729 shutdown_connections 2023-09-29T23:23:49.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.815+0000 7fd141b74700 1 --2- 172.21.15.92:0/1724785729 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd128035640 0x7fd128037af0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:49.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.815+0000 7fd141b74700 1 --2- 172.21.15.92:0/1724785729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd13c0a3030 0x7fd13c12c400 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:49.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.815+0000 7fd141b74700 1 -- 172.21.15.92:0/1724785729 >> 172.21.15.92:0/1724785729 conn(0x7fd13c067fc0 msgr2=0x7fd13c12d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:49.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.815+0000 7fd141b74700 1 -- 172.21.15.92:0/1724785729 shutdown_connections 2023-09-29T23:23:49.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.815+0000 7fd141b74700 1 -- 172.21.15.92:0/1724785729 wait complete. 2023-09-29T23:23:49.818 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-09-29T23:23:49.827 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-09-29T23:23:48.035447+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1536,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":70,"acting":70,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":15636,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":15232,"kb_avail":314557164,"statfs":{"total":322122547200,"available":322106535936,"internally_reserved":0,"allocated":389120,"data_stored":99651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15597568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471200+0000","last_change":"2023-09-29T23:23:45.471200+0000","last_active":"2023-09-29T23:23:45.471200+0000","last_peered":"2023-09-29T23:23:45.471200+0000","last_clean":"2023-09-29T23:23:45.471200+0000","last_became_active":"2023-09-29T23:23:45.470971+0000","last_became_peered":"2023-09-29T23:23:45.470971+0000","last_unstale":"2023-09-29T23:23:45.471200+0000","last_undegraded":"2023-09-29T23:23:45.471200+0000","last_fullsized":"2023-09-29T23:23:45.471200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:29:34.531515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470583+0000","last_change":"2023-09-29T23:23:45.470583+0000","last_active":"2023-09-29T23:23:45.470583+0000","last_peered":"2023-09-29T23:23:45.470583+0000","last_clean":"2023-09-29T23:23:45.470583+0000","last_became_active":"2023-09-29T23:23:45.470349+0000","last_became_peered":"2023-09-29T23:23:45.470349+0000","last_unstale":"2023-09-29T23:23:45.470583+0000","last_undegraded":"2023-09-29T23:23:45.470583+0000","last_fullsized":"2023-09-29T23:23:45.470583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:50:32.868236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.463286+0000","last_change":"2023-09-29T23:23:45.463286+0000","last_active":"2023-09-29T23:23:45.463286+0000","last_peered":"2023-09-29T23:23:45.463286+0000","last_clean":"2023-09-29T23:23:45.463286+0000","last_became_active":"2023-09-29T23:23:45.462888+0000","last_became_peered":"2023-09-29T23:23:45.462888+0000","last_unstale":"2023-09-29T23:23:45.463286+0000","last_undegraded":"2023-09-29T23:23:45.463286+0000","last_fullsized":"2023-09-29T23:23:45.463286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471536+0000","last_change":"2023-09-29T23:23:45.471536+0000","last_active":"2023-09-29T23:23:45.471536+0000","last_peered":"2023-09-29T23:23:45.471536+0000","last_clean":"2023-09-29T23:23:45.471536+0000","last_became_active":"2023-09-29T23:23:45.471334+0000","last_became_peered":"2023-09-29T23:23:45.471334+0000","last_unstale":"2023-09-29T23:23:45.471536+0000","last_undegraded":"2023-09-29T23:23:45.471536+0000","last_fullsized":"2023-09-29T23:23:45.471536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467819+0000","last_change":"2023-09-29T23:23:45.467819+0000","last_active":"2023-09-29T23:23:45.467819+0000","last_peered":"2023-09-29T23:23:45.467819+0000","last_clean":"2023-09-29T23:23:45.467819+0000","last_became_active":"2023-09-29T23:23:45.467434+0000","last_became_peered":"2023-09-29T23:23:45.467434+0000","last_unstale":"2023-09-29T23:23:45.467819+0000","last_undegraded":"2023-09-29T23:23:45.467819+0000","last_fullsized":"2023-09-29T23:23:45.467819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.458032+0000","last_change":"2023-09-29T23:23:45.458032+0000","last_active":"2023-09-29T23:23:45.458032+0000","last_peered":"2023-09-29T23:23:45.458032+0000","last_clean":"2023-09-29T23:23:45.458032+0000","last_became_active":"2023-09-29T23:23:45.457799+0000","last_became_peered":"2023-09-29T23:23:45.457799+0000","last_unstale":"2023-09-29T23:23:45.458032+0000","last_undegraded":"2023-09-29T23:23:45.458032+0000","last_fullsized":"2023-09-29T23:23:45.458032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:21:07.207937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467967+0000","last_change":"2023-09-29T23:23:45.467967+0000","last_active":"2023-09-29T23:23:45.467967+0000","last_peered":"2023-09-29T23:23:45.467967+0000","last_clean":"2023-09-29T23:23:45.467967+0000","last_became_active":"2023-09-29T23:23:45.467730+0000","last_became_peered":"2023-09-29T23:23:45.467730+0000","last_unstale":"2023-09-29T23:23:45.467967+0000","last_undegraded":"2023-09-29T23:23:45.467967+0000","last_fullsized":"2023-09-29T23:23:45.467967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:23:19.840400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.451173+0000","last_change":"2023-09-29T23:23:45.092553+0000","last_active":"2023-09-29T23:23:45.451173+0000","last_peered":"2023-09-29T23:23:45.451173+0000","last_clean":"2023-09-29T23:23:45.451173+0000","last_became_active":"2023-09-29T23:23:45.092273+0000","last_became_peered":"2023-09-29T23:23:45.092273+0000","last_unstale":"2023-09-29T23:23:45.451173+0000","last_undegraded":"2023-09-29T23:23:45.451173+0000","last_fullsized":"2023-09-29T23:23:45.451173+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471459+0000","last_change":"2023-09-29T23:23:45.471459+0000","last_active":"2023-09-29T23:23:45.471459+0000","last_peered":"2023-09-29T23:23:45.471459+0000","last_clean":"2023-09-29T23:23:45.471459+0000","last_became_active":"2023-09-29T23:23:45.470917+0000","last_became_peered":"2023-09-29T23:23:45.470917+0000","last_unstale":"2023-09-29T23:23:45.471459+0000","last_undegraded":"2023-09-29T23:23:45.471459+0000","last_fullsized":"2023-09-29T23:23:45.471459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:29:34.889615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.458805+0000","last_change":"2023-09-29T23:23:45.458805+0000","last_active":"2023-09-29T23:23:45.458805+0000","last_peered":"2023-09-29T23:23:45.458805+0000","last_clean":"2023-09-29T23:23:45.458805+0000","last_became_active":"2023-09-29T23:23:45.458585+0000","last_became_peered":"2023-09-29T23:23:45.458585+0000","last_unstale":"2023-09-29T23:23:45.458805+0000","last_undegraded":"2023-09-29T23:23:45.458805+0000","last_fullsized":"2023-09-29T23:23:45.458805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:05:18.350431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"16'6","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.476072+0000","last_change":"2023-09-29T23:23:45.093720+0000","last_active":"2023-09-29T23:23:45.476072+0000","last_peered":"2023-09-29T23:23:45.476072+0000","last_clean":"2023-09-29T23:23:45.476072+0000","last_became_active":"2023-09-29T23:23:45.093487+0000","last_became_peered":"2023-09-29T23:23:45.093487+0000","last_unstale":"2023-09-29T23:23:45.476072+0000","last_undegraded":"2023-09-29T23:23:45.476072+0000","last_fullsized":"2023-09-29T23:23:45.476072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.096689+0000","last_change":"2023-09-29T23:23:45.093148+0000","last_active":"2023-09-29T23:23:45.096689+0000","last_peered":"2023-09-29T23:23:45.096689+0000","last_clean":"2023-09-29T23:23:45.096689+0000","last_became_active":"2023-09-29T23:23:45.092902+0000","last_became_peered":"2023-09-29T23:23:45.092902+0000","last_unstale":"2023-09-29T23:23:45.096689+0000","last_undegraded":"2023-09-29T23:23:45.096689+0000","last_fullsized":"2023-09-29T23:23:45.096689+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"16'8","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475600+0000","last_change":"2023-09-29T23:23:45.091762+0000","last_active":"2023-09-29T23:23:45.475600+0000","last_peered":"2023-09-29T23:23:45.475600+0000","last_clean":"2023-09-29T23:23:45.475600+0000","last_became_active":"2023-09-29T23:23:45.091386+0000","last_became_peered":"2023-09-29T23:23:45.091386+0000","last_unstale":"2023-09-29T23:23:45.475600+0000","last_undegraded":"2023-09-29T23:23:45.475600+0000","last_fullsized":"2023-09-29T23:23:45.475600+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.461421+0000","last_change":"2023-09-29T23:23:45.461421+0000","last_active":"2023-09-29T23:23:45.461421+0000","last_peered":"2023-09-29T23:23:45.461421+0000","last_clean":"2023-09-29T23:23:45.461421+0000","last_became_active":"2023-09-29T23:23:45.460643+0000","last_became_peered":"2023-09-29T23:23:45.460643+0000","last_unstale":"2023-09-29T23:23:45.461421+0000","last_undegraded":"2023-09-29T23:23:45.461421+0000","last_fullsized":"2023-09-29T23:23:45.461421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:12:32.105911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467950+0000","last_change":"2023-09-29T23:23:45.467950+0000","last_active":"2023-09-29T23:23:45.467950+0000","last_peered":"2023-09-29T23:23:45.467950+0000","last_clean":"2023-09-29T23:23:45.467950+0000","last_became_active":"2023-09-29T23:23:45.467555+0000","last_became_peered":"2023-09-29T23:23:45.467555+0000","last_unstale":"2023-09-29T23:23:45.467950+0000","last_undegraded":"2023-09-29T23:23:45.467950+0000","last_fullsized":"2023-09-29T23:23:45.467950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"16'2","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467306+0000","last_change":"2023-09-29T23:23:45.092471+0000","last_active":"2023-09-29T23:23:45.467306+0000","last_peered":"2023-09-29T23:23:45.467306+0000","last_clean":"2023-09-29T23:23:45.467306+0000","last_became_active":"2023-09-29T23:23:45.092185+0000","last_became_peered":"2023-09-29T23:23:45.092185+0000","last_unstale":"2023-09-29T23:23:45.467306+0000","last_undegraded":"2023-09-29T23:23:45.467306+0000","last_fullsized":"2023-09-29T23:23:45.467306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.096676+0000","last_change":"2023-09-29T23:23:45.092714+0000","last_active":"2023-09-29T23:23:45.096676+0000","last_peered":"2023-09-29T23:23:45.096676+0000","last_clean":"2023-09-29T23:23:45.096676+0000","last_became_active":"2023-09-29T23:23:45.092476+0000","last_became_peered":"2023-09-29T23:23:45.092476+0000","last_unstale":"2023-09-29T23:23:45.096676+0000","last_undegraded":"2023-09-29T23:23:45.096676+0000","last_fullsized":"2023-09-29T23:23:45.096676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:20:23.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.463124+0000","last_change":"2023-09-29T23:23:45.463124+0000","last_active":"2023-09-29T23:23:45.463124+0000","last_peered":"2023-09-29T23:23:45.463124+0000","last_clean":"2023-09-29T23:23:45.463124+0000","last_became_active":"2023-09-29T23:23:45.462583+0000","last_became_peered":"2023-09-29T23:23:45.462583+0000","last_unstale":"2023-09-29T23:23:45.463124+0000","last_undegraded":"2023-09-29T23:23:45.463124+0000","last_fullsized":"2023-09-29T23:23:45.463124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:01:57.571277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.085622+0000","last_change":"2023-09-29T23:23:41.047954+0000","last_active":"2023-09-29T23:23:45.085622+0000","last_peered":"2023-09-29T23:23:45.085622+0000","last_clean":"2023-09-29T23:23:45.085622+0000","last_became_active":"2023-09-29T23:23:41.047701+0000","last_became_peered":"2023-09-29T23:23:41.047701+0000","last_unstale":"2023-09-29T23:23:45.085622+0000","last_undegraded":"2023-09-29T23:23:45.085622+0000","last_fullsized":"2023-09-29T23:23:45.085622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:08:35.252580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.460164+0000","last_change":"2023-09-29T23:23:45.460164+0000","last_active":"2023-09-29T23:23:45.460164+0000","last_peered":"2023-09-29T23:23:45.460164+0000","last_clean":"2023-09-29T23:23:45.460164+0000","last_became_active":"2023-09-29T23:23:45.459933+0000","last_became_peered":"2023-09-29T23:23:45.459933+0000","last_unstale":"2023-09-29T23:23:45.460164+0000","last_undegraded":"2023-09-29T23:23:45.460164+0000","last_fullsized":"2023-09-29T23:23:45.460164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:25:22.017530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-29T23:23:41.052188+0000","last_change":"2023-09-29T23:23:41.051640+0000","last_active":"2023-09-29T23:23:41.052188+0000","last_peered":"2023-09-29T23:23:41.052188+0000","last_clean":"2023-09-29T23:23:41.052188+0000","last_became_active":"2023-09-29T23:23:41.051398+0000","last_became_peered":"2023-09-29T23:23:41.051398+0000","last_unstale":"2023-09-29T23:23:41.052188+0000","last_undegraded":"2023-09-29T23:23:41.052188+0000","last_fullsized":"2023-09-29T23:23:41.052188+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:49:47.548120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-29T23:23:41.051480+0000","last_change":"2023-09-29T23:23:41.050066+0000","last_active":"2023-09-29T23:23:41.051480+0000","last_peered":"2023-09-29T23:23:41.051480+0000","last_clean":"2023-09-29T23:23:41.051480+0000","last_became_active":"2023-09-29T23:23:41.049786+0000","last_became_peered":"2023-09-29T23:23:41.049786+0000","last_unstale":"2023-09-29T23:23:41.051480+0000","last_undegraded":"2023-09-29T23:23:41.051480+0000","last_fullsized":"2023-09-29T23:23:41.051480+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:22:54.699446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.096616+0000","last_change":"2023-09-29T23:23:45.091590+0000","last_active":"2023-09-29T23:23:45.096616+0000","last_peered":"2023-09-29T23:23:45.096616+0000","last_clean":"2023-09-29T23:23:45.096616+0000","last_became_active":"2023-09-29T23:23:45.091162+0000","last_became_peered":"2023-09-29T23:23:45.091162+0000","last_unstale":"2023-09-29T23:23:45.096616+0000","last_undegraded":"2023-09-29T23:23:45.096616+0000","last_fullsized":"2023-09-29T23:23:45.096616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:29:38.240697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-29T23:23:41.051835+0000","last_change":"2023-09-29T23:23:41.049685+0000","last_active":"2023-09-29T23:23:41.051835+0000","last_peered":"2023-09-29T23:23:41.051835+0000","last_clean":"2023-09-29T23:23:41.051835+0000","last_became_active":"2023-09-29T23:23:41.049442+0000","last_became_peered":"2023-09-29T23:23:41.049442+0000","last_unstale":"2023-09-29T23:23:41.051835+0000","last_undegraded":"2023-09-29T23:23:41.051835+0000","last_fullsized":"2023-09-29T23:23:41.051835+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:52:33.065724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.096707+0000","last_change":"2023-09-29T23:23:45.092293+0000","last_active":"2023-09-29T23:23:45.096707+0000","last_peered":"2023-09-29T23:23:45.096707+0000","last_clean":"2023-09-29T23:23:45.096707+0000","last_became_active":"2023-09-29T23:23:45.092042+0000","last_became_peered":"2023-09-29T23:23:45.092042+0000","last_unstale":"2023-09-29T23:23:45.096707+0000","last_undegraded":"2023-09-29T23:23:45.096707+0000","last_fullsized":"2023-09-29T23:23:45.096707+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:07:16.838088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-29T23:23:41.052007+0000","last_change":"2023-09-29T23:23:41.051041+0000","last_active":"2023-09-29T23:23:41.052007+0000","last_peered":"2023-09-29T23:23:41.052007+0000","last_clean":"2023-09-29T23:23:41.052007+0000","last_became_active":"2023-09-29T23:23:41.050731+0000","last_became_peered":"2023-09-29T23:23:41.050731+0000","last_unstale":"2023-09-29T23:23:41.052007+0000","last_undegraded":"2023-09-29T23:23:41.052007+0000","last_fullsized":"2023-09-29T23:23:41.052007+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:20.303147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.084530+0000","last_change":"2023-09-29T23:23:41.047062+0000","last_active":"2023-09-29T23:23:45.084530+0000","last_peered":"2023-09-29T23:23:45.084530+0000","last_clean":"2023-09-29T23:23:45.084530+0000","last_became_active":"2023-09-29T23:23:41.046803+0000","last_became_peered":"2023-09-29T23:23:41.046803+0000","last_unstale":"2023-09-29T23:23:45.084530+0000","last_undegraded":"2023-09-29T23:23:45.084530+0000","last_fullsized":"2023-09-29T23:23:45.084530+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:22:14.657466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-29T23:23:41.052000+0000","last_change":"2023-09-29T23:23:41.050883+0000","last_active":"2023-09-29T23:23:41.052000+0000","last_peered":"2023-09-29T23:23:41.052000+0000","last_clean":"2023-09-29T23:23:41.052000+0000","last_became_active":"2023-09-29T23:23:41.050639+0000","last_became_peered":"2023-09-29T23:23:41.050639+0000","last_unstale":"2023-09-29T23:23:41.052000+0000","last_undegraded":"2023-09-29T23:23:41.052000+0000","last_fullsized":"2023-09-29T23:23:41.052000+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:35:26.897753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-29T23:23:41.051456+0000","last_change":"2023-09-29T23:23:41.050074+0000","last_active":"2023-09-29T23:23:41.051456+0000","last_peered":"2023-09-29T23:23:41.051456+0000","last_clean":"2023-09-29T23:23:41.051456+0000","last_became_active":"2023-09-29T23:23:41.049783+0000","last_became_peered":"2023-09-29T23:23:41.049783+0000","last_unstale":"2023-09-29T23:23:41.051456+0000","last_undegraded":"2023-09-29T23:23:41.051456+0000","last_fullsized":"2023-09-29T23:23:41.051456+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:37:01.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.459071+0000","last_change":"2023-09-29T23:23:45.459071+0000","last_active":"2023-09-29T23:23:45.459071+0000","last_peered":"2023-09-29T23:23:45.459071+0000","last_clean":"2023-09-29T23:23:45.459071+0000","last_became_active":"2023-09-29T23:23:45.458250+0000","last_became_peered":"2023-09-29T23:23:45.458250+0000","last_unstale":"2023-09-29T23:23:45.459071+0000","last_undegraded":"2023-09-29T23:23:45.459071+0000","last_fullsized":"2023-09-29T23:23:45.459071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471332+0000","last_change":"2023-09-29T23:23:45.471332+0000","last_active":"2023-09-29T23:23:45.471332+0000","last_peered":"2023-09-29T23:23:45.471332+0000","last_clean":"2023-09-29T23:23:45.471332+0000","last_became_active":"2023-09-29T23:23:45.471013+0000","last_became_peered":"2023-09-29T23:23:45.471013+0000","last_unstale":"2023-09-29T23:23:45.471332+0000","last_undegraded":"2023-09-29T23:23:45.471332+0000","last_fullsized":"2023-09-29T23:23:45.471332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.448700+0000","last_change":"2023-09-29T23:23:45.092434+0000","last_active":"2023-09-29T23:23:45.448700+0000","last_peered":"2023-09-29T23:23:45.448700+0000","last_clean":"2023-09-29T23:23:45.448700+0000","last_became_active":"2023-09-29T23:23:45.092203+0000","last_became_peered":"2023-09-29T23:23:45.092203+0000","last_unstale":"2023-09-29T23:23:45.448700+0000","last_undegraded":"2023-09-29T23:23:45.448700+0000","last_fullsized":"2023-09-29T23:23:45.448700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:44.046567+0000","last_change":"2023-09-29T23:23:44.046567+0000","last_active":"2023-09-29T23:23:44.046567+0000","last_peered":"2023-09-29T23:23:44.046567+0000","last_clean":"2023-09-29T23:23:44.046567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:44.046567+0000","last_undegraded":"2023-09-29T23:23:44.046567+0000","last_fullsized":"2023-09-29T23:23:44.046567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.460786+0000","last_change":"2023-09-29T23:23:45.460786+0000","last_active":"2023-09-29T23:23:45.460786+0000","last_peered":"2023-09-29T23:23:45.460786+0000","last_clean":"2023-09-29T23:23:45.460786+0000","last_became_active":"2023-09-29T23:23:45.460548+0000","last_became_peered":"2023-09-29T23:23:45.460548+0000","last_unstale":"2023-09-29T23:23:45.460786+0000","last_undegraded":"2023-09-29T23:23:45.460786+0000","last_fullsized":"2023-09-29T23:23:45.460786+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:09:25.160546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471512+0000","last_change":"2023-09-29T23:23:45.471512+0000","last_active":"2023-09-29T23:23:45.471512+0000","last_peered":"2023-09-29T23:23:45.471512+0000","last_clean":"2023-09-29T23:23:45.471512+0000","last_became_active":"2023-09-29T23:23:45.471294+0000","last_became_peered":"2023-09-29T23:23:45.471294+0000","last_unstale":"2023-09-29T23:23:45.471512+0000","last_undegraded":"2023-09-29T23:23:45.471512+0000","last_fullsized":"2023-09-29T23:23:45.471512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:29:14.066786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.462314+0000","last_change":"2023-09-29T23:23:45.462314+0000","last_active":"2023-09-29T23:23:45.462314+0000","last_peered":"2023-09-29T23:23:45.462314+0000","last_clean":"2023-09-29T23:23:45.462314+0000","last_became_active":"2023-09-29T23:23:45.461188+0000","last_became_peered":"2023-09-29T23:23:45.461188+0000","last_unstale":"2023-09-29T23:23:45.462314+0000","last_undegraded":"2023-09-29T23:23:45.462314+0000","last_fullsized":"2023-09-29T23:23:45.462314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:01:06.913634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-29T23:23:45.052710+0000","last_change":"2023-09-29T23:23:45.052710+0000","last_active":"2023-09-29T23:23:45.052710+0000","last_peered":"2023-09-29T23:23:45.052710+0000","last_clean":"2023-09-29T23:23:45.052710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-29T23:23:45.052710+0000","last_undegraded":"2023-09-29T23:23:45.052710+0000","last_fullsized":"2023-09-29T23:23:45.052710+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1536,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":18,"acting":18,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5112,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":104852488,"statfs":{"total":107374182400,"available":107368947712,"internally_reserved":0,"allocated":114688,"data_stored":28723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]}]},{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5412,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":104852188,"statfs":{"total":107374182400,"available":107368640512,"internally_reserved":0,"allocated":159744,"data_stored":42205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5112,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":104852488,"statfs":{"total":107374182400,"available":107368947712,"internally_reserved":0,"allocated":114688,"data_stored":28723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-29T23:23:49.832 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:23:49.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.981+0000 7ff38417f700 1 Processor -- start 2023-09-29T23:23:49.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.981+0000 7ff38417f700 1 -- start start 2023-09-29T23:23:49.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.981+0000 7ff38417f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff37c0a3030 0x7ff37c12f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:49.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.981+0000 7ff38417f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37c0997f0 con 0x7ff37c12fae0 2023-09-29T23:23:49.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.981+0000 7ff38417f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37c0a3400 con 0x7ff37c0a3030 2023-09-29T23:23:49.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.982+0000 7ff381f1b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff37c0a3030 0x7ff37c12f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:49.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.982+0000 7ff38171a700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ff37c12fae0 0x7ff37c095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43776/0 (socket says 172.21.15.92:43776) 2023-09-29T23:23:49.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.982+0000 7ff38171a700 1 -- 172.21.15.92:0/791416175 learned_addr learned my addr 172.21.15.92:0/791416175 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:49.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.982+0000 7ff381f1b700 1 -- 172.21.15.92:0/791416175 >> v1:172.21.15.92:6789/0 conn(0x7ff37c12fae0 legacy=0x7ff37c095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:49.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.982+0000 7ff381f1b700 1 -- 172.21.15.92:0/791416175 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c0977a0 con 0x7ff37c0a3030 2023-09-29T23:23:49.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.982+0000 7ff381f1b700 1 --2- 172.21.15.92:0/791416175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff37c0a3030 0x7ff37c12f5a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff378009860 tx=0x7ff3780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88153ae83374663 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:49.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.982+0000 7ff380f19700 1 -- 172.21.15.92:0/791416175 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff37800b710 con 0x7ff37c0a3030 2023-09-29T23:23:49.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.982+0000 7ff380f19700 1 -- 172.21.15.92:0/791416175 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37800b870 con 0x7ff37c0a3030 2023-09-29T23:23:49.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.982+0000 7ff380f19700 1 -- 172.21.15.92:0/791416175 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff37800ba20 con 0x7ff37c0a3030 2023-09-29T23:23:49.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.983+0000 7ff38417f700 1 -- 172.21.15.92:0/791416175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff37c0a3030 msgr2=0x7ff37c12f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:49.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.983+0000 7ff38417f700 1 --2- 172.21.15.92:0/791416175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff37c0a3030 0x7ff37c12f5a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff378009860 tx=0x7ff3780091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:49.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.983+0000 7ff38417f700 1 -- 172.21.15.92:0/791416175 shutdown_connections 2023-09-29T23:23:49.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.983+0000 7ff38417f700 1 --2- 172.21.15.92:0/791416175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff37c0a3030 0x7ff37c12f5a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:49.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.983+0000 7ff38417f700 1 -- 172.21.15.92:0/791416175 >> 172.21.15.92:0/791416175 conn(0x7ff37c067fc0 msgr2=0x7ff37c0a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:49.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.983+0000 7ff38417f700 1 -- 172.21.15.92:0/791416175 shutdown_connections 2023-09-29T23:23:49.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.983+0000 7ff38417f700 1 -- 172.21.15.92:0/791416175 wait complete. 2023-09-29T23:23:49.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.983+0000 7ff38417f700 1 Processor -- start 2023-09-29T23:23:49.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.984+0000 7ff38417f700 1 -- start start 2023-09-29T23:23:49.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.984+0000 7ff38417f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff37c0a3030 0x7ff37c12c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.984+0000 7ff38417f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c11daa0 con 0x7ff37c0a3030 2023-09-29T23:23:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.984+0000 7ff381f1b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff37c0a3030 0x7ff37c12c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.984+0000 7ff381f1b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff37c0a3030 0x7ff37c12c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37050/0 (socket says 172.21.15.92:37050) 2023-09-29T23:23:49.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.984+0000 7ff381f1b700 1 -- 172.21.15.92:0/741273948 learned_addr learned my addr 172.21.15.92:0/741273948 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:49.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.984+0000 7ff381f1b700 1 -- 172.21.15.92:0/741273948 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff378009420 con 0x7ff37c0a3030 2023-09-29T23:23:49.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.984+0000 7ff381f1b700 1 --2- 172.21.15.92:0/741273948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff37c0a3030 0x7ff37c12c400 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff378000c00 tx=0x7ff378016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:49.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.984+0000 7ff371ffb700 1 -- 172.21.15.92:0/741273948 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff378024470 con 0x7ff37c0a3030 2023-09-29T23:23:49.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.984+0000 7ff371ffb700 1 -- 172.21.15.92:0/741273948 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3780245d0 con 0x7ff37c0a3030 2023-09-29T23:23:49.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.984+0000 7ff38417f700 1 -- 172.21.15.92:0/741273948 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37c11be40 con 0x7ff37c0a3030 2023-09-29T23:23:49.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.984+0000 7ff371ffb700 1 -- 172.21.15.92:0/741273948 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3780248a0 con 0x7ff37c0a3030 2023-09-29T23:23:49.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.985+0000 7ff38417f700 1 -- 172.21.15.92:0/741273948 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37c11c6a0 con 0x7ff37c0a3030 2023-09-29T23:23:49.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.985+0000 7ff371ffb700 1 -- 172.21.15.92:0/741273948 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7ff378021070 con 0x7ff37c0a3030 2023-09-29T23:23:49.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.986+0000 7ff371ffb700 1 --2- 172.21.15.92:0/741273948 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff360035640 0x7ff360037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:49.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.986+0000 7ff38417f700 1 -- 172.21.15.92:0/741273948 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff37c11bcb0 con 0x7ff37c0a3030 2023-09-29T23:23:49.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.986+0000 7ff371ffb700 1 -- 172.21.15.92:0/741273948 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7ff378049410 con 0x7ff37c0a3030 2023-09-29T23:23:49.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.986+0000 7ff38171a700 1 --2- 172.21.15.92:0/741273948 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff360035640 0x7ff360037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:49.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.986+0000 7ff38171a700 1 --2- 172.21.15.92:0/741273948 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff360035640 0x7ff360037af0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0016a0 tx=0x7ff36c007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:49.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:49.990+0000 7ff371ffb700 1 -- 172.21.15.92:0/741273948 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff378023790 con 0x7ff37c0a3030 2023-09-29T23:23:50.170 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.169+0000 7ff38417f700 1 -- 172.21.15.92:0/741273948 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff37c05f230 con 0x7ff360035640 2023-09-29T23:23:50.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.176+0000 7ff371ffb700 1 -- 172.21.15.92:0/741273948 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+262514 (secure 0 0 0) 0x7ff37c05f230 con 0x7ff360035640 2023-09-29T23:23:50.179 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:50.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.179+0000 7ff38417f700 1 -- 172.21.15.92:0/741273948 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff360035640 msgr2=0x7ff360037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:50.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.179+0000 7ff38417f700 1 --2- 172.21.15.92:0/741273948 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff360035640 0x7ff360037af0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0016a0 tx=0x7ff36c007b30 comp rx=0 tx=0).stop 2023-09-29T23:23:50.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.179+0000 7ff38417f700 1 -- 172.21.15.92:0/741273948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff37c0a3030 msgr2=0x7ff37c12c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:50.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.179+0000 7ff38417f700 1 --2- 172.21.15.92:0/741273948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff37c0a3030 0x7ff37c12c400 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff378000c00 tx=0x7ff378016000 comp rx=0 tx=0).stop 2023-09-29T23:23:50.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.179+0000 7ff38417f700 1 -- 172.21.15.92:0/741273948 shutdown_connections 2023-09-29T23:23:50.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.179+0000 7ff38417f700 1 --2- 172.21.15.92:0/741273948 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff360035640 0x7ff360037af0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:50.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.179+0000 7ff38417f700 1 --2- 172.21.15.92:0/741273948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff37c0a3030 0x7ff37c12c400 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:50.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.179+0000 7ff38417f700 1 -- 172.21.15.92:0/741273948 >> 172.21.15.92:0/741273948 conn(0x7ff37c067fc0 msgr2=0x7ff37c12d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:50.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.179+0000 7ff38417f700 1 -- 172.21.15.92:0/741273948 shutdown_connections 2023-09-29T23:23:50.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.179+0000 7ff38417f700 1 -- 172.21.15.92:0/741273948 wait complete. 2023-09-29T23:23:50.182 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-09-29T23:23:50.191 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-09-29T23:23:50.035964+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":208,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":16512,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":16000,"kb_avail":314556288,"statfs":{"total":322122547200,"available":322105638912,"internally_reserved":0,"allocated":499712,"data_stored":134277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16384000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":770,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000517"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473355+0000","last_change":"2023-09-29T23:23:45.465624+0000","last_active":"2023-09-29T23:23:45.473355+0000","last_peered":"2023-09-29T23:23:45.473355+0000","last_clean":"2023-09-29T23:23:45.473355+0000","last_became_active":"2023-09-29T23:23:45.464271+0000","last_became_peered":"2023-09-29T23:23:45.464271+0000","last_unstale":"2023-09-29T23:23:45.473355+0000","last_undegraded":"2023-09-29T23:23:45.473355+0000","last_fullsized":"2023-09-29T23:23:45.473355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:54:19.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.469593+0000","last_change":"2023-09-29T23:23:45.466587+0000","last_active":"2023-09-29T23:23:45.469593+0000","last_peered":"2023-09-29T23:23:45.469593+0000","last_clean":"2023-09-29T23:23:45.469593+0000","last_became_active":"2023-09-29T23:23:45.466338+0000","last_became_peered":"2023-09-29T23:23:45.466338+0000","last_unstale":"2023-09-29T23:23:45.469593+0000","last_undegraded":"2023-09-29T23:23:45.469593+0000","last_fullsized":"2023-09-29T23:23:45.469593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479450+0000","last_change":"2023-09-29T23:23:45.477248+0000","last_active":"2023-09-29T23:23:45.479450+0000","last_peered":"2023-09-29T23:23:45.479450+0000","last_clean":"2023-09-29T23:23:45.479450+0000","last_became_active":"2023-09-29T23:23:45.474129+0000","last_became_peered":"2023-09-29T23:23:45.474129+0000","last_unstale":"2023-09-29T23:23:45.479450+0000","last_undegraded":"2023-09-29T23:23:45.479450+0000","last_fullsized":"2023-09-29T23:23:45.479450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:09:27.600159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471200+0000","last_change":"2023-09-29T23:23:45.471200+0000","last_active":"2023-09-29T23:23:45.471200+0000","last_peered":"2023-09-29T23:23:45.471200+0000","last_clean":"2023-09-29T23:23:45.471200+0000","last_became_active":"2023-09-29T23:23:45.470971+0000","last_became_peered":"2023-09-29T23:23:45.470971+0000","last_unstale":"2023-09-29T23:23:45.471200+0000","last_undegraded":"2023-09-29T23:23:45.471200+0000","last_fullsized":"2023-09-29T23:23:45.471200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:29:34.531515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479230+0000","last_change":"2023-09-29T23:23:45.473831+0000","last_active":"2023-09-29T23:23:45.479230+0000","last_peered":"2023-09-29T23:23:45.479230+0000","last_clean":"2023-09-29T23:23:45.479230+0000","last_became_active":"2023-09-29T23:23:45.473570+0000","last_became_peered":"2023-09-29T23:23:45.473570+0000","last_unstale":"2023-09-29T23:23:45.479230+0000","last_undegraded":"2023-09-29T23:23:45.479230+0000","last_fullsized":"2023-09-29T23:23:45.479230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:51:36.401360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470583+0000","last_change":"2023-09-29T23:23:45.470583+0000","last_active":"2023-09-29T23:23:45.470583+0000","last_peered":"2023-09-29T23:23:45.470583+0000","last_clean":"2023-09-29T23:23:45.470583+0000","last_became_active":"2023-09-29T23:23:45.470349+0000","last_became_peered":"2023-09-29T23:23:45.470349+0000","last_unstale":"2023-09-29T23:23:45.470583+0000","last_undegraded":"2023-09-29T23:23:45.470583+0000","last_fullsized":"2023-09-29T23:23:45.470583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:50:32.868236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473871+0000","last_change":"2023-09-29T23:23:45.465376+0000","last_active":"2023-09-29T23:23:45.473871+0000","last_peered":"2023-09-29T23:23:45.473871+0000","last_clean":"2023-09-29T23:23:45.473871+0000","last_became_active":"2023-09-29T23:23:45.464893+0000","last_became_peered":"2023-09-29T23:23:45.464893+0000","last_unstale":"2023-09-29T23:23:45.473871+0000","last_undegraded":"2023-09-29T23:23:45.473871+0000","last_fullsized":"2023-09-29T23:23:45.473871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:34:22.460877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.463286+0000","last_change":"2023-09-29T23:23:45.463286+0000","last_active":"2023-09-29T23:23:45.463286+0000","last_peered":"2023-09-29T23:23:45.463286+0000","last_clean":"2023-09-29T23:23:45.463286+0000","last_became_active":"2023-09-29T23:23:45.462888+0000","last_became_peered":"2023-09-29T23:23:45.462888+0000","last_unstale":"2023-09-29T23:23:45.463286+0000","last_undegraded":"2023-09-29T23:23:45.463286+0000","last_fullsized":"2023-09-29T23:23:45.463286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470175+0000","last_change":"2023-09-29T23:23:45.468860+0000","last_active":"2023-09-29T23:23:45.470175+0000","last_peered":"2023-09-29T23:23:45.470175+0000","last_clean":"2023-09-29T23:23:45.470175+0000","last_became_active":"2023-09-29T23:23:45.468303+0000","last_became_peered":"2023-09-29T23:23:45.468303+0000","last_unstale":"2023-09-29T23:23:45.470175+0000","last_undegraded":"2023-09-29T23:23:45.470175+0000","last_fullsized":"2023-09-29T23:23:45.470175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:34:22.460877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479380+0000","last_change":"2023-09-29T23:23:45.475091+0000","last_active":"2023-09-29T23:23:45.479380+0000","last_peered":"2023-09-29T23:23:45.479380+0000","last_clean":"2023-09-29T23:23:45.479380+0000","last_became_active":"2023-09-29T23:23:45.474757+0000","last_became_peered":"2023-09-29T23:23:45.474757+0000","last_unstale":"2023-09-29T23:23:45.479380+0000","last_undegraded":"2023-09-29T23:23:45.479380+0000","last_fullsized":"2023-09-29T23:23:45.479380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:59:29.779691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473519+0000","last_change":"2023-09-29T23:23:45.467858+0000","last_active":"2023-09-29T23:23:45.473519+0000","last_peered":"2023-09-29T23:23:45.473519+0000","last_clean":"2023-09-29T23:23:45.473519+0000","last_became_active":"2023-09-29T23:23:45.464083+0000","last_became_peered":"2023-09-29T23:23:45.464083+0000","last_unstale":"2023-09-29T23:23:45.473519+0000","last_undegraded":"2023-09-29T23:23:45.473519+0000","last_fullsized":"2023-09-29T23:23:45.473519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:30:57.865969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473409+0000","last_change":"2023-09-29T23:23:45.466588+0000","last_active":"2023-09-29T23:23:45.473409+0000","last_peered":"2023-09-29T23:23:45.473409+0000","last_clean":"2023-09-29T23:23:45.473409+0000","last_became_active":"2023-09-29T23:23:45.466161+0000","last_became_peered":"2023-09-29T23:23:45.466161+0000","last_unstale":"2023-09-29T23:23:45.473409+0000","last_undegraded":"2023-09-29T23:23:45.473409+0000","last_fullsized":"2023-09-29T23:23:45.473409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:13.284557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473383+0000","last_change":"2023-09-29T23:23:45.467402+0000","last_active":"2023-09-29T23:23:45.473383+0000","last_peered":"2023-09-29T23:23:45.473383+0000","last_clean":"2023-09-29T23:23:45.473383+0000","last_became_active":"2023-09-29T23:23:45.467178+0000","last_became_peered":"2023-09-29T23:23:45.467178+0000","last_unstale":"2023-09-29T23:23:45.473383+0000","last_undegraded":"2023-09-29T23:23:45.473383+0000","last_fullsized":"2023-09-29T23:23:45.473383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472302+0000","last_change":"2023-09-29T23:23:45.465231+0000","last_active":"2023-09-29T23:23:45.472302+0000","last_peered":"2023-09-29T23:23:45.472302+0000","last_clean":"2023-09-29T23:23:45.472302+0000","last_became_active":"2023-09-29T23:23:45.464523+0000","last_became_peered":"2023-09-29T23:23:45.464523+0000","last_unstale":"2023-09-29T23:23:45.472302+0000","last_undegraded":"2023-09-29T23:23:45.472302+0000","last_fullsized":"2023-09-29T23:23:45.472302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:32.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471955+0000","last_change":"2023-09-29T23:23:45.470349+0000","last_active":"2023-09-29T23:23:45.471955+0000","last_peered":"2023-09-29T23:23:45.471955+0000","last_clean":"2023-09-29T23:23:45.471955+0000","last_became_active":"2023-09-29T23:23:45.467004+0000","last_became_peered":"2023-09-29T23:23:45.467004+0000","last_unstale":"2023-09-29T23:23:45.471955+0000","last_undegraded":"2023-09-29T23:23:45.471955+0000","last_fullsized":"2023-09-29T23:23:45.471955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471536+0000","last_change":"2023-09-29T23:23:45.471536+0000","last_active":"2023-09-29T23:23:45.471536+0000","last_peered":"2023-09-29T23:23:45.471536+0000","last_clean":"2023-09-29T23:23:45.471536+0000","last_became_active":"2023-09-29T23:23:45.471334+0000","last_became_peered":"2023-09-29T23:23:45.471334+0000","last_unstale":"2023-09-29T23:23:45.471536+0000","last_undegraded":"2023-09-29T23:23:45.471536+0000","last_fullsized":"2023-09-29T23:23:45.471536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470193+0000","last_change":"2023-09-29T23:23:45.468857+0000","last_active":"2023-09-29T23:23:45.470193+0000","last_peered":"2023-09-29T23:23:45.470193+0000","last_clean":"2023-09-29T23:23:45.470193+0000","last_became_active":"2023-09-29T23:23:45.468001+0000","last_became_peered":"2023-09-29T23:23:45.468001+0000","last_unstale":"2023-09-29T23:23:45.470193+0000","last_undegraded":"2023-09-29T23:23:45.470193+0000","last_fullsized":"2023-09-29T23:23:45.470193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:11.211646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467819+0000","last_change":"2023-09-29T23:23:45.467819+0000","last_active":"2023-09-29T23:23:45.467819+0000","last_peered":"2023-09-29T23:23:45.467819+0000","last_clean":"2023-09-29T23:23:45.467819+0000","last_became_active":"2023-09-29T23:23:45.467434+0000","last_became_peered":"2023-09-29T23:23:45.467434+0000","last_unstale":"2023-09-29T23:23:45.467819+0000","last_undegraded":"2023-09-29T23:23:45.467819+0000","last_fullsized":"2023-09-29T23:23:45.467819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479225+0000","last_change":"2023-09-29T23:23:45.473751+0000","last_active":"2023-09-29T23:23:45.479225+0000","last_peered":"2023-09-29T23:23:45.479225+0000","last_clean":"2023-09-29T23:23:45.479225+0000","last_became_active":"2023-09-29T23:23:45.473326+0000","last_became_peered":"2023-09-29T23:23:45.473326+0000","last_unstale":"2023-09-29T23:23:45.479225+0000","last_undegraded":"2023-09-29T23:23:45.479225+0000","last_fullsized":"2023-09-29T23:23:45.479225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:21:17.261104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473427+0000","last_change":"2023-09-29T23:23:45.467719+0000","last_active":"2023-09-29T23:23:45.473427+0000","last_peered":"2023-09-29T23:23:45.473427+0000","last_clean":"2023-09-29T23:23:45.473427+0000","last_became_active":"2023-09-29T23:23:45.467494+0000","last_became_peered":"2023-09-29T23:23:45.467494+0000","last_unstale":"2023-09-29T23:23:45.473427+0000","last_undegraded":"2023-09-29T23:23:45.473427+0000","last_fullsized":"2023-09-29T23:23:45.473427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479563+0000","last_change":"2023-09-29T23:23:45.478055+0000","last_active":"2023-09-29T23:23:45.479563+0000","last_peered":"2023-09-29T23:23:45.479563+0000","last_clean":"2023-09-29T23:23:45.479563+0000","last_became_active":"2023-09-29T23:23:45.477408+0000","last_became_peered":"2023-09-29T23:23:45.477408+0000","last_unstale":"2023-09-29T23:23:45.479563+0000","last_undegraded":"2023-09-29T23:23:45.479563+0000","last_fullsized":"2023-09-29T23:23:45.479563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:14:56.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474548+0000","last_change":"2023-09-29T23:23:45.471232+0000","last_active":"2023-09-29T23:23:45.474548+0000","last_peered":"2023-09-29T23:23:45.474548+0000","last_clean":"2023-09-29T23:23:45.474548+0000","last_became_active":"2023-09-29T23:23:45.470574+0000","last_became_peered":"2023-09-29T23:23:45.470574+0000","last_unstale":"2023-09-29T23:23:45.474548+0000","last_undegraded":"2023-09-29T23:23:45.474548+0000","last_fullsized":"2023-09-29T23:23:45.474548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:25:25.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479248+0000","last_change":"2023-09-29T23:23:45.474093+0000","last_active":"2023-09-29T23:23:45.479248+0000","last_peered":"2023-09-29T23:23:45.479248+0000","last_clean":"2023-09-29T23:23:45.479248+0000","last_became_active":"2023-09-29T23:23:45.473789+0000","last_became_peered":"2023-09-29T23:23:45.473789+0000","last_unstale":"2023-09-29T23:23:45.479248+0000","last_undegraded":"2023-09-29T23:23:45.479248+0000","last_fullsized":"2023-09-29T23:23:45.479248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:46.564456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472272+0000","last_change":"2023-09-29T23:23:45.465993+0000","last_active":"2023-09-29T23:23:45.472272+0000","last_peered":"2023-09-29T23:23:45.472272+0000","last_clean":"2023-09-29T23:23:45.472272+0000","last_became_active":"2023-09-29T23:23:45.465443+0000","last_became_peered":"2023-09-29T23:23:45.465443+0000","last_unstale":"2023-09-29T23:23:45.472272+0000","last_undegraded":"2023-09-29T23:23:45.472272+0000","last_fullsized":"2023-09-29T23:23:45.472272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:12:18.769461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.458032+0000","last_change":"2023-09-29T23:23:45.458032+0000","last_active":"2023-09-29T23:23:45.458032+0000","last_peered":"2023-09-29T23:23:45.458032+0000","last_clean":"2023-09-29T23:23:45.458032+0000","last_became_active":"2023-09-29T23:23:45.457799+0000","last_became_peered":"2023-09-29T23:23:45.457799+0000","last_unstale":"2023-09-29T23:23:45.458032+0000","last_undegraded":"2023-09-29T23:23:45.458032+0000","last_fullsized":"2023-09-29T23:23:45.458032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:21:07.207937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467967+0000","last_change":"2023-09-29T23:23:45.467967+0000","last_active":"2023-09-29T23:23:45.467967+0000","last_peered":"2023-09-29T23:23:45.467967+0000","last_clean":"2023-09-29T23:23:45.467967+0000","last_became_active":"2023-09-29T23:23:45.467730+0000","last_became_peered":"2023-09-29T23:23:45.467730+0000","last_unstale":"2023-09-29T23:23:45.467967+0000","last_undegraded":"2023-09-29T23:23:45.467967+0000","last_fullsized":"2023-09-29T23:23:45.467967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:23:19.840400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475084+0000","last_change":"2023-09-29T23:23:45.076072+0000","last_active":"2023-09-29T23:23:45.475084+0000","last_peered":"2023-09-29T23:23:45.475084+0000","last_clean":"2023-09-29T23:23:45.475084+0000","last_became_active":"2023-09-29T23:23:45.075848+0000","last_became_peered":"2023-09-29T23:23:45.075848+0000","last_unstale":"2023-09-29T23:23:45.475084+0000","last_undegraded":"2023-09-29T23:23:45.475084+0000","last_fullsized":"2023-09-29T23:23:45.475084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:29:13.914085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.464208+0000","last_change":"2023-09-29T23:23:45.462781+0000","last_active":"2023-09-29T23:23:45.464208+0000","last_peered":"2023-09-29T23:23:45.464208+0000","last_clean":"2023-09-29T23:23:45.464208+0000","last_became_active":"2023-09-29T23:23:45.462155+0000","last_became_peered":"2023-09-29T23:23:45.462155+0000","last_unstale":"2023-09-29T23:23:45.464208+0000","last_undegraded":"2023-09-29T23:23:45.464208+0000","last_fullsized":"2023-09-29T23:23:45.464208+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:13.284557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.451173+0000","last_change":"2023-09-29T23:23:45.092553+0000","last_active":"2023-09-29T23:23:45.451173+0000","last_peered":"2023-09-29T23:23:45.451173+0000","last_clean":"2023-09-29T23:23:45.451173+0000","last_became_active":"2023-09-29T23:23:45.092273+0000","last_became_peered":"2023-09-29T23:23:45.092273+0000","last_unstale":"2023-09-29T23:23:45.451173+0000","last_undegraded":"2023-09-29T23:23:45.451173+0000","last_fullsized":"2023-09-29T23:23:45.451173+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472939+0000","last_change":"2023-09-29T23:23:45.464637+0000","last_active":"2023-09-29T23:23:45.472939+0000","last_peered":"2023-09-29T23:23:45.472939+0000","last_clean":"2023-09-29T23:23:45.472939+0000","last_became_active":"2023-09-29T23:23:45.464027+0000","last_became_peered":"2023-09-29T23:23:45.464027+0000","last_unstale":"2023-09-29T23:23:45.472939+0000","last_undegraded":"2023-09-29T23:23:45.472939+0000","last_fullsized":"2023-09-29T23:23:45.472939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.449247+0000","last_change":"2023-09-29T23:23:45.088658+0000","last_active":"2023-09-29T23:23:45.449247+0000","last_peered":"2023-09-29T23:23:45.449247+0000","last_clean":"2023-09-29T23:23:45.449247+0000","last_became_active":"2023-09-29T23:23:45.088405+0000","last_became_peered":"2023-09-29T23:23:45.088405+0000","last_unstale":"2023-09-29T23:23:45.449247+0000","last_undegraded":"2023-09-29T23:23:45.449247+0000","last_fullsized":"2023-09-29T23:23:45.449247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471459+0000","last_change":"2023-09-29T23:23:45.471459+0000","last_active":"2023-09-29T23:23:45.471459+0000","last_peered":"2023-09-29T23:23:45.471459+0000","last_clean":"2023-09-29T23:23:45.471459+0000","last_became_active":"2023-09-29T23:23:45.470917+0000","last_became_peered":"2023-09-29T23:23:45.470917+0000","last_unstale":"2023-09-29T23:23:45.471459+0000","last_undegraded":"2023-09-29T23:23:45.471459+0000","last_fullsized":"2023-09-29T23:23:45.471459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:29:34.889615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.444294+0000","last_change":"2023-09-29T23:23:45.070764+0000","last_active":"2023-09-29T23:23:45.444294+0000","last_peered":"2023-09-29T23:23:45.444294+0000","last_clean":"2023-09-29T23:23:45.444294+0000","last_became_active":"2023-09-29T23:23:45.070610+0000","last_became_peered":"2023-09-29T23:23:45.070610+0000","last_unstale":"2023-09-29T23:23:45.444294+0000","last_undegraded":"2023-09-29T23:23:45.444294+0000","last_fullsized":"2023-09-29T23:23:45.444294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:26:19.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.477784+0000","last_change":"2023-09-29T23:23:45.475877+0000","last_active":"2023-09-29T23:23:45.477784+0000","last_peered":"2023-09-29T23:23:45.477784+0000","last_clean":"2023-09-29T23:23:45.477784+0000","last_became_active":"2023-09-29T23:23:45.475634+0000","last_became_peered":"2023-09-29T23:23:45.475634+0000","last_unstale":"2023-09-29T23:23:45.477784+0000","last_undegraded":"2023-09-29T23:23:45.477784+0000","last_fullsized":"2023-09-29T23:23:45.477784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:59:25.888959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.458483+0000","last_change":"2023-09-29T23:23:45.091556+0000","last_active":"2023-09-29T23:23:45.458483+0000","last_peered":"2023-09-29T23:23:45.458483+0000","last_clean":"2023-09-29T23:23:45.458483+0000","last_became_active":"2023-09-29T23:23:45.091317+0000","last_became_peered":"2023-09-29T23:23:45.091317+0000","last_unstale":"2023-09-29T23:23:45.458483+0000","last_undegraded":"2023-09-29T23:23:45.458483+0000","last_fullsized":"2023-09-29T23:23:45.458483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:53.097532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.458805+0000","last_change":"2023-09-29T23:23:45.458805+0000","last_active":"2023-09-29T23:23:45.458805+0000","last_peered":"2023-09-29T23:23:45.458805+0000","last_clean":"2023-09-29T23:23:45.458805+0000","last_became_active":"2023-09-29T23:23:45.458585+0000","last_became_peered":"2023-09-29T23:23:45.458585+0000","last_unstale":"2023-09-29T23:23:45.458805+0000","last_undegraded":"2023-09-29T23:23:45.458805+0000","last_fullsized":"2023-09-29T23:23:45.458805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:05:18.350431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.446151+0000","last_change":"2023-09-29T23:23:45.071269+0000","last_active":"2023-09-29T23:23:45.446151+0000","last_peered":"2023-09-29T23:23:45.446151+0000","last_clean":"2023-09-29T23:23:45.446151+0000","last_became_active":"2023-09-29T23:23:45.070986+0000","last_became_peered":"2023-09-29T23:23:45.070986+0000","last_unstale":"2023-09-29T23:23:45.446151+0000","last_undegraded":"2023-09-29T23:23:45.446151+0000","last_fullsized":"2023-09-29T23:23:45.446151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:29.355473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472807+0000","last_change":"2023-09-29T23:23:45.464917+0000","last_active":"2023-09-29T23:23:45.472807+0000","last_peered":"2023-09-29T23:23:45.472807+0000","last_clean":"2023-09-29T23:23:45.472807+0000","last_became_active":"2023-09-29T23:23:45.464510+0000","last_became_peered":"2023-09-29T23:23:45.464510+0000","last_unstale":"2023-09-29T23:23:45.472807+0000","last_undegraded":"2023-09-29T23:23:45.472807+0000","last_fullsized":"2023-09-29T23:23:45.472807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:58:16.565151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475769+0000","last_change":"2023-09-29T23:23:45.077097+0000","last_active":"2023-09-29T23:23:45.475769+0000","last_peered":"2023-09-29T23:23:45.475769+0000","last_clean":"2023-09-29T23:23:45.475769+0000","last_became_active":"2023-09-29T23:23:45.076856+0000","last_became_peered":"2023-09-29T23:23:45.076856+0000","last_unstale":"2023-09-29T23:23:45.475769+0000","last_undegraded":"2023-09-29T23:23:45.475769+0000","last_fullsized":"2023-09-29T23:23:45.475769+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:00:28.816753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.464231+0000","last_change":"2023-09-29T23:23:45.462198+0000","last_active":"2023-09-29T23:23:45.464231+0000","last_peered":"2023-09-29T23:23:45.464231+0000","last_clean":"2023-09-29T23:23:45.464231+0000","last_became_active":"2023-09-29T23:23:45.461199+0000","last_became_peered":"2023-09-29T23:23:45.461199+0000","last_unstale":"2023-09-29T23:23:45.464231+0000","last_undegraded":"2023-09-29T23:23:45.464231+0000","last_fullsized":"2023-09-29T23:23:45.464231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:33.901646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"16'6","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.476072+0000","last_change":"2023-09-29T23:23:45.093720+0000","last_active":"2023-09-29T23:23:45.476072+0000","last_peered":"2023-09-29T23:23:45.476072+0000","last_clean":"2023-09-29T23:23:45.476072+0000","last_became_active":"2023-09-29T23:23:45.093487+0000","last_became_peered":"2023-09-29T23:23:45.093487+0000","last_unstale":"2023-09-29T23:23:45.476072+0000","last_undegraded":"2023-09-29T23:23:45.476072+0000","last_fullsized":"2023-09-29T23:23:45.476072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473468+0000","last_change":"2023-09-29T23:23:45.466875+0000","last_active":"2023-09-29T23:23:45.473468+0000","last_peered":"2023-09-29T23:23:45.473468+0000","last_clean":"2023-09-29T23:23:45.473468+0000","last_became_active":"2023-09-29T23:23:45.466667+0000","last_became_peered":"2023-09-29T23:23:45.466667+0000","last_unstale":"2023-09-29T23:23:45.473468+0000","last_undegraded":"2023-09-29T23:23:45.473468+0000","last_fullsized":"2023-09-29T23:23:45.473468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:19.696930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.480207+0000","last_change":"2023-09-29T23:23:45.089727+0000","last_active":"2023-09-29T23:23:45.480207+0000","last_peered":"2023-09-29T23:23:45.480207+0000","last_clean":"2023-09-29T23:23:45.480207+0000","last_became_active":"2023-09-29T23:23:45.089450+0000","last_became_peered":"2023-09-29T23:23:45.089450+0000","last_unstale":"2023-09-29T23:23:45.480207+0000","last_undegraded":"2023-09-29T23:23:45.480207+0000","last_fullsized":"2023-09-29T23:23:45.480207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473639+0000","last_change":"2023-09-29T23:23:45.468316+0000","last_active":"2023-09-29T23:23:45.473639+0000","last_peered":"2023-09-29T23:23:45.473639+0000","last_clean":"2023-09-29T23:23:45.473639+0000","last_became_active":"2023-09-29T23:23:45.464801+0000","last_became_peered":"2023-09-29T23:23:45.464801+0000","last_unstale":"2023-09-29T23:23:45.473639+0000","last_undegraded":"2023-09-29T23:23:45.473639+0000","last_fullsized":"2023-09-29T23:23:45.473639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.096689+0000","last_change":"2023-09-29T23:23:45.093148+0000","last_active":"2023-09-29T23:23:45.096689+0000","last_peered":"2023-09-29T23:23:45.096689+0000","last_clean":"2023-09-29T23:23:45.096689+0000","last_became_active":"2023-09-29T23:23:45.092902+0000","last_became_peered":"2023-09-29T23:23:45.092902+0000","last_unstale":"2023-09-29T23:23:45.096689+0000","last_undegraded":"2023-09-29T23:23:45.096689+0000","last_fullsized":"2023-09-29T23:23:45.096689+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470060+0000","last_change":"2023-09-29T23:23:45.466007+0000","last_active":"2023-09-29T23:23:45.470060+0000","last_peered":"2023-09-29T23:23:45.470060+0000","last_clean":"2023-09-29T23:23:45.470060+0000","last_became_active":"2023-09-29T23:23:45.465743+0000","last_became_peered":"2023-09-29T23:23:45.465743+0000","last_unstale":"2023-09-29T23:23:45.470060+0000","last_undegraded":"2023-09-29T23:23:45.470060+0000","last_fullsized":"2023-09-29T23:23:45.470060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.448899+0000","last_change":"2023-09-29T23:23:45.072234+0000","last_active":"2023-09-29T23:23:45.448899+0000","last_peered":"2023-09-29T23:23:45.448899+0000","last_clean":"2023-09-29T23:23:45.448899+0000","last_became_active":"2023-09-29T23:23:45.072009+0000","last_became_peered":"2023-09-29T23:23:45.072009+0000","last_unstale":"2023-09-29T23:23:45.448899+0000","last_undegraded":"2023-09-29T23:23:45.448899+0000","last_fullsized":"2023-09-29T23:23:45.448899+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471991+0000","last_change":"2023-09-29T23:23:45.466374+0000","last_active":"2023-09-29T23:23:45.471991+0000","last_peered":"2023-09-29T23:23:45.471991+0000","last_clean":"2023-09-29T23:23:45.471991+0000","last_became_active":"2023-09-29T23:23:45.466169+0000","last_became_peered":"2023-09-29T23:23:45.466169+0000","last_unstale":"2023-09-29T23:23:45.471991+0000","last_undegraded":"2023-09-29T23:23:45.471991+0000","last_fullsized":"2023-09-29T23:23:45.471991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"16'8","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475600+0000","last_change":"2023-09-29T23:23:45.091762+0000","last_active":"2023-09-29T23:23:45.475600+0000","last_peered":"2023-09-29T23:23:45.475600+0000","last_clean":"2023-09-29T23:23:45.475600+0000","last_became_active":"2023-09-29T23:23:45.091386+0000","last_became_peered":"2023-09-29T23:23:45.091386+0000","last_unstale":"2023-09-29T23:23:45.475600+0000","last_undegraded":"2023-09-29T23:23:45.475600+0000","last_fullsized":"2023-09-29T23:23:45.475600+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.461421+0000","last_change":"2023-09-29T23:23:45.461421+0000","last_active":"2023-09-29T23:23:45.461421+0000","last_peered":"2023-09-29T23:23:45.461421+0000","last_clean":"2023-09-29T23:23:45.461421+0000","last_became_active":"2023-09-29T23:23:45.460643+0000","last_became_peered":"2023-09-29T23:23:45.460643+0000","last_unstale":"2023-09-29T23:23:45.461421+0000","last_undegraded":"2023-09-29T23:23:45.461421+0000","last_fullsized":"2023-09-29T23:23:45.461421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:12:32.105911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.480077+0000","last_change":"2023-09-29T23:23:45.078091+0000","last_active":"2023-09-29T23:23:45.480077+0000","last_peered":"2023-09-29T23:23:45.480077+0000","last_clean":"2023-09-29T23:23:45.480077+0000","last_became_active":"2023-09-29T23:23:45.077734+0000","last_became_peered":"2023-09-29T23:23:45.077734+0000","last_unstale":"2023-09-29T23:23:45.480077+0000","last_undegraded":"2023-09-29T23:23:45.480077+0000","last_fullsized":"2023-09-29T23:23:45.480077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:53.097532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467950+0000","last_change":"2023-09-29T23:23:45.467950+0000","last_active":"2023-09-29T23:23:45.467950+0000","last_peered":"2023-09-29T23:23:45.467950+0000","last_clean":"2023-09-29T23:23:45.467950+0000","last_became_active":"2023-09-29T23:23:45.467555+0000","last_became_peered":"2023-09-29T23:23:45.467555+0000","last_unstale":"2023-09-29T23:23:45.467950+0000","last_undegraded":"2023-09-29T23:23:45.467950+0000","last_fullsized":"2023-09-29T23:23:45.467950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"16'2","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467306+0000","last_change":"2023-09-29T23:23:45.092471+0000","last_active":"2023-09-29T23:23:45.467306+0000","last_peered":"2023-09-29T23:23:45.467306+0000","last_clean":"2023-09-29T23:23:45.467306+0000","last_became_active":"2023-09-29T23:23:45.092185+0000","last_became_peered":"2023-09-29T23:23:45.092185+0000","last_unstale":"2023-09-29T23:23:45.467306+0000","last_undegraded":"2023-09-29T23:23:45.467306+0000","last_fullsized":"2023-09-29T23:23:45.467306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472722+0000","last_change":"2023-09-29T23:23:45.464504+0000","last_active":"2023-09-29T23:23:45.472722+0000","last_peered":"2023-09-29T23:23:45.472722+0000","last_clean":"2023-09-29T23:23:45.472722+0000","last_became_active":"2023-09-29T23:23:45.463806+0000","last_became_peered":"2023-09-29T23:23:45.463806+0000","last_unstale":"2023-09-29T23:23:45.472722+0000","last_undegraded":"2023-09-29T23:23:45.472722+0000","last_fullsized":"2023-09-29T23:23:45.472722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:25:25.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475877+0000","last_change":"2023-09-29T23:23:45.088776+0000","last_active":"2023-09-29T23:23:45.475877+0000","last_peered":"2023-09-29T23:23:45.475877+0000","last_clean":"2023-09-29T23:23:45.475877+0000","last_became_active":"2023-09-29T23:23:45.088535+0000","last_became_peered":"2023-09-29T23:23:45.088535+0000","last_unstale":"2023-09-29T23:23:45.475877+0000","last_undegraded":"2023-09-29T23:23:45.475877+0000","last_fullsized":"2023-09-29T23:23:45.475877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:35:07.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473390+0000","last_change":"2023-09-29T23:23:45.466379+0000","last_active":"2023-09-29T23:23:45.473390+0000","last_peered":"2023-09-29T23:23:45.473390+0000","last_clean":"2023-09-29T23:23:45.473390+0000","last_became_active":"2023-09-29T23:23:45.465855+0000","last_became_peered":"2023-09-29T23:23:45.465855+0000","last_unstale":"2023-09-29T23:23:45.473390+0000","last_undegraded":"2023-09-29T23:23:45.473390+0000","last_fullsized":"2023-09-29T23:23:45.473390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:06.275738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.096676+0000","last_change":"2023-09-29T23:23:45.092714+0000","last_active":"2023-09-29T23:23:45.096676+0000","last_peered":"2023-09-29T23:23:45.096676+0000","last_clean":"2023-09-29T23:23:45.096676+0000","last_became_active":"2023-09-29T23:23:45.092476+0000","last_became_peered":"2023-09-29T23:23:45.092476+0000","last_unstale":"2023-09-29T23:23:45.096676+0000","last_undegraded":"2023-09-29T23:23:45.096676+0000","last_fullsized":"2023-09-29T23:23:45.096676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:20:23.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.469720+0000","last_change":"2023-09-29T23:23:45.467010+0000","last_active":"2023-09-29T23:23:45.469720+0000","last_peered":"2023-09-29T23:23:45.469720+0000","last_clean":"2023-09-29T23:23:45.469720+0000","last_became_active":"2023-09-29T23:23:45.466694+0000","last_became_peered":"2023-09-29T23:23:45.466694+0000","last_unstale":"2023-09-29T23:23:45.469720+0000","last_undegraded":"2023-09-29T23:23:45.469720+0000","last_fullsized":"2023-09-29T23:23:45.469720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.484451+0000","last_change":"2023-09-29T23:23:45.089622+0000","last_active":"2023-09-29T23:23:45.484451+0000","last_peered":"2023-09-29T23:23:45.484451+0000","last_clean":"2023-09-29T23:23:45.484451+0000","last_became_active":"2023-09-29T23:23:45.089176+0000","last_became_peered":"2023-09-29T23:23:45.089176+0000","last_unstale":"2023-09-29T23:23:45.484451+0000","last_undegraded":"2023-09-29T23:23:45.484451+0000","last_fullsized":"2023-09-29T23:23:45.484451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472323+0000","last_change":"2023-09-29T23:23:45.465798+0000","last_active":"2023-09-29T23:23:45.472323+0000","last_peered":"2023-09-29T23:23:45.472323+0000","last_clean":"2023-09-29T23:23:45.472323+0000","last_became_active":"2023-09-29T23:23:45.465127+0000","last_became_peered":"2023-09-29T23:23:45.465127+0000","last_unstale":"2023-09-29T23:23:45.472323+0000","last_undegraded":"2023-09-29T23:23:45.472323+0000","last_fullsized":"2023-09-29T23:23:45.472323+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:33.901646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450509+0000","last_change":"2023-09-29T23:23:45.075630+0000","last_active":"2023-09-29T23:23:45.450509+0000","last_peered":"2023-09-29T23:23:45.450509+0000","last_clean":"2023-09-29T23:23:45.450509+0000","last_became_active":"2023-09-29T23:23:45.075313+0000","last_became_peered":"2023-09-29T23:23:45.075313+0000","last_unstale":"2023-09-29T23:23:45.450509+0000","last_undegraded":"2023-09-29T23:23:45.450509+0000","last_fullsized":"2023-09-29T23:23:45.450509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:59:03.439349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470041+0000","last_change":"2023-09-29T23:23:45.465956+0000","last_active":"2023-09-29T23:23:45.470041+0000","last_peered":"2023-09-29T23:23:45.470041+0000","last_clean":"2023-09-29T23:23:45.470041+0000","last_became_active":"2023-09-29T23:23:45.465599+0000","last_became_peered":"2023-09-29T23:23:45.465599+0000","last_unstale":"2023-09-29T23:23:45.470041+0000","last_undegraded":"2023-09-29T23:23:45.470041+0000","last_fullsized":"2023-09-29T23:23:45.470041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:29:34.889615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450944+0000","last_change":"2023-09-29T23:23:45.075998+0000","last_active":"2023-09-29T23:23:45.450944+0000","last_peered":"2023-09-29T23:23:45.450944+0000","last_clean":"2023-09-29T23:23:45.450944+0000","last_became_active":"2023-09-29T23:23:45.075772+0000","last_became_peered":"2023-09-29T23:23:45.075772+0000","last_unstale":"2023-09-29T23:23:45.450944+0000","last_undegraded":"2023-09-29T23:23:45.450944+0000","last_fullsized":"2023-09-29T23:23:45.450944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:12:24.809572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.463124+0000","last_change":"2023-09-29T23:23:45.463124+0000","last_active":"2023-09-29T23:23:45.463124+0000","last_peered":"2023-09-29T23:23:45.463124+0000","last_clean":"2023-09-29T23:23:45.463124+0000","last_became_active":"2023-09-29T23:23:45.462583+0000","last_became_peered":"2023-09-29T23:23:45.462583+0000","last_unstale":"2023-09-29T23:23:45.463124+0000","last_undegraded":"2023-09-29T23:23:45.463124+0000","last_fullsized":"2023-09-29T23:23:45.463124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:01:57.571277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.444191+0000","last_change":"2023-09-29T23:23:45.088750+0000","last_active":"2023-09-29T23:23:45.444191+0000","last_peered":"2023-09-29T23:23:45.444191+0000","last_clean":"2023-09-29T23:23:45.444191+0000","last_became_active":"2023-09-29T23:23:45.088506+0000","last_became_peered":"2023-09-29T23:23:45.088506+0000","last_unstale":"2023-09-29T23:23:45.444191+0000","last_undegraded":"2023-09-29T23:23:45.444191+0000","last_fullsized":"2023-09-29T23:23:45.444191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479465+0000","last_change":"2023-09-29T23:23:45.477617+0000","last_active":"2023-09-29T23:23:45.479465+0000","last_peered":"2023-09-29T23:23:45.479465+0000","last_clean":"2023-09-29T23:23:45.479465+0000","last_became_active":"2023-09-29T23:23:45.477335+0000","last_became_peered":"2023-09-29T23:23:45.477335+0000","last_unstale":"2023-09-29T23:23:45.479465+0000","last_undegraded":"2023-09-29T23:23:45.479465+0000","last_fullsized":"2023-09-29T23:23:45.479465+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:44:09.599636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.085622+0000","last_change":"2023-09-29T23:23:41.047954+0000","last_active":"2023-09-29T23:23:45.085622+0000","last_peered":"2023-09-29T23:23:45.085622+0000","last_clean":"2023-09-29T23:23:45.085622+0000","last_became_active":"2023-09-29T23:23:41.047701+0000","last_became_peered":"2023-09-29T23:23:41.047701+0000","last_unstale":"2023-09-29T23:23:45.085622+0000","last_undegraded":"2023-09-29T23:23:45.085622+0000","last_fullsized":"2023-09-29T23:23:45.085622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:08:35.252580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.457414+0000","last_change":"2023-09-29T23:23:45.075607+0000","last_active":"2023-09-29T23:23:45.457414+0000","last_peered":"2023-09-29T23:23:45.457414+0000","last_clean":"2023-09-29T23:23:45.457414+0000","last_became_active":"2023-09-29T23:23:45.075249+0000","last_became_peered":"2023-09-29T23:23:45.075249+0000","last_unstale":"2023-09-29T23:23:45.457414+0000","last_undegraded":"2023-09-29T23:23:45.457414+0000","last_fullsized":"2023-09-29T23:23:45.457414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:55:12.692421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.460164+0000","last_change":"2023-09-29T23:23:45.460164+0000","last_active":"2023-09-29T23:23:45.460164+0000","last_peered":"2023-09-29T23:23:45.460164+0000","last_clean":"2023-09-29T23:23:45.460164+0000","last_became_active":"2023-09-29T23:23:45.459933+0000","last_became_peered":"2023-09-29T23:23:45.459933+0000","last_unstale":"2023-09-29T23:23:45.460164+0000","last_undegraded":"2023-09-29T23:23:45.460164+0000","last_fullsized":"2023-09-29T23:23:45.460164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:25:22.017530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.453586+0000","last_change":"2023-09-29T23:23:41.051640+0000","last_active":"2023-09-29T23:23:45.453586+0000","last_peered":"2023-09-29T23:23:45.453586+0000","last_clean":"2023-09-29T23:23:45.453586+0000","last_became_active":"2023-09-29T23:23:41.051398+0000","last_became_peered":"2023-09-29T23:23:41.051398+0000","last_unstale":"2023-09-29T23:23:45.453586+0000","last_undegraded":"2023-09-29T23:23:45.453586+0000","last_fullsized":"2023-09-29T23:23:45.453586+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:49:47.548120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.476402+0000","last_change":"2023-09-29T23:23:45.076540+0000","last_active":"2023-09-29T23:23:45.476402+0000","last_peered":"2023-09-29T23:23:45.476402+0000","last_clean":"2023-09-29T23:23:45.476402+0000","last_became_active":"2023-09-29T23:23:45.076293+0000","last_became_peered":"2023-09-29T23:23:45.076293+0000","last_unstale":"2023-09-29T23:23:45.476402+0000","last_undegraded":"2023-09-29T23:23:45.476402+0000","last_fullsized":"2023-09-29T23:23:45.476402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:09.131795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474065+0000","last_change":"2023-09-29T23:23:45.466336+0000","last_active":"2023-09-29T23:23:45.474065+0000","last_peered":"2023-09-29T23:23:45.474065+0000","last_clean":"2023-09-29T23:23:45.474065+0000","last_became_active":"2023-09-29T23:23:45.466115+0000","last_became_peered":"2023-09-29T23:23:45.466115+0000","last_unstale":"2023-09-29T23:23:45.474065+0000","last_undegraded":"2023-09-29T23:23:45.474065+0000","last_fullsized":"2023-09-29T23:23:45.474065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:11.211646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450776+0000","last_change":"2023-09-29T23:23:41.050066+0000","last_active":"2023-09-29T23:23:45.450776+0000","last_peered":"2023-09-29T23:23:45.450776+0000","last_clean":"2023-09-29T23:23:45.450776+0000","last_became_active":"2023-09-29T23:23:41.049786+0000","last_became_peered":"2023-09-29T23:23:41.049786+0000","last_unstale":"2023-09-29T23:23:45.450776+0000","last_undegraded":"2023-09-29T23:23:45.450776+0000","last_fullsized":"2023-09-29T23:23:45.450776+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:22:54.699446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.096616+0000","last_change":"2023-09-29T23:23:45.091590+0000","last_active":"2023-09-29T23:23:45.096616+0000","last_peered":"2023-09-29T23:23:45.096616+0000","last_clean":"2023-09-29T23:23:45.096616+0000","last_became_active":"2023-09-29T23:23:45.091162+0000","last_became_peered":"2023-09-29T23:23:45.091162+0000","last_unstale":"2023-09-29T23:23:45.096616+0000","last_undegraded":"2023-09-29T23:23:45.096616+0000","last_fullsized":"2023-09-29T23:23:45.096616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:29:38.240697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479301+0000","last_change":"2023-09-29T23:23:45.474238+0000","last_active":"2023-09-29T23:23:45.479301+0000","last_peered":"2023-09-29T23:23:45.479301+0000","last_clean":"2023-09-29T23:23:45.479301+0000","last_became_active":"2023-09-29T23:23:45.473861+0000","last_became_peered":"2023-09-29T23:23:45.473861+0000","last_unstale":"2023-09-29T23:23:45.479301+0000","last_undegraded":"2023-09-29T23:23:45.479301+0000","last_fullsized":"2023-09-29T23:23:45.479301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:39:43.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.451691+0000","last_change":"2023-09-29T23:23:41.049685+0000","last_active":"2023-09-29T23:23:45.451691+0000","last_peered":"2023-09-29T23:23:45.451691+0000","last_clean":"2023-09-29T23:23:45.451691+0000","last_became_active":"2023-09-29T23:23:41.049442+0000","last_became_peered":"2023-09-29T23:23:41.049442+0000","last_unstale":"2023-09-29T23:23:45.451691+0000","last_undegraded":"2023-09-29T23:23:45.451691+0000","last_fullsized":"2023-09-29T23:23:45.451691+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:52:33.065724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.096707+0000","last_change":"2023-09-29T23:23:45.092293+0000","last_active":"2023-09-29T23:23:45.096707+0000","last_peered":"2023-09-29T23:23:45.096707+0000","last_clean":"2023-09-29T23:23:45.096707+0000","last_became_active":"2023-09-29T23:23:45.092042+0000","last_became_peered":"2023-09-29T23:23:45.092042+0000","last_unstale":"2023-09-29T23:23:45.096707+0000","last_undegraded":"2023-09-29T23:23:45.096707+0000","last_fullsized":"2023-09-29T23:23:45.096707+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:07:16.838088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.466547+0000","last_change":"2023-09-29T23:23:45.461917+0000","last_active":"2023-09-29T23:23:45.466547+0000","last_peered":"2023-09-29T23:23:45.466547+0000","last_clean":"2023-09-29T23:23:45.466547+0000","last_became_active":"2023-09-29T23:23:45.461228+0000","last_became_peered":"2023-09-29T23:23:45.461228+0000","last_unstale":"2023-09-29T23:23:45.466547+0000","last_undegraded":"2023-09-29T23:23:45.466547+0000","last_fullsized":"2023-09-29T23:23:45.466547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:54:19.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450606+0000","last_change":"2023-09-29T23:23:41.051041+0000","last_active":"2023-09-29T23:23:45.450606+0000","last_peered":"2023-09-29T23:23:45.450606+0000","last_clean":"2023-09-29T23:23:45.450606+0000","last_became_active":"2023-09-29T23:23:41.050731+0000","last_became_peered":"2023-09-29T23:23:41.050731+0000","last_unstale":"2023-09-29T23:23:45.450606+0000","last_undegraded":"2023-09-29T23:23:45.450606+0000","last_fullsized":"2023-09-29T23:23:45.450606+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:20.303147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450701+0000","last_change":"2023-09-29T23:23:45.088759+0000","last_active":"2023-09-29T23:23:45.450701+0000","last_peered":"2023-09-29T23:23:45.450701+0000","last_clean":"2023-09-29T23:23:45.450701+0000","last_became_active":"2023-09-29T23:23:45.088510+0000","last_became_peered":"2023-09-29T23:23:45.088510+0000","last_unstale":"2023-09-29T23:23:45.450701+0000","last_undegraded":"2023-09-29T23:23:45.450701+0000","last_fullsized":"2023-09-29T23:23:45.450701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:27:56.918672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.477404+0000","last_change":"2023-09-29T23:23:45.472092+0000","last_active":"2023-09-29T23:23:45.477404+0000","last_peered":"2023-09-29T23:23:45.477404+0000","last_clean":"2023-09-29T23:23:45.477404+0000","last_became_active":"2023-09-29T23:23:45.461672+0000","last_became_peered":"2023-09-29T23:23:45.461672+0000","last_unstale":"2023-09-29T23:23:45.477404+0000","last_undegraded":"2023-09-29T23:23:45.477404+0000","last_fullsized":"2023-09-29T23:23:45.477404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:58:16.565151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.084530+0000","last_change":"2023-09-29T23:23:41.047062+0000","last_active":"2023-09-29T23:23:45.084530+0000","last_peered":"2023-09-29T23:23:45.084530+0000","last_clean":"2023-09-29T23:23:45.084530+0000","last_became_active":"2023-09-29T23:23:41.046803+0000","last_became_peered":"2023-09-29T23:23:41.046803+0000","last_unstale":"2023-09-29T23:23:45.084530+0000","last_undegraded":"2023-09-29T23:23:45.084530+0000","last_fullsized":"2023-09-29T23:23:45.084530+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:22:14.657466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.451787+0000","last_change":"2023-09-29T23:23:45.073226+0000","last_active":"2023-09-29T23:23:45.451787+0000","last_peered":"2023-09-29T23:23:45.451787+0000","last_clean":"2023-09-29T23:23:45.451787+0000","last_became_active":"2023-09-29T23:23:45.072973+0000","last_became_peered":"2023-09-29T23:23:45.072973+0000","last_unstale":"2023-09-29T23:23:45.451787+0000","last_undegraded":"2023-09-29T23:23:45.451787+0000","last_fullsized":"2023-09-29T23:23:45.451787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:27:56.918672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479531+0000","last_change":"2023-09-29T23:23:45.477628+0000","last_active":"2023-09-29T23:23:45.479531+0000","last_peered":"2023-09-29T23:23:45.479531+0000","last_clean":"2023-09-29T23:23:45.479531+0000","last_became_active":"2023-09-29T23:23:45.474318+0000","last_became_peered":"2023-09-29T23:23:45.474318+0000","last_unstale":"2023-09-29T23:23:45.479531+0000","last_undegraded":"2023-09-29T23:23:45.479531+0000","last_fullsized":"2023-09-29T23:23:45.479531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:46:02.634499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.457485+0000","last_change":"2023-09-29T23:23:41.050883+0000","last_active":"2023-09-29T23:23:45.457485+0000","last_peered":"2023-09-29T23:23:45.457485+0000","last_clean":"2023-09-29T23:23:45.457485+0000","last_became_active":"2023-09-29T23:23:41.050639+0000","last_became_peered":"2023-09-29T23:23:41.050639+0000","last_unstale":"2023-09-29T23:23:45.457485+0000","last_undegraded":"2023-09-29T23:23:45.457485+0000","last_fullsized":"2023-09-29T23:23:45.457485+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:35:26.897753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.457867+0000","last_change":"2023-09-29T23:23:45.077040+0000","last_active":"2023-09-29T23:23:45.457867+0000","last_peered":"2023-09-29T23:23:45.457867+0000","last_clean":"2023-09-29T23:23:45.457867+0000","last_became_active":"2023-09-29T23:23:45.076806+0000","last_became_peered":"2023-09-29T23:23:45.076806+0000","last_unstale":"2023-09-29T23:23:45.457867+0000","last_undegraded":"2023-09-29T23:23:45.457867+0000","last_fullsized":"2023-09-29T23:23:45.457867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:26:19.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.463631+0000","last_change":"2023-09-29T23:23:45.462067+0000","last_active":"2023-09-29T23:23:45.463631+0000","last_peered":"2023-09-29T23:23:45.463631+0000","last_clean":"2023-09-29T23:23:45.463631+0000","last_became_active":"2023-09-29T23:23:45.460913+0000","last_became_peered":"2023-09-29T23:23:45.460913+0000","last_unstale":"2023-09-29T23:23:45.463631+0000","last_undegraded":"2023-09-29T23:23:45.463631+0000","last_fullsized":"2023-09-29T23:23:45.463631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:06.275738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.458336+0000","last_change":"2023-09-29T23:23:41.050074+0000","last_active":"2023-09-29T23:23:45.458336+0000","last_peered":"2023-09-29T23:23:45.458336+0000","last_clean":"2023-09-29T23:23:45.458336+0000","last_became_active":"2023-09-29T23:23:41.049783+0000","last_became_peered":"2023-09-29T23:23:41.049783+0000","last_unstale":"2023-09-29T23:23:45.458336+0000","last_undegraded":"2023-09-29T23:23:45.458336+0000","last_fullsized":"2023-09-29T23:23:45.458336+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:37:01.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.453746+0000","last_change":"2023-09-29T23:23:45.076087+0000","last_active":"2023-09-29T23:23:45.453746+0000","last_peered":"2023-09-29T23:23:45.453746+0000","last_clean":"2023-09-29T23:23:45.453746+0000","last_became_active":"2023-09-29T23:23:45.075273+0000","last_became_peered":"2023-09-29T23:23:45.075273+0000","last_unstale":"2023-09-29T23:23:45.453746+0000","last_undegraded":"2023-09-29T23:23:45.453746+0000","last_fullsized":"2023-09-29T23:23:45.453746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:27.356997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.459071+0000","last_change":"2023-09-29T23:23:45.459071+0000","last_active":"2023-09-29T23:23:45.459071+0000","last_peered":"2023-09-29T23:23:45.459071+0000","last_clean":"2023-09-29T23:23:45.459071+0000","last_became_active":"2023-09-29T23:23:45.458250+0000","last_became_peered":"2023-09-29T23:23:45.458250+0000","last_unstale":"2023-09-29T23:23:45.459071+0000","last_undegraded":"2023-09-29T23:23:45.459071+0000","last_fullsized":"2023-09-29T23:23:45.459071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.478408+0000","last_change":"2023-09-29T23:23:45.076932+0000","last_active":"2023-09-29T23:23:45.478408+0000","last_peered":"2023-09-29T23:23:45.478408+0000","last_clean":"2023-09-29T23:23:45.478408+0000","last_became_active":"2023-09-29T23:23:45.076638+0000","last_became_peered":"2023-09-29T23:23:45.076638+0000","last_unstale":"2023-09-29T23:23:45.478408+0000","last_undegraded":"2023-09-29T23:23:45.478408+0000","last_fullsized":"2023-09-29T23:23:45.478408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:35:07.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471332+0000","last_change":"2023-09-29T23:23:45.471332+0000","last_active":"2023-09-29T23:23:45.471332+0000","last_peered":"2023-09-29T23:23:45.471332+0000","last_clean":"2023-09-29T23:23:45.471332+0000","last_became_active":"2023-09-29T23:23:45.471013+0000","last_became_peered":"2023-09-29T23:23:45.471013+0000","last_unstale":"2023-09-29T23:23:45.471332+0000","last_undegraded":"2023-09-29T23:23:45.471332+0000","last_fullsized":"2023-09-29T23:23:45.471332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479907+0000","last_change":"2023-09-29T23:23:45.076405+0000","last_active":"2023-09-29T23:23:45.479907+0000","last_peered":"2023-09-29T23:23:45.479907+0000","last_clean":"2023-09-29T23:23:45.479907+0000","last_became_active":"2023-09-29T23:23:45.076191+0000","last_became_peered":"2023-09-29T23:23:45.076191+0000","last_unstale":"2023-09-29T23:23:45.479907+0000","last_undegraded":"2023-09-29T23:23:45.479907+0000","last_fullsized":"2023-09-29T23:23:45.479907+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:20:23.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.477541+0000","last_change":"2023-09-29T23:23:45.471929+0000","last_active":"2023-09-29T23:23:45.477541+0000","last_peered":"2023-09-29T23:23:45.477541+0000","last_clean":"2023-09-29T23:23:45.477541+0000","last_became_active":"2023-09-29T23:23:45.471673+0000","last_became_peered":"2023-09-29T23:23:45.471673+0000","last_unstale":"2023-09-29T23:23:45.477541+0000","last_undegraded":"2023-09-29T23:23:45.477541+0000","last_fullsized":"2023-09-29T23:23:45.477541+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.448700+0000","last_change":"2023-09-29T23:23:45.092434+0000","last_active":"2023-09-29T23:23:45.448700+0000","last_peered":"2023-09-29T23:23:45.448700+0000","last_clean":"2023-09-29T23:23:45.448700+0000","last_became_active":"2023-09-29T23:23:45.092203+0000","last_became_peered":"2023-09-29T23:23:45.092203+0000","last_unstale":"2023-09-29T23:23:45.448700+0000","last_undegraded":"2023-09-29T23:23:45.448700+0000","last_fullsized":"2023-09-29T23:23:45.448700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472769+0000","last_change":"2023-09-29T23:23:45.464734+0000","last_active":"2023-09-29T23:23:45.472769+0000","last_peered":"2023-09-29T23:23:45.472769+0000","last_clean":"2023-09-29T23:23:45.472769+0000","last_became_active":"2023-09-29T23:23:45.464202+0000","last_became_peered":"2023-09-29T23:23:45.464202+0000","last_unstale":"2023-09-29T23:23:45.472769+0000","last_undegraded":"2023-09-29T23:23:45.472769+0000","last_fullsized":"2023-09-29T23:23:45.472769+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:59:25.888959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.480111+0000","last_change":"2023-09-29T23:23:45.074017+0000","last_active":"2023-09-29T23:23:45.480111+0000","last_peered":"2023-09-29T23:23:45.480111+0000","last_clean":"2023-09-29T23:23:45.480111+0000","last_became_active":"2023-09-29T23:23:45.073772+0000","last_became_peered":"2023-09-29T23:23:45.073772+0000","last_unstale":"2023-09-29T23:23:45.480111+0000","last_undegraded":"2023-09-29T23:23:45.480111+0000","last_fullsized":"2023-09-29T23:23:45.480111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.460786+0000","last_change":"2023-09-29T23:23:45.460786+0000","last_active":"2023-09-29T23:23:45.460786+0000","last_peered":"2023-09-29T23:23:45.460786+0000","last_clean":"2023-09-29T23:23:45.460786+0000","last_became_active":"2023-09-29T23:23:45.460548+0000","last_became_peered":"2023-09-29T23:23:45.460548+0000","last_unstale":"2023-09-29T23:23:45.460786+0000","last_undegraded":"2023-09-29T23:23:45.460786+0000","last_fullsized":"2023-09-29T23:23:45.460786+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:09:25.160546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471512+0000","last_change":"2023-09-29T23:23:45.471512+0000","last_active":"2023-09-29T23:23:45.471512+0000","last_peered":"2023-09-29T23:23:45.471512+0000","last_clean":"2023-09-29T23:23:45.471512+0000","last_became_active":"2023-09-29T23:23:45.471294+0000","last_became_peered":"2023-09-29T23:23:45.471294+0000","last_unstale":"2023-09-29T23:23:45.471512+0000","last_undegraded":"2023-09-29T23:23:45.471512+0000","last_fullsized":"2023-09-29T23:23:45.471512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:29:14.066786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.462314+0000","last_change":"2023-09-29T23:23:45.462314+0000","last_active":"2023-09-29T23:23:45.462314+0000","last_peered":"2023-09-29T23:23:45.462314+0000","last_clean":"2023-09-29T23:23:45.462314+0000","last_became_active":"2023-09-29T23:23:45.461188+0000","last_became_peered":"2023-09-29T23:23:45.461188+0000","last_unstale":"2023-09-29T23:23:45.462314+0000","last_undegraded":"2023-09-29T23:23:45.462314+0000","last_fullsized":"2023-09-29T23:23:45.462314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:01:06.913634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479183+0000","last_change":"2023-09-29T23:23:45.473685+0000","last_active":"2023-09-29T23:23:45.479183+0000","last_peered":"2023-09-29T23:23:45.479183+0000","last_clean":"2023-09-29T23:23:45.479183+0000","last_became_active":"2023-09-29T23:23:45.473438+0000","last_became_peered":"2023-09-29T23:23:45.473438+0000","last_unstale":"2023-09-29T23:23:45.479183+0000","last_undegraded":"2023-09-29T23:23:45.479183+0000","last_fullsized":"2023-09-29T23:23:45.479183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:39:59.923188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479548+0000","last_change":"2023-09-29T23:23:45.477880+0000","last_active":"2023-09-29T23:23:45.479548+0000","last_peered":"2023-09-29T23:23:45.479548+0000","last_clean":"2023-09-29T23:23:45.479548+0000","last_became_active":"2023-09-29T23:23:45.474163+0000","last_became_peered":"2023-09-29T23:23:45.474163+0000","last_unstale":"2023-09-29T23:23:45.479548+0000","last_undegraded":"2023-09-29T23:23:45.479548+0000","last_fullsized":"2023-09-29T23:23:45.479548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:40:09.175714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479092+0000","last_change":"2023-09-29T23:23:45.473292+0000","last_active":"2023-09-29T23:23:45.479092+0000","last_peered":"2023-09-29T23:23:45.479092+0000","last_clean":"2023-09-29T23:23:45.479092+0000","last_became_active":"2023-09-29T23:23:45.473063+0000","last_became_peered":"2023-09-29T23:23:45.473063+0000","last_unstale":"2023-09-29T23:23:45.479092+0000","last_undegraded":"2023-09-29T23:23:45.479092+0000","last_fullsized":"2023-09-29T23:23:45.479092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:06:47.738713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.464396+0000","last_change":"2023-09-29T23:23:45.463712+0000","last_active":"2023-09-29T23:23:45.464396+0000","last_peered":"2023-09-29T23:23:45.464396+0000","last_clean":"2023-09-29T23:23:45.464396+0000","last_became_active":"2023-09-29T23:23:45.463269+0000","last_became_peered":"2023-09-29T23:23:45.463269+0000","last_unstale":"2023-09-29T23:23:45.464396+0000","last_undegraded":"2023-09-29T23:23:45.464396+0000","last_fullsized":"2023-09-29T23:23:45.464396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:32.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5556,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852044,"statfs":{"total":107374182400,"available":107368493056,"internally_reserved":0,"allocated":176128,"data_stored":46822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.218}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20799999999999999}]}]},{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5412,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":104852188,"statfs":{"total":107374182400,"available":107368640512,"internally_reserved":0,"allocated":159744,"data_stored":42205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5544,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852056,"statfs":{"total":107374182400,"available":107368505344,"internally_reserved":0,"allocated":163840,"data_stored":45250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-29T23:23:50.198 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-09-29T23:23:50.343 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.343+0000 7f18b3635700 1 Processor -- start 2023-09-29T23:23:50.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.343+0000 7f18b3635700 1 -- start start 2023-09-29T23:23:50.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.344+0000 7f18b3635700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f18ac097780 0x7f18ac131640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:50.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.344+0000 7f18b3635700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ac098700 con 0x7f18ac096ca0 2023-09-29T23:23:50.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.344+0000 7f18b3635700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ac09f430 con 0x7f18ac097780 2023-09-29T23:23:50.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.344+0000 7f18b0bd0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f18ac097780 0x7f18ac131640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:50.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.344+0000 7f18b0bd0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f18ac097780 0x7f18ac131640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48970/0 (socket says 172.21.15.92:48970) 2023-09-29T23:23:50.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.344+0000 7f18b13d1700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f18ac096ca0 0x7f18ac097070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54588/0 (socket says 172.21.15.92:54588) 2023-09-29T23:23:50.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.344+0000 7f18b0bd0700 1 -- 172.21.15.92:0/372188722 learned_addr learned my addr 172.21.15.92:0/372188722 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:50.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.344+0000 7f18b0bd0700 1 -- 172.21.15.92:0/372188722 >> v1:172.21.15.92:6789/0 conn(0x7f18ac096ca0 legacy=0x7f18ac097070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:50.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.344+0000 7f18b0bd0700 1 -- 172.21.15.92:0/372188722 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac06fab0 con 0x7f18ac097780 2023-09-29T23:23:50.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.344+0000 7f18a3fff700 1 -- 172.21.15.92:0/372188722 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166731056 0 0) 0x7f18ac098700 con 0x7f18ac096ca0 2023-09-29T23:23:50.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.344+0000 7f18b0bd0700 1 --2- 172.21.15.92:0/372188722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18ac097780 0x7f18ac131640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f189c009930 tx=0x7f189c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733236c3fe8bdf10 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:50.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.344+0000 7f18a3fff700 1 -- 172.21.15.92:0/372188722 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f189c00b860 con 0x7f18ac097780 2023-09-29T23:23:50.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.344+0000 7f18a3fff700 1 -- 172.21.15.92:0/372188722 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189c00b9c0 con 0x7f18ac097780 2023-09-29T23:23:50.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.344+0000 7f18a3fff700 1 -- 172.21.15.92:0/372188722 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f189c00bc90 con 0x7f18ac097780 2023-09-29T23:23:50.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.345+0000 7f18b3635700 1 -- 172.21.15.92:0/372188722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18ac097780 msgr2=0x7f18ac131640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:50.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.345+0000 7f18b3635700 1 --2- 172.21.15.92:0/372188722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18ac097780 0x7f18ac131640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f189c009930 tx=0x7f189c009250 comp rx=0 tx=0).stop 2023-09-29T23:23:50.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.345+0000 7f18b3635700 1 -- 172.21.15.92:0/372188722 shutdown_connections 2023-09-29T23:23:50.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.345+0000 7f18b3635700 1 --2- 172.21.15.92:0/372188722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18ac097780 0x7f18ac131640 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:50.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.345+0000 7f18b3635700 1 -- 172.21.15.92:0/372188722 >> 172.21.15.92:0/372188722 conn(0x7f18ac06bd70 msgr2=0x7f18ac06e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:50.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.345+0000 7f18b3635700 1 -- 172.21.15.92:0/372188722 shutdown_connections 2023-09-29T23:23:50.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.345+0000 7f18b3635700 1 -- 172.21.15.92:0/372188722 wait complete. 2023-09-29T23:23:50.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.346+0000 7f18b3635700 1 Processor -- start 2023-09-29T23:23:50.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.346+0000 7f18b3635700 1 -- start start 2023-09-29T23:23:50.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.346+0000 7f18b3635700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18ac096ca0 0x7f18ac13e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:50.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.346+0000 7f18b3635700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac090980 con 0x7f18ac096ca0 2023-09-29T23:23:50.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.346+0000 7f18b13d1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18ac096ca0 0x7f18ac13e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:50.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.346+0000 7f18b13d1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18ac096ca0 0x7f18ac13e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48982/0 (socket says 172.21.15.92:48982) 2023-09-29T23:23:50.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.347+0000 7f18b13d1700 1 -- 172.21.15.92:0/41451652 learned_addr learned my addr 172.21.15.92:0/41451652 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:50.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.347+0000 7f18b13d1700 1 -- 172.21.15.92:0/41451652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c0094f0 con 0x7f18ac096ca0 2023-09-29T23:23:50.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.347+0000 7f18b13d1700 1 --2- 172.21.15.92:0/41451652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18ac096ca0 0x7f18ac13e730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f18a800c710 tx=0x7f18a8007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:50.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.347+0000 7f18a17fa700 1 -- 172.21.15.92:0/41451652 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18a80074c0 con 0x7f18ac096ca0 2023-09-29T23:23:50.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.347+0000 7f18a17fa700 1 -- 172.21.15.92:0/41451652 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a8007620 con 0x7f18ac096ca0 2023-09-29T23:23:50.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.347+0000 7f18a17fa700 1 -- 172.21.15.92:0/41451652 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18a8005950 con 0x7f18ac096ca0 2023-09-29T23:23:50.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.347+0000 7f18b3635700 1 -- 172.21.15.92:0/41451652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ac092640 con 0x7f18ac096ca0 2023-09-29T23:23:50.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.347+0000 7f18b3635700 1 -- 172.21.15.92:0/41451652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ac0929f0 con 0x7f18ac096ca0 2023-09-29T23:23:50.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.348+0000 7f18a17fa700 1 -- 172.21.15.92:0/41451652 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f18a8005ab0 con 0x7f18ac096ca0 2023-09-29T23:23:50.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.348+0000 7f18b3635700 1 -- 172.21.15.92:0/41451652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ac08f6d0 con 0x7f18ac096ca0 2023-09-29T23:23:50.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.348+0000 7f18a17fa700 1 --2- 172.21.15.92:0/41451652 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1890035640 0x7f1890037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:50.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.348+0000 7f18a17fa700 1 -- 172.21.15.92:0/41451652 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f18a8047410 con 0x7f18ac096ca0 2023-09-29T23:23:50.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.348+0000 7f18b0bd0700 1 --2- 172.21.15.92:0/41451652 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1890035640 0x7f1890037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:50.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.349+0000 7f18b0bd0700 1 --2- 172.21.15.92:0/41451652 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1890035640 0x7f1890037af0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f189c009930 tx=0x7f189c016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:50.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.353+0000 7f18a17fa700 1 -- 172.21.15.92:0/41451652 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18a8013c80 con 0x7f18ac096ca0 2023-09-29T23:23:50.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.611+0000 7f18b3635700 1 -- 172.21.15.92:0/41451652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f18ac0907f0 con 0x7f18ac096ca0 2023-09-29T23:23:50.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.611+0000 7f18a17fa700 1 -- 172.21.15.92:0/41451652 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1181 (secure 0 0 0) 0x7f18a8011360 con 0x7f18ac096ca0 2023-09-29T23:23:50.612 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:50.612 INFO:teuthology.orchestra.run.smithi092.stdout:{"fsid":"5b80eae7-9a7e-4dc0-8ff1-cd1f82a1fa33","health":{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":20,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":17,"num_osds":3,"num_up_osds":3,"osd_up_since":1696029817,"num_in_osds":3,"osd_in_since":1696029811,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":104}],"num_pgs":104,"num_pools":3,"num_objects":21,"data_bytes":2306,"bytes_used":16908288,"bytes_avail":322105638912,"bytes_total":322122547200,"write_bytes_sec":5118,"read_op_per_sec":0,"write_op_per_sec":11},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4146}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-09-29T23:23:30.309623+0000","services":{}},"progress_events":{}} 2023-09-29T23:23:50.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.613+0000 7f18b3635700 1 -- 172.21.15.92:0/41451652 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1890035640 msgr2=0x7f1890037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:50.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.613+0000 7f18b3635700 1 --2- 172.21.15.92:0/41451652 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1890035640 0x7f1890037af0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f189c009930 tx=0x7f189c016000 comp rx=0 tx=0).stop 2023-09-29T23:23:50.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.613+0000 7f18b3635700 1 -- 172.21.15.92:0/41451652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18ac096ca0 msgr2=0x7f18ac13e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:50.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.613+0000 7f18b3635700 1 --2- 172.21.15.92:0/41451652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18ac096ca0 0x7f18ac13e730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f18a800c710 tx=0x7f18a8007cc0 comp rx=0 tx=0).stop 2023-09-29T23:23:50.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.613+0000 7f18b3635700 1 -- 172.21.15.92:0/41451652 shutdown_connections 2023-09-29T23:23:50.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.613+0000 7f18b3635700 1 --2- 172.21.15.92:0/41451652 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1890035640 0x7f1890037af0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:50.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.613+0000 7f18b3635700 1 --2- 172.21.15.92:0/41451652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18ac096ca0 0x7f18ac13e730 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:50.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.613+0000 7f18b3635700 1 -- 172.21.15.92:0/41451652 >> 172.21.15.92:0/41451652 conn(0x7f18ac06bd70 msgr2=0x7f18ac06d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:50.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.613+0000 7f18b3635700 1 -- 172.21.15.92:0/41451652 shutdown_connections 2023-09-29T23:23:50.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.613+0000 7f18b3635700 1 -- 172.21.15.92:0/41451652 wait complete. 2023-09-29T23:23:50.625 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-09-29T23:23:50.625 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:23:50.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.738+0000 7f24dffd3700 1 Processor -- start 2023-09-29T23:23:50.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.739+0000 7f24dffd3700 1 -- start start 2023-09-29T23:23:50.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.739+0000 7f24dffd3700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f24d809fd80 0x7f24d80a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:50.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.739+0000 7f24dffd3700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d8098710 con 0x7f24d812f8b0 2023-09-29T23:23:50.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.739+0000 7f24dffd3700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d812f340 con 0x7f24d809fd80 2023-09-29T23:23:50.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.739+0000 7f24ddd6f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f24d809fd80 0x7f24d80a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:50.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.739+0000 7f24dd56e700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f24d812f8b0 0x7f24d8095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54604/0 (socket says 172.21.15.92:54604) 2023-09-29T23:23:50.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.739+0000 7f24dd56e700 1 -- 172.21.15.92:0/2496798898 learned_addr learned my addr 172.21.15.92:0/2496798898 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:50.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.739+0000 7f24ddd6f700 1 -- 172.21.15.92:0/2496798898 >> v1:172.21.15.92:6789/0 conn(0x7f24d812f8b0 legacy=0x7f24d8095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:50.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.739+0000 7f24ddd6f700 1 -- 172.21.15.92:0/2496798898 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d80997e0 con 0x7f24d809fd80 2023-09-29T23:23:50.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.740+0000 7f24ddd6f700 1 --2- 172.21.15.92:0/2496798898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24d809fd80 0x7f24d80a3090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009860 tx=0x7f24d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6760471026336ce8 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:50.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.740+0000 7f24dcd6d700 1 -- 172.21.15.92:0/2496798898 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24d400b680 con 0x7f24d809fd80 2023-09-29T23:23:50.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.740+0000 7f24dcd6d700 1 -- 172.21.15.92:0/2496798898 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d400b7e0 con 0x7f24d809fd80 2023-09-29T23:23:50.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.740+0000 7f24dcd6d700 1 -- 172.21.15.92:0/2496798898 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24d400b990 con 0x7f24d809fd80 2023-09-29T23:23:50.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.740+0000 7f24dffd3700 1 -- 172.21.15.92:0/2496798898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24d809fd80 msgr2=0x7f24d80a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:50.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.740+0000 7f24dffd3700 1 --2- 172.21.15.92:0/2496798898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24d809fd80 0x7f24d80a3090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009860 tx=0x7f24d40091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:50.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.740+0000 7f24dffd3700 1 -- 172.21.15.92:0/2496798898 shutdown_connections 2023-09-29T23:23:50.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.740+0000 7f24dffd3700 1 --2- 172.21.15.92:0/2496798898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24d809fd80 0x7f24d80a3090 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:50.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.740+0000 7f24dffd3700 1 -- 172.21.15.92:0/2496798898 >> 172.21.15.92:0/2496798898 conn(0x7f24d8068000 msgr2=0x7f24d80a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:50.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.740+0000 7f24dffd3700 1 -- 172.21.15.92:0/2496798898 shutdown_connections 2023-09-29T23:23:50.742 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.740+0000 7f24dffd3700 1 -- 172.21.15.92:0/2496798898 wait complete. 2023-09-29T23:23:50.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.741+0000 7f24dffd3700 1 Processor -- start 2023-09-29T23:23:50.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.741+0000 7f24dffd3700 1 -- start start 2023-09-29T23:23:50.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.741+0000 7f24dffd3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24d809fd80 0x7f24d8119fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:50.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.741+0000 7f24dffd3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d811e610 con 0x7f24d809fd80 2023-09-29T23:23:50.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.741+0000 7f24ddd6f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24d809fd80 0x7f24d8119fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:50.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.741+0000 7f24ddd6f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24d809fd80 0x7f24d8119fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49000/0 (socket says 172.21.15.92:49000) 2023-09-29T23:23:50.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.742+0000 7f24ddd6f700 1 -- 172.21.15.92:0/3104003094 learned_addr learned my addr 172.21.15.92:0/3104003094 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:50.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.742+0000 7f24ddd6f700 1 -- 172.21.15.92:0/3104003094 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d4009420 con 0x7f24d809fd80 2023-09-29T23:23:50.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.742+0000 7f24ddd6f700 1 --2- 172.21.15.92:0/3104003094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24d809fd80 0x7f24d8119fa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f24d40091e0 tx=0x7f24d4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:50.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.742+0000 7f24cdffb700 1 -- 172.21.15.92:0/3104003094 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24d4011cf0 con 0x7f24d809fd80 2023-09-29T23:23:50.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.742+0000 7f24cdffb700 1 -- 172.21.15.92:0/3104003094 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d4020070 con 0x7f24d809fd80 2023-09-29T23:23:50.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.742+0000 7f24cdffb700 1 -- 172.21.15.92:0/3104003094 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24d401b450 con 0x7f24d809fd80 2023-09-29T23:23:50.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.742+0000 7f24dffd3700 1 -- 172.21.15.92:0/3104003094 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d811ba50 con 0x7f24d809fd80 2023-09-29T23:23:50.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.742+0000 7f24dffd3700 1 -- 172.21.15.92:0/3104003094 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d811d460 con 0x7f24d809fd80 2023-09-29T23:23:50.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.743+0000 7f24cdffb700 1 -- 172.21.15.92:0/3104003094 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f24d4022030 con 0x7f24d809fd80 2023-09-29T23:23:50.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.743+0000 7f24cdffb700 1 --2- 172.21.15.92:0/3104003094 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f24bc035640 0x7f24bc037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:50.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.743+0000 7f24cdffb700 1 -- 172.21.15.92:0/3104003094 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f24d4049460 con 0x7f24d809fd80 2023-09-29T23:23:50.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.743+0000 7f24dd56e700 1 --2- 172.21.15.92:0/3104003094 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f24bc035640 0x7f24bc037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:50.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.743+0000 7f24dffd3700 1 -- 172.21.15.92:0/3104003094 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d805f230 con 0x7f24d809fd80 2023-09-29T23:23:50.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.743+0000 7f24dd56e700 1 --2- 172.21.15.92:0/3104003094 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f24bc035640 0x7f24bc037af0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f24c8007fd0 tx=0x7f24c8007b00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:50.748 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.748+0000 7f24cdffb700 1 -- 172.21.15.92:0/3104003094 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24d401a9c0 con 0x7f24d809fd80 2023-09-29T23:23:50.925 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.925+0000 7f24dffd3700 1 -- 172.21.15.92:0/3104003094 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24d804bb40 con 0x7f24bc035640 2023-09-29T23:23:50.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.931+0000 7f24cdffb700 1 -- 172.21.15.92:0/3104003094 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+262514 (secure 0 0 0) 0x7f24d804bb40 con 0x7f24bc035640 2023-09-29T23:23:50.936 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:50.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.934+0000 7f24dffd3700 1 -- 172.21.15.92:0/3104003094 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f24bc035640 msgr2=0x7f24bc037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:50.939 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.934+0000 7f24dffd3700 1 --2- 172.21.15.92:0/3104003094 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f24bc035640 0x7f24bc037af0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f24c8007fd0 tx=0x7f24c8007b00 comp rx=0 tx=0).stop 2023-09-29T23:23:50.939 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.934+0000 7f24dffd3700 1 -- 172.21.15.92:0/3104003094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24d809fd80 msgr2=0x7f24d8119fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:50.939 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.934+0000 7f24dffd3700 1 --2- 172.21.15.92:0/3104003094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24d809fd80 0x7f24d8119fa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f24d40091e0 tx=0x7f24d4016000 comp rx=0 tx=0).stop 2023-09-29T23:23:50.939 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.934+0000 7f24dffd3700 1 -- 172.21.15.92:0/3104003094 shutdown_connections 2023-09-29T23:23:50.939 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.934+0000 7f24dffd3700 1 --2- 172.21.15.92:0/3104003094 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f24bc035640 0x7f24bc037af0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:50.939 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.934+0000 7f24dffd3700 1 --2- 172.21.15.92:0/3104003094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24d809fd80 0x7f24d8119fa0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:50.939 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.934+0000 7f24dffd3700 1 -- 172.21.15.92:0/3104003094 >> 172.21.15.92:0/3104003094 conn(0x7f24d8068000 msgr2=0x7f24d8094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:50.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.934+0000 7f24dffd3700 1 -- 172.21.15.92:0/3104003094 shutdown_connections 2023-09-29T23:23:50.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:50.934+0000 7f24dffd3700 1 -- 172.21.15.92:0/3104003094 wait complete. 2023-09-29T23:23:50.940 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-09-29T23:23:50.946 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-09-29T23:23:50.035964+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":208,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":16512,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":16000,"kb_avail":314556288,"statfs":{"total":322122547200,"available":322105638912,"internally_reserved":0,"allocated":499712,"data_stored":134277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16384000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":770,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000517"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473355+0000","last_change":"2023-09-29T23:23:45.465624+0000","last_active":"2023-09-29T23:23:45.473355+0000","last_peered":"2023-09-29T23:23:45.473355+0000","last_clean":"2023-09-29T23:23:45.473355+0000","last_became_active":"2023-09-29T23:23:45.464271+0000","last_became_peered":"2023-09-29T23:23:45.464271+0000","last_unstale":"2023-09-29T23:23:45.473355+0000","last_undegraded":"2023-09-29T23:23:45.473355+0000","last_fullsized":"2023-09-29T23:23:45.473355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:54:19.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.469593+0000","last_change":"2023-09-29T23:23:45.466587+0000","last_active":"2023-09-29T23:23:45.469593+0000","last_peered":"2023-09-29T23:23:45.469593+0000","last_clean":"2023-09-29T23:23:45.469593+0000","last_became_active":"2023-09-29T23:23:45.466338+0000","last_became_peered":"2023-09-29T23:23:45.466338+0000","last_unstale":"2023-09-29T23:23:45.469593+0000","last_undegraded":"2023-09-29T23:23:45.469593+0000","last_fullsized":"2023-09-29T23:23:45.469593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479450+0000","last_change":"2023-09-29T23:23:45.477248+0000","last_active":"2023-09-29T23:23:45.479450+0000","last_peered":"2023-09-29T23:23:45.479450+0000","last_clean":"2023-09-29T23:23:45.479450+0000","last_became_active":"2023-09-29T23:23:45.474129+0000","last_became_peered":"2023-09-29T23:23:45.474129+0000","last_unstale":"2023-09-29T23:23:45.479450+0000","last_undegraded":"2023-09-29T23:23:45.479450+0000","last_fullsized":"2023-09-29T23:23:45.479450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:09:27.600159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471200+0000","last_change":"2023-09-29T23:23:45.471200+0000","last_active":"2023-09-29T23:23:45.471200+0000","last_peered":"2023-09-29T23:23:45.471200+0000","last_clean":"2023-09-29T23:23:45.471200+0000","last_became_active":"2023-09-29T23:23:45.470971+0000","last_became_peered":"2023-09-29T23:23:45.470971+0000","last_unstale":"2023-09-29T23:23:45.471200+0000","last_undegraded":"2023-09-29T23:23:45.471200+0000","last_fullsized":"2023-09-29T23:23:45.471200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:29:34.531515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479230+0000","last_change":"2023-09-29T23:23:45.473831+0000","last_active":"2023-09-29T23:23:45.479230+0000","last_peered":"2023-09-29T23:23:45.479230+0000","last_clean":"2023-09-29T23:23:45.479230+0000","last_became_active":"2023-09-29T23:23:45.473570+0000","last_became_peered":"2023-09-29T23:23:45.473570+0000","last_unstale":"2023-09-29T23:23:45.479230+0000","last_undegraded":"2023-09-29T23:23:45.479230+0000","last_fullsized":"2023-09-29T23:23:45.479230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:51:36.401360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470583+0000","last_change":"2023-09-29T23:23:45.470583+0000","last_active":"2023-09-29T23:23:45.470583+0000","last_peered":"2023-09-29T23:23:45.470583+0000","last_clean":"2023-09-29T23:23:45.470583+0000","last_became_active":"2023-09-29T23:23:45.470349+0000","last_became_peered":"2023-09-29T23:23:45.470349+0000","last_unstale":"2023-09-29T23:23:45.470583+0000","last_undegraded":"2023-09-29T23:23:45.470583+0000","last_fullsized":"2023-09-29T23:23:45.470583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:50:32.868236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473871+0000","last_change":"2023-09-29T23:23:45.465376+0000","last_active":"2023-09-29T23:23:45.473871+0000","last_peered":"2023-09-29T23:23:45.473871+0000","last_clean":"2023-09-29T23:23:45.473871+0000","last_became_active":"2023-09-29T23:23:45.464893+0000","last_became_peered":"2023-09-29T23:23:45.464893+0000","last_unstale":"2023-09-29T23:23:45.473871+0000","last_undegraded":"2023-09-29T23:23:45.473871+0000","last_fullsized":"2023-09-29T23:23:45.473871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:34:22.460877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.463286+0000","last_change":"2023-09-29T23:23:45.463286+0000","last_active":"2023-09-29T23:23:45.463286+0000","last_peered":"2023-09-29T23:23:45.463286+0000","last_clean":"2023-09-29T23:23:45.463286+0000","last_became_active":"2023-09-29T23:23:45.462888+0000","last_became_peered":"2023-09-29T23:23:45.462888+0000","last_unstale":"2023-09-29T23:23:45.463286+0000","last_undegraded":"2023-09-29T23:23:45.463286+0000","last_fullsized":"2023-09-29T23:23:45.463286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470175+0000","last_change":"2023-09-29T23:23:45.468860+0000","last_active":"2023-09-29T23:23:45.470175+0000","last_peered":"2023-09-29T23:23:45.470175+0000","last_clean":"2023-09-29T23:23:45.470175+0000","last_became_active":"2023-09-29T23:23:45.468303+0000","last_became_peered":"2023-09-29T23:23:45.468303+0000","last_unstale":"2023-09-29T23:23:45.470175+0000","last_undegraded":"2023-09-29T23:23:45.470175+0000","last_fullsized":"2023-09-29T23:23:45.470175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:34:22.460877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479380+0000","last_change":"2023-09-29T23:23:45.475091+0000","last_active":"2023-09-29T23:23:45.479380+0000","last_peered":"2023-09-29T23:23:45.479380+0000","last_clean":"2023-09-29T23:23:45.479380+0000","last_became_active":"2023-09-29T23:23:45.474757+0000","last_became_peered":"2023-09-29T23:23:45.474757+0000","last_unstale":"2023-09-29T23:23:45.479380+0000","last_undegraded":"2023-09-29T23:23:45.479380+0000","last_fullsized":"2023-09-29T23:23:45.479380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:59:29.779691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473519+0000","last_change":"2023-09-29T23:23:45.467858+0000","last_active":"2023-09-29T23:23:45.473519+0000","last_peered":"2023-09-29T23:23:45.473519+0000","last_clean":"2023-09-29T23:23:45.473519+0000","last_became_active":"2023-09-29T23:23:45.464083+0000","last_became_peered":"2023-09-29T23:23:45.464083+0000","last_unstale":"2023-09-29T23:23:45.473519+0000","last_undegraded":"2023-09-29T23:23:45.473519+0000","last_fullsized":"2023-09-29T23:23:45.473519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:30:57.865969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473409+0000","last_change":"2023-09-29T23:23:45.466588+0000","last_active":"2023-09-29T23:23:45.473409+0000","last_peered":"2023-09-29T23:23:45.473409+0000","last_clean":"2023-09-29T23:23:45.473409+0000","last_became_active":"2023-09-29T23:23:45.466161+0000","last_became_peered":"2023-09-29T23:23:45.466161+0000","last_unstale":"2023-09-29T23:23:45.473409+0000","last_undegraded":"2023-09-29T23:23:45.473409+0000","last_fullsized":"2023-09-29T23:23:45.473409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:13.284557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473383+0000","last_change":"2023-09-29T23:23:45.467402+0000","last_active":"2023-09-29T23:23:45.473383+0000","last_peered":"2023-09-29T23:23:45.473383+0000","last_clean":"2023-09-29T23:23:45.473383+0000","last_became_active":"2023-09-29T23:23:45.467178+0000","last_became_peered":"2023-09-29T23:23:45.467178+0000","last_unstale":"2023-09-29T23:23:45.473383+0000","last_undegraded":"2023-09-29T23:23:45.473383+0000","last_fullsized":"2023-09-29T23:23:45.473383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472302+0000","last_change":"2023-09-29T23:23:45.465231+0000","last_active":"2023-09-29T23:23:45.472302+0000","last_peered":"2023-09-29T23:23:45.472302+0000","last_clean":"2023-09-29T23:23:45.472302+0000","last_became_active":"2023-09-29T23:23:45.464523+0000","last_became_peered":"2023-09-29T23:23:45.464523+0000","last_unstale":"2023-09-29T23:23:45.472302+0000","last_undegraded":"2023-09-29T23:23:45.472302+0000","last_fullsized":"2023-09-29T23:23:45.472302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:32.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471955+0000","last_change":"2023-09-29T23:23:45.470349+0000","last_active":"2023-09-29T23:23:45.471955+0000","last_peered":"2023-09-29T23:23:45.471955+0000","last_clean":"2023-09-29T23:23:45.471955+0000","last_became_active":"2023-09-29T23:23:45.467004+0000","last_became_peered":"2023-09-29T23:23:45.467004+0000","last_unstale":"2023-09-29T23:23:45.471955+0000","last_undegraded":"2023-09-29T23:23:45.471955+0000","last_fullsized":"2023-09-29T23:23:45.471955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471536+0000","last_change":"2023-09-29T23:23:45.471536+0000","last_active":"2023-09-29T23:23:45.471536+0000","last_peered":"2023-09-29T23:23:45.471536+0000","last_clean":"2023-09-29T23:23:45.471536+0000","last_became_active":"2023-09-29T23:23:45.471334+0000","last_became_peered":"2023-09-29T23:23:45.471334+0000","last_unstale":"2023-09-29T23:23:45.471536+0000","last_undegraded":"2023-09-29T23:23:45.471536+0000","last_fullsized":"2023-09-29T23:23:45.471536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470193+0000","last_change":"2023-09-29T23:23:45.468857+0000","last_active":"2023-09-29T23:23:45.470193+0000","last_peered":"2023-09-29T23:23:45.470193+0000","last_clean":"2023-09-29T23:23:45.470193+0000","last_became_active":"2023-09-29T23:23:45.468001+0000","last_became_peered":"2023-09-29T23:23:45.468001+0000","last_unstale":"2023-09-29T23:23:45.470193+0000","last_undegraded":"2023-09-29T23:23:45.470193+0000","last_fullsized":"2023-09-29T23:23:45.470193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:11.211646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467819+0000","last_change":"2023-09-29T23:23:45.467819+0000","last_active":"2023-09-29T23:23:45.467819+0000","last_peered":"2023-09-29T23:23:45.467819+0000","last_clean":"2023-09-29T23:23:45.467819+0000","last_became_active":"2023-09-29T23:23:45.467434+0000","last_became_peered":"2023-09-29T23:23:45.467434+0000","last_unstale":"2023-09-29T23:23:45.467819+0000","last_undegraded":"2023-09-29T23:23:45.467819+0000","last_fullsized":"2023-09-29T23:23:45.467819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479225+0000","last_change":"2023-09-29T23:23:45.473751+0000","last_active":"2023-09-29T23:23:45.479225+0000","last_peered":"2023-09-29T23:23:45.479225+0000","last_clean":"2023-09-29T23:23:45.479225+0000","last_became_active":"2023-09-29T23:23:45.473326+0000","last_became_peered":"2023-09-29T23:23:45.473326+0000","last_unstale":"2023-09-29T23:23:45.479225+0000","last_undegraded":"2023-09-29T23:23:45.479225+0000","last_fullsized":"2023-09-29T23:23:45.479225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:21:17.261104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473427+0000","last_change":"2023-09-29T23:23:45.467719+0000","last_active":"2023-09-29T23:23:45.473427+0000","last_peered":"2023-09-29T23:23:45.473427+0000","last_clean":"2023-09-29T23:23:45.473427+0000","last_became_active":"2023-09-29T23:23:45.467494+0000","last_became_peered":"2023-09-29T23:23:45.467494+0000","last_unstale":"2023-09-29T23:23:45.473427+0000","last_undegraded":"2023-09-29T23:23:45.473427+0000","last_fullsized":"2023-09-29T23:23:45.473427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479563+0000","last_change":"2023-09-29T23:23:45.478055+0000","last_active":"2023-09-29T23:23:45.479563+0000","last_peered":"2023-09-29T23:23:45.479563+0000","last_clean":"2023-09-29T23:23:45.479563+0000","last_became_active":"2023-09-29T23:23:45.477408+0000","last_became_peered":"2023-09-29T23:23:45.477408+0000","last_unstale":"2023-09-29T23:23:45.479563+0000","last_undegraded":"2023-09-29T23:23:45.479563+0000","last_fullsized":"2023-09-29T23:23:45.479563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:14:56.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474548+0000","last_change":"2023-09-29T23:23:45.471232+0000","last_active":"2023-09-29T23:23:45.474548+0000","last_peered":"2023-09-29T23:23:45.474548+0000","last_clean":"2023-09-29T23:23:45.474548+0000","last_became_active":"2023-09-29T23:23:45.470574+0000","last_became_peered":"2023-09-29T23:23:45.470574+0000","last_unstale":"2023-09-29T23:23:45.474548+0000","last_undegraded":"2023-09-29T23:23:45.474548+0000","last_fullsized":"2023-09-29T23:23:45.474548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:25:25.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479248+0000","last_change":"2023-09-29T23:23:45.474093+0000","last_active":"2023-09-29T23:23:45.479248+0000","last_peered":"2023-09-29T23:23:45.479248+0000","last_clean":"2023-09-29T23:23:45.479248+0000","last_became_active":"2023-09-29T23:23:45.473789+0000","last_became_peered":"2023-09-29T23:23:45.473789+0000","last_unstale":"2023-09-29T23:23:45.479248+0000","last_undegraded":"2023-09-29T23:23:45.479248+0000","last_fullsized":"2023-09-29T23:23:45.479248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:46.564456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472272+0000","last_change":"2023-09-29T23:23:45.465993+0000","last_active":"2023-09-29T23:23:45.472272+0000","last_peered":"2023-09-29T23:23:45.472272+0000","last_clean":"2023-09-29T23:23:45.472272+0000","last_became_active":"2023-09-29T23:23:45.465443+0000","last_became_peered":"2023-09-29T23:23:45.465443+0000","last_unstale":"2023-09-29T23:23:45.472272+0000","last_undegraded":"2023-09-29T23:23:45.472272+0000","last_fullsized":"2023-09-29T23:23:45.472272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:12:18.769461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.458032+0000","last_change":"2023-09-29T23:23:45.458032+0000","last_active":"2023-09-29T23:23:45.458032+0000","last_peered":"2023-09-29T23:23:45.458032+0000","last_clean":"2023-09-29T23:23:45.458032+0000","last_became_active":"2023-09-29T23:23:45.457799+0000","last_became_peered":"2023-09-29T23:23:45.457799+0000","last_unstale":"2023-09-29T23:23:45.458032+0000","last_undegraded":"2023-09-29T23:23:45.458032+0000","last_fullsized":"2023-09-29T23:23:45.458032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:21:07.207937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467967+0000","last_change":"2023-09-29T23:23:45.467967+0000","last_active":"2023-09-29T23:23:45.467967+0000","last_peered":"2023-09-29T23:23:45.467967+0000","last_clean":"2023-09-29T23:23:45.467967+0000","last_became_active":"2023-09-29T23:23:45.467730+0000","last_became_peered":"2023-09-29T23:23:45.467730+0000","last_unstale":"2023-09-29T23:23:45.467967+0000","last_undegraded":"2023-09-29T23:23:45.467967+0000","last_fullsized":"2023-09-29T23:23:45.467967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:23:19.840400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475084+0000","last_change":"2023-09-29T23:23:45.076072+0000","last_active":"2023-09-29T23:23:45.475084+0000","last_peered":"2023-09-29T23:23:45.475084+0000","last_clean":"2023-09-29T23:23:45.475084+0000","last_became_active":"2023-09-29T23:23:45.075848+0000","last_became_peered":"2023-09-29T23:23:45.075848+0000","last_unstale":"2023-09-29T23:23:45.475084+0000","last_undegraded":"2023-09-29T23:23:45.475084+0000","last_fullsized":"2023-09-29T23:23:45.475084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:29:13.914085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.464208+0000","last_change":"2023-09-29T23:23:45.462781+0000","last_active":"2023-09-29T23:23:45.464208+0000","last_peered":"2023-09-29T23:23:45.464208+0000","last_clean":"2023-09-29T23:23:45.464208+0000","last_became_active":"2023-09-29T23:23:45.462155+0000","last_became_peered":"2023-09-29T23:23:45.462155+0000","last_unstale":"2023-09-29T23:23:45.464208+0000","last_undegraded":"2023-09-29T23:23:45.464208+0000","last_fullsized":"2023-09-29T23:23:45.464208+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:13.284557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.451173+0000","last_change":"2023-09-29T23:23:45.092553+0000","last_active":"2023-09-29T23:23:45.451173+0000","last_peered":"2023-09-29T23:23:45.451173+0000","last_clean":"2023-09-29T23:23:45.451173+0000","last_became_active":"2023-09-29T23:23:45.092273+0000","last_became_peered":"2023-09-29T23:23:45.092273+0000","last_unstale":"2023-09-29T23:23:45.451173+0000","last_undegraded":"2023-09-29T23:23:45.451173+0000","last_fullsized":"2023-09-29T23:23:45.451173+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472939+0000","last_change":"2023-09-29T23:23:45.464637+0000","last_active":"2023-09-29T23:23:45.472939+0000","last_peered":"2023-09-29T23:23:45.472939+0000","last_clean":"2023-09-29T23:23:45.472939+0000","last_became_active":"2023-09-29T23:23:45.464027+0000","last_became_peered":"2023-09-29T23:23:45.464027+0000","last_unstale":"2023-09-29T23:23:45.472939+0000","last_undegraded":"2023-09-29T23:23:45.472939+0000","last_fullsized":"2023-09-29T23:23:45.472939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.449247+0000","last_change":"2023-09-29T23:23:45.088658+0000","last_active":"2023-09-29T23:23:45.449247+0000","last_peered":"2023-09-29T23:23:45.449247+0000","last_clean":"2023-09-29T23:23:45.449247+0000","last_became_active":"2023-09-29T23:23:45.088405+0000","last_became_peered":"2023-09-29T23:23:45.088405+0000","last_unstale":"2023-09-29T23:23:45.449247+0000","last_undegraded":"2023-09-29T23:23:45.449247+0000","last_fullsized":"2023-09-29T23:23:45.449247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471459+0000","last_change":"2023-09-29T23:23:45.471459+0000","last_active":"2023-09-29T23:23:45.471459+0000","last_peered":"2023-09-29T23:23:45.471459+0000","last_clean":"2023-09-29T23:23:45.471459+0000","last_became_active":"2023-09-29T23:23:45.470917+0000","last_became_peered":"2023-09-29T23:23:45.470917+0000","last_unstale":"2023-09-29T23:23:45.471459+0000","last_undegraded":"2023-09-29T23:23:45.471459+0000","last_fullsized":"2023-09-29T23:23:45.471459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:29:34.889615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.444294+0000","last_change":"2023-09-29T23:23:45.070764+0000","last_active":"2023-09-29T23:23:45.444294+0000","last_peered":"2023-09-29T23:23:45.444294+0000","last_clean":"2023-09-29T23:23:45.444294+0000","last_became_active":"2023-09-29T23:23:45.070610+0000","last_became_peered":"2023-09-29T23:23:45.070610+0000","last_unstale":"2023-09-29T23:23:45.444294+0000","last_undegraded":"2023-09-29T23:23:45.444294+0000","last_fullsized":"2023-09-29T23:23:45.444294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:26:19.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.477784+0000","last_change":"2023-09-29T23:23:45.475877+0000","last_active":"2023-09-29T23:23:45.477784+0000","last_peered":"2023-09-29T23:23:45.477784+0000","last_clean":"2023-09-29T23:23:45.477784+0000","last_became_active":"2023-09-29T23:23:45.475634+0000","last_became_peered":"2023-09-29T23:23:45.475634+0000","last_unstale":"2023-09-29T23:23:45.477784+0000","last_undegraded":"2023-09-29T23:23:45.477784+0000","last_fullsized":"2023-09-29T23:23:45.477784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:59:25.888959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.458483+0000","last_change":"2023-09-29T23:23:45.091556+0000","last_active":"2023-09-29T23:23:45.458483+0000","last_peered":"2023-09-29T23:23:45.458483+0000","last_clean":"2023-09-29T23:23:45.458483+0000","last_became_active":"2023-09-29T23:23:45.091317+0000","last_became_peered":"2023-09-29T23:23:45.091317+0000","last_unstale":"2023-09-29T23:23:45.458483+0000","last_undegraded":"2023-09-29T23:23:45.458483+0000","last_fullsized":"2023-09-29T23:23:45.458483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:53.097532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.458805+0000","last_change":"2023-09-29T23:23:45.458805+0000","last_active":"2023-09-29T23:23:45.458805+0000","last_peered":"2023-09-29T23:23:45.458805+0000","last_clean":"2023-09-29T23:23:45.458805+0000","last_became_active":"2023-09-29T23:23:45.458585+0000","last_became_peered":"2023-09-29T23:23:45.458585+0000","last_unstale":"2023-09-29T23:23:45.458805+0000","last_undegraded":"2023-09-29T23:23:45.458805+0000","last_fullsized":"2023-09-29T23:23:45.458805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:05:18.350431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.446151+0000","last_change":"2023-09-29T23:23:45.071269+0000","last_active":"2023-09-29T23:23:45.446151+0000","last_peered":"2023-09-29T23:23:45.446151+0000","last_clean":"2023-09-29T23:23:45.446151+0000","last_became_active":"2023-09-29T23:23:45.070986+0000","last_became_peered":"2023-09-29T23:23:45.070986+0000","last_unstale":"2023-09-29T23:23:45.446151+0000","last_undegraded":"2023-09-29T23:23:45.446151+0000","last_fullsized":"2023-09-29T23:23:45.446151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:29.355473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472807+0000","last_change":"2023-09-29T23:23:45.464917+0000","last_active":"2023-09-29T23:23:45.472807+0000","last_peered":"2023-09-29T23:23:45.472807+0000","last_clean":"2023-09-29T23:23:45.472807+0000","last_became_active":"2023-09-29T23:23:45.464510+0000","last_became_peered":"2023-09-29T23:23:45.464510+0000","last_unstale":"2023-09-29T23:23:45.472807+0000","last_undegraded":"2023-09-29T23:23:45.472807+0000","last_fullsized":"2023-09-29T23:23:45.472807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:58:16.565151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475769+0000","last_change":"2023-09-29T23:23:45.077097+0000","last_active":"2023-09-29T23:23:45.475769+0000","last_peered":"2023-09-29T23:23:45.475769+0000","last_clean":"2023-09-29T23:23:45.475769+0000","last_became_active":"2023-09-29T23:23:45.076856+0000","last_became_peered":"2023-09-29T23:23:45.076856+0000","last_unstale":"2023-09-29T23:23:45.475769+0000","last_undegraded":"2023-09-29T23:23:45.475769+0000","last_fullsized":"2023-09-29T23:23:45.475769+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:00:28.816753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.464231+0000","last_change":"2023-09-29T23:23:45.462198+0000","last_active":"2023-09-29T23:23:45.464231+0000","last_peered":"2023-09-29T23:23:45.464231+0000","last_clean":"2023-09-29T23:23:45.464231+0000","last_became_active":"2023-09-29T23:23:45.461199+0000","last_became_peered":"2023-09-29T23:23:45.461199+0000","last_unstale":"2023-09-29T23:23:45.464231+0000","last_undegraded":"2023-09-29T23:23:45.464231+0000","last_fullsized":"2023-09-29T23:23:45.464231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:33.901646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"16'6","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.476072+0000","last_change":"2023-09-29T23:23:45.093720+0000","last_active":"2023-09-29T23:23:45.476072+0000","last_peered":"2023-09-29T23:23:45.476072+0000","last_clean":"2023-09-29T23:23:45.476072+0000","last_became_active":"2023-09-29T23:23:45.093487+0000","last_became_peered":"2023-09-29T23:23:45.093487+0000","last_unstale":"2023-09-29T23:23:45.476072+0000","last_undegraded":"2023-09-29T23:23:45.476072+0000","last_fullsized":"2023-09-29T23:23:45.476072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473468+0000","last_change":"2023-09-29T23:23:45.466875+0000","last_active":"2023-09-29T23:23:45.473468+0000","last_peered":"2023-09-29T23:23:45.473468+0000","last_clean":"2023-09-29T23:23:45.473468+0000","last_became_active":"2023-09-29T23:23:45.466667+0000","last_became_peered":"2023-09-29T23:23:45.466667+0000","last_unstale":"2023-09-29T23:23:45.473468+0000","last_undegraded":"2023-09-29T23:23:45.473468+0000","last_fullsized":"2023-09-29T23:23:45.473468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:19.696930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.480207+0000","last_change":"2023-09-29T23:23:45.089727+0000","last_active":"2023-09-29T23:23:45.480207+0000","last_peered":"2023-09-29T23:23:45.480207+0000","last_clean":"2023-09-29T23:23:45.480207+0000","last_became_active":"2023-09-29T23:23:45.089450+0000","last_became_peered":"2023-09-29T23:23:45.089450+0000","last_unstale":"2023-09-29T23:23:45.480207+0000","last_undegraded":"2023-09-29T23:23:45.480207+0000","last_fullsized":"2023-09-29T23:23:45.480207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473639+0000","last_change":"2023-09-29T23:23:45.468316+0000","last_active":"2023-09-29T23:23:45.473639+0000","last_peered":"2023-09-29T23:23:45.473639+0000","last_clean":"2023-09-29T23:23:45.473639+0000","last_became_active":"2023-09-29T23:23:45.464801+0000","last_became_peered":"2023-09-29T23:23:45.464801+0000","last_unstale":"2023-09-29T23:23:45.473639+0000","last_undegraded":"2023-09-29T23:23:45.473639+0000","last_fullsized":"2023-09-29T23:23:45.473639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.096689+0000","last_change":"2023-09-29T23:23:45.093148+0000","last_active":"2023-09-29T23:23:45.096689+0000","last_peered":"2023-09-29T23:23:45.096689+0000","last_clean":"2023-09-29T23:23:45.096689+0000","last_became_active":"2023-09-29T23:23:45.092902+0000","last_became_peered":"2023-09-29T23:23:45.092902+0000","last_unstale":"2023-09-29T23:23:45.096689+0000","last_undegraded":"2023-09-29T23:23:45.096689+0000","last_fullsized":"2023-09-29T23:23:45.096689+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470060+0000","last_change":"2023-09-29T23:23:45.466007+0000","last_active":"2023-09-29T23:23:45.470060+0000","last_peered":"2023-09-29T23:23:45.470060+0000","last_clean":"2023-09-29T23:23:45.470060+0000","last_became_active":"2023-09-29T23:23:45.465743+0000","last_became_peered":"2023-09-29T23:23:45.465743+0000","last_unstale":"2023-09-29T23:23:45.470060+0000","last_undegraded":"2023-09-29T23:23:45.470060+0000","last_fullsized":"2023-09-29T23:23:45.470060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.448899+0000","last_change":"2023-09-29T23:23:45.072234+0000","last_active":"2023-09-29T23:23:45.448899+0000","last_peered":"2023-09-29T23:23:45.448899+0000","last_clean":"2023-09-29T23:23:45.448899+0000","last_became_active":"2023-09-29T23:23:45.072009+0000","last_became_peered":"2023-09-29T23:23:45.072009+0000","last_unstale":"2023-09-29T23:23:45.448899+0000","last_undegraded":"2023-09-29T23:23:45.448899+0000","last_fullsized":"2023-09-29T23:23:45.448899+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471991+0000","last_change":"2023-09-29T23:23:45.466374+0000","last_active":"2023-09-29T23:23:45.471991+0000","last_peered":"2023-09-29T23:23:45.471991+0000","last_clean":"2023-09-29T23:23:45.471991+0000","last_became_active":"2023-09-29T23:23:45.466169+0000","last_became_peered":"2023-09-29T23:23:45.466169+0000","last_unstale":"2023-09-29T23:23:45.471991+0000","last_undegraded":"2023-09-29T23:23:45.471991+0000","last_fullsized":"2023-09-29T23:23:45.471991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"16'8","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475600+0000","last_change":"2023-09-29T23:23:45.091762+0000","last_active":"2023-09-29T23:23:45.475600+0000","last_peered":"2023-09-29T23:23:45.475600+0000","last_clean":"2023-09-29T23:23:45.475600+0000","last_became_active":"2023-09-29T23:23:45.091386+0000","last_became_peered":"2023-09-29T23:23:45.091386+0000","last_unstale":"2023-09-29T23:23:45.475600+0000","last_undegraded":"2023-09-29T23:23:45.475600+0000","last_fullsized":"2023-09-29T23:23:45.475600+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.461421+0000","last_change":"2023-09-29T23:23:45.461421+0000","last_active":"2023-09-29T23:23:45.461421+0000","last_peered":"2023-09-29T23:23:45.461421+0000","last_clean":"2023-09-29T23:23:45.461421+0000","last_became_active":"2023-09-29T23:23:45.460643+0000","last_became_peered":"2023-09-29T23:23:45.460643+0000","last_unstale":"2023-09-29T23:23:45.461421+0000","last_undegraded":"2023-09-29T23:23:45.461421+0000","last_fullsized":"2023-09-29T23:23:45.461421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:12:32.105911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.480077+0000","last_change":"2023-09-29T23:23:45.078091+0000","last_active":"2023-09-29T23:23:45.480077+0000","last_peered":"2023-09-29T23:23:45.480077+0000","last_clean":"2023-09-29T23:23:45.480077+0000","last_became_active":"2023-09-29T23:23:45.077734+0000","last_became_peered":"2023-09-29T23:23:45.077734+0000","last_unstale":"2023-09-29T23:23:45.480077+0000","last_undegraded":"2023-09-29T23:23:45.480077+0000","last_fullsized":"2023-09-29T23:23:45.480077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:53.097532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467950+0000","last_change":"2023-09-29T23:23:45.467950+0000","last_active":"2023-09-29T23:23:45.467950+0000","last_peered":"2023-09-29T23:23:45.467950+0000","last_clean":"2023-09-29T23:23:45.467950+0000","last_became_active":"2023-09-29T23:23:45.467555+0000","last_became_peered":"2023-09-29T23:23:45.467555+0000","last_unstale":"2023-09-29T23:23:45.467950+0000","last_undegraded":"2023-09-29T23:23:45.467950+0000","last_fullsized":"2023-09-29T23:23:45.467950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"16'2","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467306+0000","last_change":"2023-09-29T23:23:45.092471+0000","last_active":"2023-09-29T23:23:45.467306+0000","last_peered":"2023-09-29T23:23:45.467306+0000","last_clean":"2023-09-29T23:23:45.467306+0000","last_became_active":"2023-09-29T23:23:45.092185+0000","last_became_peered":"2023-09-29T23:23:45.092185+0000","last_unstale":"2023-09-29T23:23:45.467306+0000","last_undegraded":"2023-09-29T23:23:45.467306+0000","last_fullsized":"2023-09-29T23:23:45.467306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472722+0000","last_change":"2023-09-29T23:23:45.464504+0000","last_active":"2023-09-29T23:23:45.472722+0000","last_peered":"2023-09-29T23:23:45.472722+0000","last_clean":"2023-09-29T23:23:45.472722+0000","last_became_active":"2023-09-29T23:23:45.463806+0000","last_became_peered":"2023-09-29T23:23:45.463806+0000","last_unstale":"2023-09-29T23:23:45.472722+0000","last_undegraded":"2023-09-29T23:23:45.472722+0000","last_fullsized":"2023-09-29T23:23:45.472722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:25:25.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475877+0000","last_change":"2023-09-29T23:23:45.088776+0000","last_active":"2023-09-29T23:23:45.475877+0000","last_peered":"2023-09-29T23:23:45.475877+0000","last_clean":"2023-09-29T23:23:45.475877+0000","last_became_active":"2023-09-29T23:23:45.088535+0000","last_became_peered":"2023-09-29T23:23:45.088535+0000","last_unstale":"2023-09-29T23:23:45.475877+0000","last_undegraded":"2023-09-29T23:23:45.475877+0000","last_fullsized":"2023-09-29T23:23:45.475877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:35:07.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473390+0000","last_change":"2023-09-29T23:23:45.466379+0000","last_active":"2023-09-29T23:23:45.473390+0000","last_peered":"2023-09-29T23:23:45.473390+0000","last_clean":"2023-09-29T23:23:45.473390+0000","last_became_active":"2023-09-29T23:23:45.465855+0000","last_became_peered":"2023-09-29T23:23:45.465855+0000","last_unstale":"2023-09-29T23:23:45.473390+0000","last_undegraded":"2023-09-29T23:23:45.473390+0000","last_fullsized":"2023-09-29T23:23:45.473390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:06.275738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.096676+0000","last_change":"2023-09-29T23:23:45.092714+0000","last_active":"2023-09-29T23:23:45.096676+0000","last_peered":"2023-09-29T23:23:45.096676+0000","last_clean":"2023-09-29T23:23:45.096676+0000","last_became_active":"2023-09-29T23:23:45.092476+0000","last_became_peered":"2023-09-29T23:23:45.092476+0000","last_unstale":"2023-09-29T23:23:45.096676+0000","last_undegraded":"2023-09-29T23:23:45.096676+0000","last_fullsized":"2023-09-29T23:23:45.096676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:20:23.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.469720+0000","last_change":"2023-09-29T23:23:45.467010+0000","last_active":"2023-09-29T23:23:45.469720+0000","last_peered":"2023-09-29T23:23:45.469720+0000","last_clean":"2023-09-29T23:23:45.469720+0000","last_became_active":"2023-09-29T23:23:45.466694+0000","last_became_peered":"2023-09-29T23:23:45.466694+0000","last_unstale":"2023-09-29T23:23:45.469720+0000","last_undegraded":"2023-09-29T23:23:45.469720+0000","last_fullsized":"2023-09-29T23:23:45.469720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.484451+0000","last_change":"2023-09-29T23:23:45.089622+0000","last_active":"2023-09-29T23:23:45.484451+0000","last_peered":"2023-09-29T23:23:45.484451+0000","last_clean":"2023-09-29T23:23:45.484451+0000","last_became_active":"2023-09-29T23:23:45.089176+0000","last_became_peered":"2023-09-29T23:23:45.089176+0000","last_unstale":"2023-09-29T23:23:45.484451+0000","last_undegraded":"2023-09-29T23:23:45.484451+0000","last_fullsized":"2023-09-29T23:23:45.484451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472323+0000","last_change":"2023-09-29T23:23:45.465798+0000","last_active":"2023-09-29T23:23:45.472323+0000","last_peered":"2023-09-29T23:23:45.472323+0000","last_clean":"2023-09-29T23:23:45.472323+0000","last_became_active":"2023-09-29T23:23:45.465127+0000","last_became_peered":"2023-09-29T23:23:45.465127+0000","last_unstale":"2023-09-29T23:23:45.472323+0000","last_undegraded":"2023-09-29T23:23:45.472323+0000","last_fullsized":"2023-09-29T23:23:45.472323+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:33.901646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450509+0000","last_change":"2023-09-29T23:23:45.075630+0000","last_active":"2023-09-29T23:23:45.450509+0000","last_peered":"2023-09-29T23:23:45.450509+0000","last_clean":"2023-09-29T23:23:45.450509+0000","last_became_active":"2023-09-29T23:23:45.075313+0000","last_became_peered":"2023-09-29T23:23:45.075313+0000","last_unstale":"2023-09-29T23:23:45.450509+0000","last_undegraded":"2023-09-29T23:23:45.450509+0000","last_fullsized":"2023-09-29T23:23:45.450509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:59:03.439349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470041+0000","last_change":"2023-09-29T23:23:45.465956+0000","last_active":"2023-09-29T23:23:45.470041+0000","last_peered":"2023-09-29T23:23:45.470041+0000","last_clean":"2023-09-29T23:23:45.470041+0000","last_became_active":"2023-09-29T23:23:45.465599+0000","last_became_peered":"2023-09-29T23:23:45.465599+0000","last_unstale":"2023-09-29T23:23:45.470041+0000","last_undegraded":"2023-09-29T23:23:45.470041+0000","last_fullsized":"2023-09-29T23:23:45.470041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:29:34.889615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450944+0000","last_change":"2023-09-29T23:23:45.075998+0000","last_active":"2023-09-29T23:23:45.450944+0000","last_peered":"2023-09-29T23:23:45.450944+0000","last_clean":"2023-09-29T23:23:45.450944+0000","last_became_active":"2023-09-29T23:23:45.075772+0000","last_became_peered":"2023-09-29T23:23:45.075772+0000","last_unstale":"2023-09-29T23:23:45.450944+0000","last_undegraded":"2023-09-29T23:23:45.450944+0000","last_fullsized":"2023-09-29T23:23:45.450944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:12:24.809572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.463124+0000","last_change":"2023-09-29T23:23:45.463124+0000","last_active":"2023-09-29T23:23:45.463124+0000","last_peered":"2023-09-29T23:23:45.463124+0000","last_clean":"2023-09-29T23:23:45.463124+0000","last_became_active":"2023-09-29T23:23:45.462583+0000","last_became_peered":"2023-09-29T23:23:45.462583+0000","last_unstale":"2023-09-29T23:23:45.463124+0000","last_undegraded":"2023-09-29T23:23:45.463124+0000","last_fullsized":"2023-09-29T23:23:45.463124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:01:57.571277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.444191+0000","last_change":"2023-09-29T23:23:45.088750+0000","last_active":"2023-09-29T23:23:45.444191+0000","last_peered":"2023-09-29T23:23:45.444191+0000","last_clean":"2023-09-29T23:23:45.444191+0000","last_became_active":"2023-09-29T23:23:45.088506+0000","last_became_peered":"2023-09-29T23:23:45.088506+0000","last_unstale":"2023-09-29T23:23:45.444191+0000","last_undegraded":"2023-09-29T23:23:45.444191+0000","last_fullsized":"2023-09-29T23:23:45.444191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479465+0000","last_change":"2023-09-29T23:23:45.477617+0000","last_active":"2023-09-29T23:23:45.479465+0000","last_peered":"2023-09-29T23:23:45.479465+0000","last_clean":"2023-09-29T23:23:45.479465+0000","last_became_active":"2023-09-29T23:23:45.477335+0000","last_became_peered":"2023-09-29T23:23:45.477335+0000","last_unstale":"2023-09-29T23:23:45.479465+0000","last_undegraded":"2023-09-29T23:23:45.479465+0000","last_fullsized":"2023-09-29T23:23:45.479465+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:44:09.599636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.085622+0000","last_change":"2023-09-29T23:23:41.047954+0000","last_active":"2023-09-29T23:23:45.085622+0000","last_peered":"2023-09-29T23:23:45.085622+0000","last_clean":"2023-09-29T23:23:45.085622+0000","last_became_active":"2023-09-29T23:23:41.047701+0000","last_became_peered":"2023-09-29T23:23:41.047701+0000","last_unstale":"2023-09-29T23:23:45.085622+0000","last_undegraded":"2023-09-29T23:23:45.085622+0000","last_fullsized":"2023-09-29T23:23:45.085622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:08:35.252580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.457414+0000","last_change":"2023-09-29T23:23:45.075607+0000","last_active":"2023-09-29T23:23:45.457414+0000","last_peered":"2023-09-29T23:23:45.457414+0000","last_clean":"2023-09-29T23:23:45.457414+0000","last_became_active":"2023-09-29T23:23:45.075249+0000","last_became_peered":"2023-09-29T23:23:45.075249+0000","last_unstale":"2023-09-29T23:23:45.457414+0000","last_undegraded":"2023-09-29T23:23:45.457414+0000","last_fullsized":"2023-09-29T23:23:45.457414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:55:12.692421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.460164+0000","last_change":"2023-09-29T23:23:45.460164+0000","last_active":"2023-09-29T23:23:45.460164+0000","last_peered":"2023-09-29T23:23:45.460164+0000","last_clean":"2023-09-29T23:23:45.460164+0000","last_became_active":"2023-09-29T23:23:45.459933+0000","last_became_peered":"2023-09-29T23:23:45.459933+0000","last_unstale":"2023-09-29T23:23:45.460164+0000","last_undegraded":"2023-09-29T23:23:45.460164+0000","last_fullsized":"2023-09-29T23:23:45.460164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:25:22.017530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.453586+0000","last_change":"2023-09-29T23:23:41.051640+0000","last_active":"2023-09-29T23:23:45.453586+0000","last_peered":"2023-09-29T23:23:45.453586+0000","last_clean":"2023-09-29T23:23:45.453586+0000","last_became_active":"2023-09-29T23:23:41.051398+0000","last_became_peered":"2023-09-29T23:23:41.051398+0000","last_unstale":"2023-09-29T23:23:45.453586+0000","last_undegraded":"2023-09-29T23:23:45.453586+0000","last_fullsized":"2023-09-29T23:23:45.453586+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:49:47.548120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.476402+0000","last_change":"2023-09-29T23:23:45.076540+0000","last_active":"2023-09-29T23:23:45.476402+0000","last_peered":"2023-09-29T23:23:45.476402+0000","last_clean":"2023-09-29T23:23:45.476402+0000","last_became_active":"2023-09-29T23:23:45.076293+0000","last_became_peered":"2023-09-29T23:23:45.076293+0000","last_unstale":"2023-09-29T23:23:45.476402+0000","last_undegraded":"2023-09-29T23:23:45.476402+0000","last_fullsized":"2023-09-29T23:23:45.476402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:09.131795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474065+0000","last_change":"2023-09-29T23:23:45.466336+0000","last_active":"2023-09-29T23:23:45.474065+0000","last_peered":"2023-09-29T23:23:45.474065+0000","last_clean":"2023-09-29T23:23:45.474065+0000","last_became_active":"2023-09-29T23:23:45.466115+0000","last_became_peered":"2023-09-29T23:23:45.466115+0000","last_unstale":"2023-09-29T23:23:45.474065+0000","last_undegraded":"2023-09-29T23:23:45.474065+0000","last_fullsized":"2023-09-29T23:23:45.474065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:11.211646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450776+0000","last_change":"2023-09-29T23:23:41.050066+0000","last_active":"2023-09-29T23:23:45.450776+0000","last_peered":"2023-09-29T23:23:45.450776+0000","last_clean":"2023-09-29T23:23:45.450776+0000","last_became_active":"2023-09-29T23:23:41.049786+0000","last_became_peered":"2023-09-29T23:23:41.049786+0000","last_unstale":"2023-09-29T23:23:45.450776+0000","last_undegraded":"2023-09-29T23:23:45.450776+0000","last_fullsized":"2023-09-29T23:23:45.450776+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:22:54.699446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.096616+0000","last_change":"2023-09-29T23:23:45.091590+0000","last_active":"2023-09-29T23:23:45.096616+0000","last_peered":"2023-09-29T23:23:45.096616+0000","last_clean":"2023-09-29T23:23:45.096616+0000","last_became_active":"2023-09-29T23:23:45.091162+0000","last_became_peered":"2023-09-29T23:23:45.091162+0000","last_unstale":"2023-09-29T23:23:45.096616+0000","last_undegraded":"2023-09-29T23:23:45.096616+0000","last_fullsized":"2023-09-29T23:23:45.096616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:29:38.240697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479301+0000","last_change":"2023-09-29T23:23:45.474238+0000","last_active":"2023-09-29T23:23:45.479301+0000","last_peered":"2023-09-29T23:23:45.479301+0000","last_clean":"2023-09-29T23:23:45.479301+0000","last_became_active":"2023-09-29T23:23:45.473861+0000","last_became_peered":"2023-09-29T23:23:45.473861+0000","last_unstale":"2023-09-29T23:23:45.479301+0000","last_undegraded":"2023-09-29T23:23:45.479301+0000","last_fullsized":"2023-09-29T23:23:45.479301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:39:43.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.451691+0000","last_change":"2023-09-29T23:23:41.049685+0000","last_active":"2023-09-29T23:23:45.451691+0000","last_peered":"2023-09-29T23:23:45.451691+0000","last_clean":"2023-09-29T23:23:45.451691+0000","last_became_active":"2023-09-29T23:23:41.049442+0000","last_became_peered":"2023-09-29T23:23:41.049442+0000","last_unstale":"2023-09-29T23:23:45.451691+0000","last_undegraded":"2023-09-29T23:23:45.451691+0000","last_fullsized":"2023-09-29T23:23:45.451691+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:52:33.065724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.096707+0000","last_change":"2023-09-29T23:23:45.092293+0000","last_active":"2023-09-29T23:23:45.096707+0000","last_peered":"2023-09-29T23:23:45.096707+0000","last_clean":"2023-09-29T23:23:45.096707+0000","last_became_active":"2023-09-29T23:23:45.092042+0000","last_became_peered":"2023-09-29T23:23:45.092042+0000","last_unstale":"2023-09-29T23:23:45.096707+0000","last_undegraded":"2023-09-29T23:23:45.096707+0000","last_fullsized":"2023-09-29T23:23:45.096707+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:07:16.838088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.466547+0000","last_change":"2023-09-29T23:23:45.461917+0000","last_active":"2023-09-29T23:23:45.466547+0000","last_peered":"2023-09-29T23:23:45.466547+0000","last_clean":"2023-09-29T23:23:45.466547+0000","last_became_active":"2023-09-29T23:23:45.461228+0000","last_became_peered":"2023-09-29T23:23:45.461228+0000","last_unstale":"2023-09-29T23:23:45.466547+0000","last_undegraded":"2023-09-29T23:23:45.466547+0000","last_fullsized":"2023-09-29T23:23:45.466547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:54:19.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450606+0000","last_change":"2023-09-29T23:23:41.051041+0000","last_active":"2023-09-29T23:23:45.450606+0000","last_peered":"2023-09-29T23:23:45.450606+0000","last_clean":"2023-09-29T23:23:45.450606+0000","last_became_active":"2023-09-29T23:23:41.050731+0000","last_became_peered":"2023-09-29T23:23:41.050731+0000","last_unstale":"2023-09-29T23:23:45.450606+0000","last_undegraded":"2023-09-29T23:23:45.450606+0000","last_fullsized":"2023-09-29T23:23:45.450606+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:20.303147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450701+0000","last_change":"2023-09-29T23:23:45.088759+0000","last_active":"2023-09-29T23:23:45.450701+0000","last_peered":"2023-09-29T23:23:45.450701+0000","last_clean":"2023-09-29T23:23:45.450701+0000","last_became_active":"2023-09-29T23:23:45.088510+0000","last_became_peered":"2023-09-29T23:23:45.088510+0000","last_unstale":"2023-09-29T23:23:45.450701+0000","last_undegraded":"2023-09-29T23:23:45.450701+0000","last_fullsized":"2023-09-29T23:23:45.450701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:27:56.918672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.477404+0000","last_change":"2023-09-29T23:23:45.472092+0000","last_active":"2023-09-29T23:23:45.477404+0000","last_peered":"2023-09-29T23:23:45.477404+0000","last_clean":"2023-09-29T23:23:45.477404+0000","last_became_active":"2023-09-29T23:23:45.461672+0000","last_became_peered":"2023-09-29T23:23:45.461672+0000","last_unstale":"2023-09-29T23:23:45.477404+0000","last_undegraded":"2023-09-29T23:23:45.477404+0000","last_fullsized":"2023-09-29T23:23:45.477404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:58:16.565151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.084530+0000","last_change":"2023-09-29T23:23:41.047062+0000","last_active":"2023-09-29T23:23:45.084530+0000","last_peered":"2023-09-29T23:23:45.084530+0000","last_clean":"2023-09-29T23:23:45.084530+0000","last_became_active":"2023-09-29T23:23:41.046803+0000","last_became_peered":"2023-09-29T23:23:41.046803+0000","last_unstale":"2023-09-29T23:23:45.084530+0000","last_undegraded":"2023-09-29T23:23:45.084530+0000","last_fullsized":"2023-09-29T23:23:45.084530+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:22:14.657466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.451787+0000","last_change":"2023-09-29T23:23:45.073226+0000","last_active":"2023-09-29T23:23:45.451787+0000","last_peered":"2023-09-29T23:23:45.451787+0000","last_clean":"2023-09-29T23:23:45.451787+0000","last_became_active":"2023-09-29T23:23:45.072973+0000","last_became_peered":"2023-09-29T23:23:45.072973+0000","last_unstale":"2023-09-29T23:23:45.451787+0000","last_undegraded":"2023-09-29T23:23:45.451787+0000","last_fullsized":"2023-09-29T23:23:45.451787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:27:56.918672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479531+0000","last_change":"2023-09-29T23:23:45.477628+0000","last_active":"2023-09-29T23:23:45.479531+0000","last_peered":"2023-09-29T23:23:45.479531+0000","last_clean":"2023-09-29T23:23:45.479531+0000","last_became_active":"2023-09-29T23:23:45.474318+0000","last_became_peered":"2023-09-29T23:23:45.474318+0000","last_unstale":"2023-09-29T23:23:45.479531+0000","last_undegraded":"2023-09-29T23:23:45.479531+0000","last_fullsized":"2023-09-29T23:23:45.479531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:46:02.634499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.457485+0000","last_change":"2023-09-29T23:23:41.050883+0000","last_active":"2023-09-29T23:23:45.457485+0000","last_peered":"2023-09-29T23:23:45.457485+0000","last_clean":"2023-09-29T23:23:45.457485+0000","last_became_active":"2023-09-29T23:23:41.050639+0000","last_became_peered":"2023-09-29T23:23:41.050639+0000","last_unstale":"2023-09-29T23:23:45.457485+0000","last_undegraded":"2023-09-29T23:23:45.457485+0000","last_fullsized":"2023-09-29T23:23:45.457485+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:35:26.897753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.457867+0000","last_change":"2023-09-29T23:23:45.077040+0000","last_active":"2023-09-29T23:23:45.457867+0000","last_peered":"2023-09-29T23:23:45.457867+0000","last_clean":"2023-09-29T23:23:45.457867+0000","last_became_active":"2023-09-29T23:23:45.076806+0000","last_became_peered":"2023-09-29T23:23:45.076806+0000","last_unstale":"2023-09-29T23:23:45.457867+0000","last_undegraded":"2023-09-29T23:23:45.457867+0000","last_fullsized":"2023-09-29T23:23:45.457867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:26:19.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.463631+0000","last_change":"2023-09-29T23:23:45.462067+0000","last_active":"2023-09-29T23:23:45.463631+0000","last_peered":"2023-09-29T23:23:45.463631+0000","last_clean":"2023-09-29T23:23:45.463631+0000","last_became_active":"2023-09-29T23:23:45.460913+0000","last_became_peered":"2023-09-29T23:23:45.460913+0000","last_unstale":"2023-09-29T23:23:45.463631+0000","last_undegraded":"2023-09-29T23:23:45.463631+0000","last_fullsized":"2023-09-29T23:23:45.463631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:06.275738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.458336+0000","last_change":"2023-09-29T23:23:41.050074+0000","last_active":"2023-09-29T23:23:45.458336+0000","last_peered":"2023-09-29T23:23:45.458336+0000","last_clean":"2023-09-29T23:23:45.458336+0000","last_became_active":"2023-09-29T23:23:41.049783+0000","last_became_peered":"2023-09-29T23:23:41.049783+0000","last_unstale":"2023-09-29T23:23:45.458336+0000","last_undegraded":"2023-09-29T23:23:45.458336+0000","last_fullsized":"2023-09-29T23:23:45.458336+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:37:01.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.453746+0000","last_change":"2023-09-29T23:23:45.076087+0000","last_active":"2023-09-29T23:23:45.453746+0000","last_peered":"2023-09-29T23:23:45.453746+0000","last_clean":"2023-09-29T23:23:45.453746+0000","last_became_active":"2023-09-29T23:23:45.075273+0000","last_became_peered":"2023-09-29T23:23:45.075273+0000","last_unstale":"2023-09-29T23:23:45.453746+0000","last_undegraded":"2023-09-29T23:23:45.453746+0000","last_fullsized":"2023-09-29T23:23:45.453746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:27.356997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.459071+0000","last_change":"2023-09-29T23:23:45.459071+0000","last_active":"2023-09-29T23:23:45.459071+0000","last_peered":"2023-09-29T23:23:45.459071+0000","last_clean":"2023-09-29T23:23:45.459071+0000","last_became_active":"2023-09-29T23:23:45.458250+0000","last_became_peered":"2023-09-29T23:23:45.458250+0000","last_unstale":"2023-09-29T23:23:45.459071+0000","last_undegraded":"2023-09-29T23:23:45.459071+0000","last_fullsized":"2023-09-29T23:23:45.459071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.478408+0000","last_change":"2023-09-29T23:23:45.076932+0000","last_active":"2023-09-29T23:23:45.478408+0000","last_peered":"2023-09-29T23:23:45.478408+0000","last_clean":"2023-09-29T23:23:45.478408+0000","last_became_active":"2023-09-29T23:23:45.076638+0000","last_became_peered":"2023-09-29T23:23:45.076638+0000","last_unstale":"2023-09-29T23:23:45.478408+0000","last_undegraded":"2023-09-29T23:23:45.478408+0000","last_fullsized":"2023-09-29T23:23:45.478408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:35:07.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471332+0000","last_change":"2023-09-29T23:23:45.471332+0000","last_active":"2023-09-29T23:23:45.471332+0000","last_peered":"2023-09-29T23:23:45.471332+0000","last_clean":"2023-09-29T23:23:45.471332+0000","last_became_active":"2023-09-29T23:23:45.471013+0000","last_became_peered":"2023-09-29T23:23:45.471013+0000","last_unstale":"2023-09-29T23:23:45.471332+0000","last_undegraded":"2023-09-29T23:23:45.471332+0000","last_fullsized":"2023-09-29T23:23:45.471332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479907+0000","last_change":"2023-09-29T23:23:45.076405+0000","last_active":"2023-09-29T23:23:45.479907+0000","last_peered":"2023-09-29T23:23:45.479907+0000","last_clean":"2023-09-29T23:23:45.479907+0000","last_became_active":"2023-09-29T23:23:45.076191+0000","last_became_peered":"2023-09-29T23:23:45.076191+0000","last_unstale":"2023-09-29T23:23:45.479907+0000","last_undegraded":"2023-09-29T23:23:45.479907+0000","last_fullsized":"2023-09-29T23:23:45.479907+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:20:23.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.477541+0000","last_change":"2023-09-29T23:23:45.471929+0000","last_active":"2023-09-29T23:23:45.477541+0000","last_peered":"2023-09-29T23:23:45.477541+0000","last_clean":"2023-09-29T23:23:45.477541+0000","last_became_active":"2023-09-29T23:23:45.471673+0000","last_became_peered":"2023-09-29T23:23:45.471673+0000","last_unstale":"2023-09-29T23:23:45.477541+0000","last_undegraded":"2023-09-29T23:23:45.477541+0000","last_fullsized":"2023-09-29T23:23:45.477541+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.448700+0000","last_change":"2023-09-29T23:23:45.092434+0000","last_active":"2023-09-29T23:23:45.448700+0000","last_peered":"2023-09-29T23:23:45.448700+0000","last_clean":"2023-09-29T23:23:45.448700+0000","last_became_active":"2023-09-29T23:23:45.092203+0000","last_became_peered":"2023-09-29T23:23:45.092203+0000","last_unstale":"2023-09-29T23:23:45.448700+0000","last_undegraded":"2023-09-29T23:23:45.448700+0000","last_fullsized":"2023-09-29T23:23:45.448700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472769+0000","last_change":"2023-09-29T23:23:45.464734+0000","last_active":"2023-09-29T23:23:45.472769+0000","last_peered":"2023-09-29T23:23:45.472769+0000","last_clean":"2023-09-29T23:23:45.472769+0000","last_became_active":"2023-09-29T23:23:45.464202+0000","last_became_peered":"2023-09-29T23:23:45.464202+0000","last_unstale":"2023-09-29T23:23:45.472769+0000","last_undegraded":"2023-09-29T23:23:45.472769+0000","last_fullsized":"2023-09-29T23:23:45.472769+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:59:25.888959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.480111+0000","last_change":"2023-09-29T23:23:45.074017+0000","last_active":"2023-09-29T23:23:45.480111+0000","last_peered":"2023-09-29T23:23:45.480111+0000","last_clean":"2023-09-29T23:23:45.480111+0000","last_became_active":"2023-09-29T23:23:45.073772+0000","last_became_peered":"2023-09-29T23:23:45.073772+0000","last_unstale":"2023-09-29T23:23:45.480111+0000","last_undegraded":"2023-09-29T23:23:45.480111+0000","last_fullsized":"2023-09-29T23:23:45.480111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.460786+0000","last_change":"2023-09-29T23:23:45.460786+0000","last_active":"2023-09-29T23:23:45.460786+0000","last_peered":"2023-09-29T23:23:45.460786+0000","last_clean":"2023-09-29T23:23:45.460786+0000","last_became_active":"2023-09-29T23:23:45.460548+0000","last_became_peered":"2023-09-29T23:23:45.460548+0000","last_unstale":"2023-09-29T23:23:45.460786+0000","last_undegraded":"2023-09-29T23:23:45.460786+0000","last_fullsized":"2023-09-29T23:23:45.460786+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:09:25.160546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471512+0000","last_change":"2023-09-29T23:23:45.471512+0000","last_active":"2023-09-29T23:23:45.471512+0000","last_peered":"2023-09-29T23:23:45.471512+0000","last_clean":"2023-09-29T23:23:45.471512+0000","last_became_active":"2023-09-29T23:23:45.471294+0000","last_became_peered":"2023-09-29T23:23:45.471294+0000","last_unstale":"2023-09-29T23:23:45.471512+0000","last_undegraded":"2023-09-29T23:23:45.471512+0000","last_fullsized":"2023-09-29T23:23:45.471512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:29:14.066786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.462314+0000","last_change":"2023-09-29T23:23:45.462314+0000","last_active":"2023-09-29T23:23:45.462314+0000","last_peered":"2023-09-29T23:23:45.462314+0000","last_clean":"2023-09-29T23:23:45.462314+0000","last_became_active":"2023-09-29T23:23:45.461188+0000","last_became_peered":"2023-09-29T23:23:45.461188+0000","last_unstale":"2023-09-29T23:23:45.462314+0000","last_undegraded":"2023-09-29T23:23:45.462314+0000","last_fullsized":"2023-09-29T23:23:45.462314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:01:06.913634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479183+0000","last_change":"2023-09-29T23:23:45.473685+0000","last_active":"2023-09-29T23:23:45.479183+0000","last_peered":"2023-09-29T23:23:45.479183+0000","last_clean":"2023-09-29T23:23:45.479183+0000","last_became_active":"2023-09-29T23:23:45.473438+0000","last_became_peered":"2023-09-29T23:23:45.473438+0000","last_unstale":"2023-09-29T23:23:45.479183+0000","last_undegraded":"2023-09-29T23:23:45.479183+0000","last_fullsized":"2023-09-29T23:23:45.479183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:39:59.923188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479548+0000","last_change":"2023-09-29T23:23:45.477880+0000","last_active":"2023-09-29T23:23:45.479548+0000","last_peered":"2023-09-29T23:23:45.479548+0000","last_clean":"2023-09-29T23:23:45.479548+0000","last_became_active":"2023-09-29T23:23:45.474163+0000","last_became_peered":"2023-09-29T23:23:45.474163+0000","last_unstale":"2023-09-29T23:23:45.479548+0000","last_undegraded":"2023-09-29T23:23:45.479548+0000","last_fullsized":"2023-09-29T23:23:45.479548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:40:09.175714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479092+0000","last_change":"2023-09-29T23:23:45.473292+0000","last_active":"2023-09-29T23:23:45.479092+0000","last_peered":"2023-09-29T23:23:45.479092+0000","last_clean":"2023-09-29T23:23:45.479092+0000","last_became_active":"2023-09-29T23:23:45.473063+0000","last_became_peered":"2023-09-29T23:23:45.473063+0000","last_unstale":"2023-09-29T23:23:45.479092+0000","last_undegraded":"2023-09-29T23:23:45.479092+0000","last_fullsized":"2023-09-29T23:23:45.479092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:06:47.738713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.464396+0000","last_change":"2023-09-29T23:23:45.463712+0000","last_active":"2023-09-29T23:23:45.464396+0000","last_peered":"2023-09-29T23:23:45.464396+0000","last_clean":"2023-09-29T23:23:45.464396+0000","last_became_active":"2023-09-29T23:23:45.463269+0000","last_became_peered":"2023-09-29T23:23:45.463269+0000","last_unstale":"2023-09-29T23:23:45.464396+0000","last_undegraded":"2023-09-29T23:23:45.464396+0000","last_fullsized":"2023-09-29T23:23:45.464396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:32.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5556,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852044,"statfs":{"total":107374182400,"available":107368493056,"internally_reserved":0,"allocated":176128,"data_stored":46822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.218}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20799999999999999}]}]},{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5412,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":5248,"kb_avail":104852188,"statfs":{"total":107374182400,"available":107368640512,"internally_reserved":0,"allocated":159744,"data_stored":42205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5373952},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5544,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852056,"statfs":{"total":107374182400,"available":107368505344,"internally_reserved":0,"allocated":163840,"data_stored":45250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-29T23:23:51.157 INFO:tasks.ceph.mds.a.smithi092.stderr:2023-09-29T23:23:51.157+0000 7feed13ed700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-29T23:23:53.954 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:23:54.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.075+0000 7f3903790700 1 Processor -- start 2023-09-29T23:23:54.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.075+0000 7f3903790700 1 -- start start 2023-09-29T23:23:54.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.076+0000 7f3903790700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f38fc09fd80 0x7f38fc0a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:54.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.076+0000 7f3903790700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38fc098710 con 0x7f38fc12f8b0 2023-09-29T23:23:54.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.076+0000 7f3903790700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38fc12f340 con 0x7f38fc09fd80 2023-09-29T23:23:54.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.076+0000 7f390152c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f38fc09fd80 0x7f38fc0a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:54.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.076+0000 7f3900d2b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f38fc12f8b0 0x7f38fc095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54612/0 (socket says 172.21.15.92:54612) 2023-09-29T23:23:54.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.076+0000 7f3900d2b700 1 -- 172.21.15.92:0/3577626788 learned_addr learned my addr 172.21.15.92:0/3577626788 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:54.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.076+0000 7f390152c700 1 -- 172.21.15.92:0/3577626788 >> v1:172.21.15.92:6789/0 conn(0x7f38fc12f8b0 legacy=0x7f38fc095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:54.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.076+0000 7f390152c700 1 -- 172.21.15.92:0/3577626788 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc0997e0 con 0x7f38fc09fd80 2023-09-29T23:23:54.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.076+0000 7f38fbfff700 1 -- 172.21.15.92:0/3577626788 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675144313 0 0) 0x7f38fc098710 con 0x7f38fc12f8b0 2023-09-29T23:23:54.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.076+0000 7f390152c700 1 --2- 172.21.15.92:0/3577626788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38fc09fd80 0x7f38fc0a3090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009de0 tx=0x7f38ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75daac5cf76b2b04 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:54.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.076+0000 7f38fbfff700 1 -- 172.21.15.92:0/3577626788 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38ec00e070 con 0x7f38fc09fd80 2023-09-29T23:23:54.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.076+0000 7f38fbfff700 1 -- 172.21.15.92:0/3577626788 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec00bc80 con 0x7f38fc09fd80 2023-09-29T23:23:54.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.076+0000 7f38fbfff700 1 -- 172.21.15.92:0/3577626788 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38ec012430 con 0x7f38fc09fd80 2023-09-29T23:23:54.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.077+0000 7f3903790700 1 -- 172.21.15.92:0/3577626788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38fc09fd80 msgr2=0x7f38fc0a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:54.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.077+0000 7f3903790700 1 --2- 172.21.15.92:0/3577626788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38fc09fd80 0x7f38fc0a3090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009de0 tx=0x7f38ec009780 comp rx=0 tx=0).stop 2023-09-29T23:23:54.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.077+0000 7f3903790700 1 -- 172.21.15.92:0/3577626788 shutdown_connections 2023-09-29T23:23:54.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.077+0000 7f3903790700 1 --2- 172.21.15.92:0/3577626788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38fc09fd80 0x7f38fc0a3090 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:54.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.077+0000 7f3903790700 1 -- 172.21.15.92:0/3577626788 >> 172.21.15.92:0/3577626788 conn(0x7f38fc068000 msgr2=0x7f38fc0a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:54.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.077+0000 7f3903790700 1 -- 172.21.15.92:0/3577626788 shutdown_connections 2023-09-29T23:23:54.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.077+0000 7f3903790700 1 -- 172.21.15.92:0/3577626788 wait complete. 2023-09-29T23:23:54.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.078+0000 7f3903790700 1 Processor -- start 2023-09-29T23:23:54.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.078+0000 7f3903790700 1 -- start start 2023-09-29T23:23:54.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.078+0000 7f3903790700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38fc09fd80 0x7f38fc13e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:54.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.078+0000 7f3903790700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc11e2c0 con 0x7f38fc09fd80 2023-09-29T23:23:54.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.079+0000 7f390152c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38fc09fd80 0x7f38fc13e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:54.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.079+0000 7f390152c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38fc09fd80 0x7f38fc13e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49024/0 (socket says 172.21.15.92:49024) 2023-09-29T23:23:54.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.079+0000 7f390152c700 1 -- 172.21.15.92:0/1708278698 learned_addr learned my addr 172.21.15.92:0/1708278698 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:54.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.079+0000 7f390152c700 1 -- 172.21.15.92:0/1708278698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ec009a20 con 0x7f38fc09fd80 2023-09-29T23:23:54.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.079+0000 7f390152c700 1 --2- 172.21.15.92:0/1708278698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38fc09fd80 0x7f38fc13e520 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0099f0 tx=0x7f38ec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:54.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.079+0000 7f38f97fa700 1 -- 172.21.15.92:0/1708278698 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38ec0275b0 con 0x7f38fc09fd80 2023-09-29T23:23:54.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.079+0000 7f38f97fa700 1 -- 172.21.15.92:0/1708278698 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec027710 con 0x7f38fc09fd80 2023-09-29T23:23:54.085 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.079+0000 7f3903790700 1 -- 172.21.15.92:0/1708278698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38fc11c590 con 0x7f38fc09fd80 2023-09-29T23:23:54.085 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.079+0000 7f38f97fa700 1 -- 172.21.15.92:0/1708278698 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38ec027a00 con 0x7f38fc09fd80 2023-09-29T23:23:54.085 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.079+0000 7f3903790700 1 -- 172.21.15.92:0/1708278698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38fc11d1c0 con 0x7f38fc09fd80 2023-09-29T23:23:54.085 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.080+0000 7f38f97fa700 1 -- 172.21.15.92:0/1708278698 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f38ec024070 con 0x7f38fc09fd80 2023-09-29T23:23:54.085 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.080+0000 7f3903790700 1 -- 172.21.15.92:0/1708278698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38fc11e410 con 0x7f38fc09fd80 2023-09-29T23:23:54.085 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.080+0000 7f38f97fa700 1 --2- 172.21.15.92:0/1708278698 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f38e8035640 0x7f38e8037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:54.085 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.080+0000 7f38f97fa700 1 -- 172.21.15.92:0/1708278698 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f38ec04a300 con 0x7f38fc09fd80 2023-09-29T23:23:54.086 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.080+0000 7f3900d2b700 1 --2- 172.21.15.92:0/1708278698 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f38e8035640 0x7f38e8037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:54.086 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.081+0000 7f3900d2b700 1 --2- 172.21.15.92:0/1708278698 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f38e8035640 0x7f38e8037af0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f38f00011e0 tx=0x7f38f00079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:54.086 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.085+0000 7f38f97fa700 1 -- 172.21.15.92:0/1708278698 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38ec027b60 con 0x7f38fc09fd80 2023-09-29T23:23:54.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.262+0000 7f3903790700 1 -- 172.21.15.92:0/1708278698 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38fc11e810 con 0x7f38e8035640 2023-09-29T23:23:54.269 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.268+0000 7f38f97fa700 1 -- 172.21.15.92:0/1708278698 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+262453 (secure 0 0 0) 0x7f38fc11e810 con 0x7f38e8035640 2023-09-29T23:23:54.274 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:54.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.272+0000 7f3903790700 1 -- 172.21.15.92:0/1708278698 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f38e8035640 msgr2=0x7f38e8037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:54.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.272+0000 7f3903790700 1 --2- 172.21.15.92:0/1708278698 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f38e8035640 0x7f38e8037af0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f38f00011e0 tx=0x7f38f00079d0 comp rx=0 tx=0).stop 2023-09-29T23:23:54.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.272+0000 7f3903790700 1 -- 172.21.15.92:0/1708278698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38fc09fd80 msgr2=0x7f38fc13e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:54.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.272+0000 7f3903790700 1 --2- 172.21.15.92:0/1708278698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38fc09fd80 0x7f38fc13e520 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0099f0 tx=0x7f38ec018000 comp rx=0 tx=0).stop 2023-09-29T23:23:54.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.272+0000 7f3903790700 1 -- 172.21.15.92:0/1708278698 shutdown_connections 2023-09-29T23:23:54.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.272+0000 7f3903790700 1 --2- 172.21.15.92:0/1708278698 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f38e8035640 0x7f38e8037af0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:54.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.272+0000 7f3903790700 1 --2- 172.21.15.92:0/1708278698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38fc09fd80 0x7f38fc13e520 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:54.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.272+0000 7f3903790700 1 -- 172.21.15.92:0/1708278698 >> 172.21.15.92:0/1708278698 conn(0x7f38fc068000 msgr2=0x7f38fc094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:54.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.272+0000 7f3903790700 1 -- 172.21.15.92:0/1708278698 shutdown_connections 2023-09-29T23:23:54.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.272+0000 7f3903790700 1 -- 172.21.15.92:0/1708278698 wait complete. 2023-09-29T23:23:54.279 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-09-29T23:23:54.283 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-09-29T23:23:54.036812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":208,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":16584,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":16064,"kb_avail":314556216,"statfs":{"total":322122547200,"available":322105565184,"internally_reserved":0,"allocated":507904,"data_stored":138262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16449536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":770,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001364"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473355+0000","last_change":"2023-09-29T23:23:45.465624+0000","last_active":"2023-09-29T23:23:45.473355+0000","last_peered":"2023-09-29T23:23:45.473355+0000","last_clean":"2023-09-29T23:23:45.473355+0000","last_became_active":"2023-09-29T23:23:45.464271+0000","last_became_peered":"2023-09-29T23:23:45.464271+0000","last_unstale":"2023-09-29T23:23:45.473355+0000","last_undegraded":"2023-09-29T23:23:45.473355+0000","last_fullsized":"2023-09-29T23:23:45.473355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:54:19.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.469593+0000","last_change":"2023-09-29T23:23:45.466587+0000","last_active":"2023-09-29T23:23:45.469593+0000","last_peered":"2023-09-29T23:23:45.469593+0000","last_clean":"2023-09-29T23:23:45.469593+0000","last_became_active":"2023-09-29T23:23:45.466338+0000","last_became_peered":"2023-09-29T23:23:45.466338+0000","last_unstale":"2023-09-29T23:23:45.469593+0000","last_undegraded":"2023-09-29T23:23:45.469593+0000","last_fullsized":"2023-09-29T23:23:45.469593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479450+0000","last_change":"2023-09-29T23:23:45.477248+0000","last_active":"2023-09-29T23:23:45.479450+0000","last_peered":"2023-09-29T23:23:45.479450+0000","last_clean":"2023-09-29T23:23:45.479450+0000","last_became_active":"2023-09-29T23:23:45.474129+0000","last_became_peered":"2023-09-29T23:23:45.474129+0000","last_unstale":"2023-09-29T23:23:45.479450+0000","last_undegraded":"2023-09-29T23:23:45.479450+0000","last_fullsized":"2023-09-29T23:23:45.479450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:09:27.600159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474474+0000","last_change":"2023-09-29T23:23:45.471200+0000","last_active":"2023-09-29T23:23:45.474474+0000","last_peered":"2023-09-29T23:23:45.474474+0000","last_clean":"2023-09-29T23:23:45.474474+0000","last_became_active":"2023-09-29T23:23:45.470971+0000","last_became_peered":"2023-09-29T23:23:45.470971+0000","last_unstale":"2023-09-29T23:23:45.474474+0000","last_undegraded":"2023-09-29T23:23:45.474474+0000","last_fullsized":"2023-09-29T23:23:45.474474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:29:34.531515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479230+0000","last_change":"2023-09-29T23:23:45.473831+0000","last_active":"2023-09-29T23:23:45.479230+0000","last_peered":"2023-09-29T23:23:45.479230+0000","last_clean":"2023-09-29T23:23:45.479230+0000","last_became_active":"2023-09-29T23:23:45.473570+0000","last_became_peered":"2023-09-29T23:23:45.473570+0000","last_unstale":"2023-09-29T23:23:45.479230+0000","last_undegraded":"2023-09-29T23:23:45.479230+0000","last_fullsized":"2023-09-29T23:23:45.479230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:51:36.401360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472105+0000","last_change":"2023-09-29T23:23:45.470583+0000","last_active":"2023-09-29T23:23:45.472105+0000","last_peered":"2023-09-29T23:23:45.472105+0000","last_clean":"2023-09-29T23:23:45.472105+0000","last_became_active":"2023-09-29T23:23:45.470349+0000","last_became_peered":"2023-09-29T23:23:45.470349+0000","last_unstale":"2023-09-29T23:23:45.472105+0000","last_undegraded":"2023-09-29T23:23:45.472105+0000","last_fullsized":"2023-09-29T23:23:45.472105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:50:32.868236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473871+0000","last_change":"2023-09-29T23:23:45.465376+0000","last_active":"2023-09-29T23:23:45.473871+0000","last_peered":"2023-09-29T23:23:45.473871+0000","last_clean":"2023-09-29T23:23:45.473871+0000","last_became_active":"2023-09-29T23:23:45.464893+0000","last_became_peered":"2023-09-29T23:23:45.464893+0000","last_unstale":"2023-09-29T23:23:45.473871+0000","last_undegraded":"2023-09-29T23:23:45.473871+0000","last_fullsized":"2023-09-29T23:23:45.473871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:34:22.460877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.469721+0000","last_change":"2023-09-29T23:23:45.463286+0000","last_active":"2023-09-29T23:23:45.469721+0000","last_peered":"2023-09-29T23:23:45.469721+0000","last_clean":"2023-09-29T23:23:45.469721+0000","last_became_active":"2023-09-29T23:23:45.462888+0000","last_became_peered":"2023-09-29T23:23:45.462888+0000","last_unstale":"2023-09-29T23:23:45.469721+0000","last_undegraded":"2023-09-29T23:23:45.469721+0000","last_fullsized":"2023-09-29T23:23:45.469721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470175+0000","last_change":"2023-09-29T23:23:45.468860+0000","last_active":"2023-09-29T23:23:45.470175+0000","last_peered":"2023-09-29T23:23:45.470175+0000","last_clean":"2023-09-29T23:23:45.470175+0000","last_became_active":"2023-09-29T23:23:45.468303+0000","last_became_peered":"2023-09-29T23:23:45.468303+0000","last_unstale":"2023-09-29T23:23:45.470175+0000","last_undegraded":"2023-09-29T23:23:45.470175+0000","last_fullsized":"2023-09-29T23:23:45.470175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:34:22.460877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479380+0000","last_change":"2023-09-29T23:23:45.475091+0000","last_active":"2023-09-29T23:23:45.479380+0000","last_peered":"2023-09-29T23:23:45.479380+0000","last_clean":"2023-09-29T23:23:45.479380+0000","last_became_active":"2023-09-29T23:23:45.474757+0000","last_became_peered":"2023-09-29T23:23:45.474757+0000","last_unstale":"2023-09-29T23:23:45.479380+0000","last_undegraded":"2023-09-29T23:23:45.479380+0000","last_fullsized":"2023-09-29T23:23:45.479380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:59:29.779691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473519+0000","last_change":"2023-09-29T23:23:45.467858+0000","last_active":"2023-09-29T23:23:45.473519+0000","last_peered":"2023-09-29T23:23:45.473519+0000","last_clean":"2023-09-29T23:23:45.473519+0000","last_became_active":"2023-09-29T23:23:45.464083+0000","last_became_peered":"2023-09-29T23:23:45.464083+0000","last_unstale":"2023-09-29T23:23:45.473519+0000","last_undegraded":"2023-09-29T23:23:45.473519+0000","last_fullsized":"2023-09-29T23:23:45.473519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:30:57.865969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473409+0000","last_change":"2023-09-29T23:23:45.466588+0000","last_active":"2023-09-29T23:23:45.473409+0000","last_peered":"2023-09-29T23:23:45.473409+0000","last_clean":"2023-09-29T23:23:45.473409+0000","last_became_active":"2023-09-29T23:23:45.466161+0000","last_became_peered":"2023-09-29T23:23:45.466161+0000","last_unstale":"2023-09-29T23:23:45.473409+0000","last_undegraded":"2023-09-29T23:23:45.473409+0000","last_fullsized":"2023-09-29T23:23:45.473409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:13.284557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473383+0000","last_change":"2023-09-29T23:23:45.467402+0000","last_active":"2023-09-29T23:23:45.473383+0000","last_peered":"2023-09-29T23:23:45.473383+0000","last_clean":"2023-09-29T23:23:45.473383+0000","last_became_active":"2023-09-29T23:23:45.467178+0000","last_became_peered":"2023-09-29T23:23:45.467178+0000","last_unstale":"2023-09-29T23:23:45.473383+0000","last_undegraded":"2023-09-29T23:23:45.473383+0000","last_fullsized":"2023-09-29T23:23:45.473383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472302+0000","last_change":"2023-09-29T23:23:45.465231+0000","last_active":"2023-09-29T23:23:45.472302+0000","last_peered":"2023-09-29T23:23:45.472302+0000","last_clean":"2023-09-29T23:23:45.472302+0000","last_became_active":"2023-09-29T23:23:45.464523+0000","last_became_peered":"2023-09-29T23:23:45.464523+0000","last_unstale":"2023-09-29T23:23:45.472302+0000","last_undegraded":"2023-09-29T23:23:45.472302+0000","last_fullsized":"2023-09-29T23:23:45.472302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:32.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471955+0000","last_change":"2023-09-29T23:23:45.470349+0000","last_active":"2023-09-29T23:23:45.471955+0000","last_peered":"2023-09-29T23:23:45.471955+0000","last_clean":"2023-09-29T23:23:45.471955+0000","last_became_active":"2023-09-29T23:23:45.467004+0000","last_became_peered":"2023-09-29T23:23:45.467004+0000","last_unstale":"2023-09-29T23:23:45.471955+0000","last_undegraded":"2023-09-29T23:23:45.471955+0000","last_fullsized":"2023-09-29T23:23:45.471955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474011+0000","last_change":"2023-09-29T23:23:45.471536+0000","last_active":"2023-09-29T23:23:45.474011+0000","last_peered":"2023-09-29T23:23:45.474011+0000","last_clean":"2023-09-29T23:23:45.474011+0000","last_became_active":"2023-09-29T23:23:45.471334+0000","last_became_peered":"2023-09-29T23:23:45.471334+0000","last_unstale":"2023-09-29T23:23:45.474011+0000","last_undegraded":"2023-09-29T23:23:45.474011+0000","last_fullsized":"2023-09-29T23:23:45.474011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470193+0000","last_change":"2023-09-29T23:23:45.468857+0000","last_active":"2023-09-29T23:23:45.470193+0000","last_peered":"2023-09-29T23:23:45.470193+0000","last_clean":"2023-09-29T23:23:45.470193+0000","last_became_active":"2023-09-29T23:23:45.468001+0000","last_became_peered":"2023-09-29T23:23:45.468001+0000","last_unstale":"2023-09-29T23:23:45.470193+0000","last_undegraded":"2023-09-29T23:23:45.470193+0000","last_fullsized":"2023-09-29T23:23:45.470193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:11.211646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470618+0000","last_change":"2023-09-29T23:23:45.467819+0000","last_active":"2023-09-29T23:23:45.470618+0000","last_peered":"2023-09-29T23:23:45.470618+0000","last_clean":"2023-09-29T23:23:45.470618+0000","last_became_active":"2023-09-29T23:23:45.467434+0000","last_became_peered":"2023-09-29T23:23:45.467434+0000","last_unstale":"2023-09-29T23:23:45.470618+0000","last_undegraded":"2023-09-29T23:23:45.470618+0000","last_fullsized":"2023-09-29T23:23:45.470618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479225+0000","last_change":"2023-09-29T23:23:45.473751+0000","last_active":"2023-09-29T23:23:45.479225+0000","last_peered":"2023-09-29T23:23:45.479225+0000","last_clean":"2023-09-29T23:23:45.479225+0000","last_became_active":"2023-09-29T23:23:45.473326+0000","last_became_peered":"2023-09-29T23:23:45.473326+0000","last_unstale":"2023-09-29T23:23:45.479225+0000","last_undegraded":"2023-09-29T23:23:45.479225+0000","last_fullsized":"2023-09-29T23:23:45.479225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:21:17.261104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473427+0000","last_change":"2023-09-29T23:23:45.467719+0000","last_active":"2023-09-29T23:23:45.473427+0000","last_peered":"2023-09-29T23:23:45.473427+0000","last_clean":"2023-09-29T23:23:45.473427+0000","last_became_active":"2023-09-29T23:23:45.467494+0000","last_became_peered":"2023-09-29T23:23:45.467494+0000","last_unstale":"2023-09-29T23:23:45.473427+0000","last_undegraded":"2023-09-29T23:23:45.473427+0000","last_fullsized":"2023-09-29T23:23:45.473427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479563+0000","last_change":"2023-09-29T23:23:45.478055+0000","last_active":"2023-09-29T23:23:45.479563+0000","last_peered":"2023-09-29T23:23:45.479563+0000","last_clean":"2023-09-29T23:23:45.479563+0000","last_became_active":"2023-09-29T23:23:45.477408+0000","last_became_peered":"2023-09-29T23:23:45.477408+0000","last_unstale":"2023-09-29T23:23:45.479563+0000","last_undegraded":"2023-09-29T23:23:45.479563+0000","last_fullsized":"2023-09-29T23:23:45.479563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:14:56.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474548+0000","last_change":"2023-09-29T23:23:45.471232+0000","last_active":"2023-09-29T23:23:45.474548+0000","last_peered":"2023-09-29T23:23:45.474548+0000","last_clean":"2023-09-29T23:23:45.474548+0000","last_became_active":"2023-09-29T23:23:45.470574+0000","last_became_peered":"2023-09-29T23:23:45.470574+0000","last_unstale":"2023-09-29T23:23:45.474548+0000","last_undegraded":"2023-09-29T23:23:45.474548+0000","last_fullsized":"2023-09-29T23:23:45.474548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:25:25.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479248+0000","last_change":"2023-09-29T23:23:45.474093+0000","last_active":"2023-09-29T23:23:45.479248+0000","last_peered":"2023-09-29T23:23:45.479248+0000","last_clean":"2023-09-29T23:23:45.479248+0000","last_became_active":"2023-09-29T23:23:45.473789+0000","last_became_peered":"2023-09-29T23:23:45.473789+0000","last_unstale":"2023-09-29T23:23:45.479248+0000","last_undegraded":"2023-09-29T23:23:45.479248+0000","last_fullsized":"2023-09-29T23:23:45.479248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:46.564456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472272+0000","last_change":"2023-09-29T23:23:45.465993+0000","last_active":"2023-09-29T23:23:45.472272+0000","last_peered":"2023-09-29T23:23:45.472272+0000","last_clean":"2023-09-29T23:23:45.472272+0000","last_became_active":"2023-09-29T23:23:45.465443+0000","last_became_peered":"2023-09-29T23:23:45.465443+0000","last_unstale":"2023-09-29T23:23:45.472272+0000","last_undegraded":"2023-09-29T23:23:45.472272+0000","last_fullsized":"2023-09-29T23:23:45.472272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:12:18.769461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.460342+0000","last_change":"2023-09-29T23:23:45.458032+0000","last_active":"2023-09-29T23:23:45.460342+0000","last_peered":"2023-09-29T23:23:45.460342+0000","last_clean":"2023-09-29T23:23:45.460342+0000","last_became_active":"2023-09-29T23:23:45.457799+0000","last_became_peered":"2023-09-29T23:23:45.457799+0000","last_unstale":"2023-09-29T23:23:45.460342+0000","last_undegraded":"2023-09-29T23:23:45.460342+0000","last_fullsized":"2023-09-29T23:23:45.460342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:21:07.207937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470656+0000","last_change":"2023-09-29T23:23:45.467967+0000","last_active":"2023-09-29T23:23:45.470656+0000","last_peered":"2023-09-29T23:23:45.470656+0000","last_clean":"2023-09-29T23:23:45.470656+0000","last_became_active":"2023-09-29T23:23:45.467730+0000","last_became_peered":"2023-09-29T23:23:45.467730+0000","last_unstale":"2023-09-29T23:23:45.470656+0000","last_undegraded":"2023-09-29T23:23:45.470656+0000","last_fullsized":"2023-09-29T23:23:45.470656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:23:19.840400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475084+0000","last_change":"2023-09-29T23:23:45.076072+0000","last_active":"2023-09-29T23:23:45.475084+0000","last_peered":"2023-09-29T23:23:45.475084+0000","last_clean":"2023-09-29T23:23:45.475084+0000","last_became_active":"2023-09-29T23:23:45.075848+0000","last_became_peered":"2023-09-29T23:23:45.075848+0000","last_unstale":"2023-09-29T23:23:45.475084+0000","last_undegraded":"2023-09-29T23:23:45.475084+0000","last_fullsized":"2023-09-29T23:23:45.475084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:29:13.914085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.464208+0000","last_change":"2023-09-29T23:23:45.462781+0000","last_active":"2023-09-29T23:23:45.464208+0000","last_peered":"2023-09-29T23:23:45.464208+0000","last_clean":"2023-09-29T23:23:45.464208+0000","last_became_active":"2023-09-29T23:23:45.462155+0000","last_became_peered":"2023-09-29T23:23:45.462155+0000","last_unstale":"2023-09-29T23:23:45.464208+0000","last_undegraded":"2023-09-29T23:23:45.464208+0000","last_fullsized":"2023-09-29T23:23:45.464208+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:13.284557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467209+0000","last_change":"2023-09-29T23:23:45.092553+0000","last_active":"2023-09-29T23:23:45.467209+0000","last_peered":"2023-09-29T23:23:45.467209+0000","last_clean":"2023-09-29T23:23:45.467209+0000","last_became_active":"2023-09-29T23:23:45.092273+0000","last_became_peered":"2023-09-29T23:23:45.092273+0000","last_unstale":"2023-09-29T23:23:45.467209+0000","last_undegraded":"2023-09-29T23:23:45.467209+0000","last_fullsized":"2023-09-29T23:23:45.467209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472939+0000","last_change":"2023-09-29T23:23:45.464637+0000","last_active":"2023-09-29T23:23:45.472939+0000","last_peered":"2023-09-29T23:23:45.472939+0000","last_clean":"2023-09-29T23:23:45.472939+0000","last_became_active":"2023-09-29T23:23:45.464027+0000","last_became_peered":"2023-09-29T23:23:45.464027+0000","last_unstale":"2023-09-29T23:23:45.472939+0000","last_undegraded":"2023-09-29T23:23:45.472939+0000","last_fullsized":"2023-09-29T23:23:45.472939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.449247+0000","last_change":"2023-09-29T23:23:45.088658+0000","last_active":"2023-09-29T23:23:45.449247+0000","last_peered":"2023-09-29T23:23:45.449247+0000","last_clean":"2023-09-29T23:23:45.449247+0000","last_became_active":"2023-09-29T23:23:45.088405+0000","last_became_peered":"2023-09-29T23:23:45.088405+0000","last_unstale":"2023-09-29T23:23:45.449247+0000","last_undegraded":"2023-09-29T23:23:45.449247+0000","last_fullsized":"2023-09-29T23:23:45.449247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473976+0000","last_change":"2023-09-29T23:23:45.471459+0000","last_active":"2023-09-29T23:23:45.473976+0000","last_peered":"2023-09-29T23:23:45.473976+0000","last_clean":"2023-09-29T23:23:45.473976+0000","last_became_active":"2023-09-29T23:23:45.470917+0000","last_became_peered":"2023-09-29T23:23:45.470917+0000","last_unstale":"2023-09-29T23:23:45.473976+0000","last_undegraded":"2023-09-29T23:23:45.473976+0000","last_fullsized":"2023-09-29T23:23:45.473976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:29:34.889615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.444294+0000","last_change":"2023-09-29T23:23:45.070764+0000","last_active":"2023-09-29T23:23:45.444294+0000","last_peered":"2023-09-29T23:23:45.444294+0000","last_clean":"2023-09-29T23:23:45.444294+0000","last_became_active":"2023-09-29T23:23:45.070610+0000","last_became_peered":"2023-09-29T23:23:45.070610+0000","last_unstale":"2023-09-29T23:23:45.444294+0000","last_undegraded":"2023-09-29T23:23:45.444294+0000","last_fullsized":"2023-09-29T23:23:45.444294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:26:19.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.477784+0000","last_change":"2023-09-29T23:23:45.475877+0000","last_active":"2023-09-29T23:23:45.477784+0000","last_peered":"2023-09-29T23:23:45.477784+0000","last_clean":"2023-09-29T23:23:45.477784+0000","last_became_active":"2023-09-29T23:23:45.475634+0000","last_became_peered":"2023-09-29T23:23:45.475634+0000","last_unstale":"2023-09-29T23:23:45.477784+0000","last_undegraded":"2023-09-29T23:23:45.477784+0000","last_fullsized":"2023-09-29T23:23:45.477784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:59:25.888959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.458483+0000","last_change":"2023-09-29T23:23:45.091556+0000","last_active":"2023-09-29T23:23:45.458483+0000","last_peered":"2023-09-29T23:23:45.458483+0000","last_clean":"2023-09-29T23:23:45.458483+0000","last_became_active":"2023-09-29T23:23:45.091317+0000","last_became_peered":"2023-09-29T23:23:45.091317+0000","last_unstale":"2023-09-29T23:23:45.458483+0000","last_undegraded":"2023-09-29T23:23:45.458483+0000","last_fullsized":"2023-09-29T23:23:45.458483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:53.097532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467362+0000","last_change":"2023-09-29T23:23:45.458805+0000","last_active":"2023-09-29T23:23:45.467362+0000","last_peered":"2023-09-29T23:23:45.467362+0000","last_clean":"2023-09-29T23:23:45.467362+0000","last_became_active":"2023-09-29T23:23:45.458585+0000","last_became_peered":"2023-09-29T23:23:45.458585+0000","last_unstale":"2023-09-29T23:23:45.467362+0000","last_undegraded":"2023-09-29T23:23:45.467362+0000","last_fullsized":"2023-09-29T23:23:45.467362+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:05:18.350431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.446151+0000","last_change":"2023-09-29T23:23:45.071269+0000","last_active":"2023-09-29T23:23:45.446151+0000","last_peered":"2023-09-29T23:23:45.446151+0000","last_clean":"2023-09-29T23:23:45.446151+0000","last_became_active":"2023-09-29T23:23:45.070986+0000","last_became_peered":"2023-09-29T23:23:45.070986+0000","last_unstale":"2023-09-29T23:23:45.446151+0000","last_undegraded":"2023-09-29T23:23:45.446151+0000","last_fullsized":"2023-09-29T23:23:45.446151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:29.355473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472807+0000","last_change":"2023-09-29T23:23:45.464917+0000","last_active":"2023-09-29T23:23:45.472807+0000","last_peered":"2023-09-29T23:23:45.472807+0000","last_clean":"2023-09-29T23:23:45.472807+0000","last_became_active":"2023-09-29T23:23:45.464510+0000","last_became_peered":"2023-09-29T23:23:45.464510+0000","last_unstale":"2023-09-29T23:23:45.472807+0000","last_undegraded":"2023-09-29T23:23:45.472807+0000","last_fullsized":"2023-09-29T23:23:45.472807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:58:16.565151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475769+0000","last_change":"2023-09-29T23:23:45.077097+0000","last_active":"2023-09-29T23:23:45.475769+0000","last_peered":"2023-09-29T23:23:45.475769+0000","last_clean":"2023-09-29T23:23:45.475769+0000","last_became_active":"2023-09-29T23:23:45.076856+0000","last_became_peered":"2023-09-29T23:23:45.076856+0000","last_unstale":"2023-09-29T23:23:45.475769+0000","last_undegraded":"2023-09-29T23:23:45.475769+0000","last_fullsized":"2023-09-29T23:23:45.475769+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:00:28.816753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.464231+0000","last_change":"2023-09-29T23:23:45.462198+0000","last_active":"2023-09-29T23:23:45.464231+0000","last_peered":"2023-09-29T23:23:45.464231+0000","last_clean":"2023-09-29T23:23:45.464231+0000","last_became_active":"2023-09-29T23:23:45.461199+0000","last_became_peered":"2023-09-29T23:23:45.461199+0000","last_unstale":"2023-09-29T23:23:45.464231+0000","last_undegraded":"2023-09-29T23:23:45.464231+0000","last_fullsized":"2023-09-29T23:23:45.464231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:33.901646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.484403+0000","last_change":"2023-09-29T23:23:45.093720+0000","last_active":"2023-09-29T23:23:45.484403+0000","last_peered":"2023-09-29T23:23:45.484403+0000","last_clean":"2023-09-29T23:23:45.484403+0000","last_became_active":"2023-09-29T23:23:45.093487+0000","last_became_peered":"2023-09-29T23:23:45.093487+0000","last_unstale":"2023-09-29T23:23:45.484403+0000","last_undegraded":"2023-09-29T23:23:45.484403+0000","last_fullsized":"2023-09-29T23:23:45.484403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473468+0000","last_change":"2023-09-29T23:23:45.466875+0000","last_active":"2023-09-29T23:23:45.473468+0000","last_peered":"2023-09-29T23:23:45.473468+0000","last_clean":"2023-09-29T23:23:45.473468+0000","last_became_active":"2023-09-29T23:23:45.466667+0000","last_became_peered":"2023-09-29T23:23:45.466667+0000","last_unstale":"2023-09-29T23:23:45.473468+0000","last_undegraded":"2023-09-29T23:23:45.473468+0000","last_fullsized":"2023-09-29T23:23:45.473468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:19.696930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.480207+0000","last_change":"2023-09-29T23:23:45.089727+0000","last_active":"2023-09-29T23:23:45.480207+0000","last_peered":"2023-09-29T23:23:45.480207+0000","last_clean":"2023-09-29T23:23:45.480207+0000","last_became_active":"2023-09-29T23:23:45.089450+0000","last_became_peered":"2023-09-29T23:23:45.089450+0000","last_unstale":"2023-09-29T23:23:45.480207+0000","last_undegraded":"2023-09-29T23:23:45.480207+0000","last_fullsized":"2023-09-29T23:23:45.480207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473639+0000","last_change":"2023-09-29T23:23:45.468316+0000","last_active":"2023-09-29T23:23:45.473639+0000","last_peered":"2023-09-29T23:23:45.473639+0000","last_clean":"2023-09-29T23:23:45.473639+0000","last_became_active":"2023-09-29T23:23:45.464801+0000","last_became_peered":"2023-09-29T23:23:45.464801+0000","last_unstale":"2023-09-29T23:23:45.473639+0000","last_undegraded":"2023-09-29T23:23:45.473639+0000","last_fullsized":"2023-09-29T23:23:45.473639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.451089+0000","last_change":"2023-09-29T23:23:45.093148+0000","last_active":"2023-09-29T23:23:45.451089+0000","last_peered":"2023-09-29T23:23:45.451089+0000","last_clean":"2023-09-29T23:23:45.451089+0000","last_became_active":"2023-09-29T23:23:45.092902+0000","last_became_peered":"2023-09-29T23:23:45.092902+0000","last_unstale":"2023-09-29T23:23:45.451089+0000","last_undegraded":"2023-09-29T23:23:45.451089+0000","last_fullsized":"2023-09-29T23:23:45.451089+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470060+0000","last_change":"2023-09-29T23:23:45.466007+0000","last_active":"2023-09-29T23:23:45.470060+0000","last_peered":"2023-09-29T23:23:45.470060+0000","last_clean":"2023-09-29T23:23:45.470060+0000","last_became_active":"2023-09-29T23:23:45.465743+0000","last_became_peered":"2023-09-29T23:23:45.465743+0000","last_unstale":"2023-09-29T23:23:45.470060+0000","last_undegraded":"2023-09-29T23:23:45.470060+0000","last_fullsized":"2023-09-29T23:23:45.470060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.448899+0000","last_change":"2023-09-29T23:23:45.072234+0000","last_active":"2023-09-29T23:23:45.448899+0000","last_peered":"2023-09-29T23:23:45.448899+0000","last_clean":"2023-09-29T23:23:45.448899+0000","last_became_active":"2023-09-29T23:23:45.072009+0000","last_became_peered":"2023-09-29T23:23:45.072009+0000","last_unstale":"2023-09-29T23:23:45.448899+0000","last_undegraded":"2023-09-29T23:23:45.448899+0000","last_fullsized":"2023-09-29T23:23:45.448899+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471991+0000","last_change":"2023-09-29T23:23:45.466374+0000","last_active":"2023-09-29T23:23:45.471991+0000","last_peered":"2023-09-29T23:23:45.471991+0000","last_clean":"2023-09-29T23:23:45.471991+0000","last_became_active":"2023-09-29T23:23:45.466169+0000","last_became_peered":"2023-09-29T23:23:45.466169+0000","last_unstale":"2023-09-29T23:23:45.471991+0000","last_undegraded":"2023-09-29T23:23:45.471991+0000","last_fullsized":"2023-09-29T23:23:45.471991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475698+0000","last_change":"2023-09-29T23:23:45.091762+0000","last_active":"2023-09-29T23:23:45.475698+0000","last_peered":"2023-09-29T23:23:45.475698+0000","last_clean":"2023-09-29T23:23:45.475698+0000","last_became_active":"2023-09-29T23:23:45.091386+0000","last_became_peered":"2023-09-29T23:23:45.091386+0000","last_unstale":"2023-09-29T23:23:45.475698+0000","last_undegraded":"2023-09-29T23:23:45.475698+0000","last_fullsized":"2023-09-29T23:23:45.475698+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467101+0000","last_change":"2023-09-29T23:23:45.461421+0000","last_active":"2023-09-29T23:23:45.467101+0000","last_peered":"2023-09-29T23:23:45.467101+0000","last_clean":"2023-09-29T23:23:45.467101+0000","last_became_active":"2023-09-29T23:23:45.460643+0000","last_became_peered":"2023-09-29T23:23:45.460643+0000","last_unstale":"2023-09-29T23:23:45.467101+0000","last_undegraded":"2023-09-29T23:23:45.467101+0000","last_fullsized":"2023-09-29T23:23:45.467101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:12:32.105911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.480077+0000","last_change":"2023-09-29T23:23:45.078091+0000","last_active":"2023-09-29T23:23:45.480077+0000","last_peered":"2023-09-29T23:23:45.480077+0000","last_clean":"2023-09-29T23:23:45.480077+0000","last_became_active":"2023-09-29T23:23:45.077734+0000","last_became_peered":"2023-09-29T23:23:45.077734+0000","last_unstale":"2023-09-29T23:23:45.480077+0000","last_undegraded":"2023-09-29T23:23:45.480077+0000","last_fullsized":"2023-09-29T23:23:45.480077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:53.097532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470638+0000","last_change":"2023-09-29T23:23:45.467950+0000","last_active":"2023-09-29T23:23:45.470638+0000","last_peered":"2023-09-29T23:23:45.470638+0000","last_clean":"2023-09-29T23:23:45.470638+0000","last_became_active":"2023-09-29T23:23:45.467555+0000","last_became_peered":"2023-09-29T23:23:45.467555+0000","last_unstale":"2023-09-29T23:23:45.470638+0000","last_undegraded":"2023-09-29T23:23:45.470638+0000","last_fullsized":"2023-09-29T23:23:45.470638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474184+0000","last_change":"2023-09-29T23:23:45.092471+0000","last_active":"2023-09-29T23:23:45.474184+0000","last_peered":"2023-09-29T23:23:45.474184+0000","last_clean":"2023-09-29T23:23:45.474184+0000","last_became_active":"2023-09-29T23:23:45.092185+0000","last_became_peered":"2023-09-29T23:23:45.092185+0000","last_unstale":"2023-09-29T23:23:45.474184+0000","last_undegraded":"2023-09-29T23:23:45.474184+0000","last_fullsized":"2023-09-29T23:23:45.474184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472722+0000","last_change":"2023-09-29T23:23:45.464504+0000","last_active":"2023-09-29T23:23:45.472722+0000","last_peered":"2023-09-29T23:23:45.472722+0000","last_clean":"2023-09-29T23:23:45.472722+0000","last_became_active":"2023-09-29T23:23:45.463806+0000","last_became_peered":"2023-09-29T23:23:45.463806+0000","last_unstale":"2023-09-29T23:23:45.472722+0000","last_undegraded":"2023-09-29T23:23:45.472722+0000","last_fullsized":"2023-09-29T23:23:45.472722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:25:25.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475877+0000","last_change":"2023-09-29T23:23:45.088776+0000","last_active":"2023-09-29T23:23:45.475877+0000","last_peered":"2023-09-29T23:23:45.475877+0000","last_clean":"2023-09-29T23:23:45.475877+0000","last_became_active":"2023-09-29T23:23:45.088535+0000","last_became_peered":"2023-09-29T23:23:45.088535+0000","last_unstale":"2023-09-29T23:23:45.475877+0000","last_undegraded":"2023-09-29T23:23:45.475877+0000","last_fullsized":"2023-09-29T23:23:45.475877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:35:07.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473390+0000","last_change":"2023-09-29T23:23:45.466379+0000","last_active":"2023-09-29T23:23:45.473390+0000","last_peered":"2023-09-29T23:23:45.473390+0000","last_clean":"2023-09-29T23:23:45.473390+0000","last_became_active":"2023-09-29T23:23:45.465855+0000","last_became_peered":"2023-09-29T23:23:45.465855+0000","last_unstale":"2023-09-29T23:23:45.473390+0000","last_undegraded":"2023-09-29T23:23:45.473390+0000","last_fullsized":"2023-09-29T23:23:45.473390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:06.275738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.447311+0000","last_change":"2023-09-29T23:23:45.092714+0000","last_active":"2023-09-29T23:23:45.447311+0000","last_peered":"2023-09-29T23:23:45.447311+0000","last_clean":"2023-09-29T23:23:45.447311+0000","last_became_active":"2023-09-29T23:23:45.092476+0000","last_became_peered":"2023-09-29T23:23:45.092476+0000","last_unstale":"2023-09-29T23:23:45.447311+0000","last_undegraded":"2023-09-29T23:23:45.447311+0000","last_fullsized":"2023-09-29T23:23:45.447311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:20:23.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.469720+0000","last_change":"2023-09-29T23:23:45.467010+0000","last_active":"2023-09-29T23:23:45.469720+0000","last_peered":"2023-09-29T23:23:45.469720+0000","last_clean":"2023-09-29T23:23:45.469720+0000","last_became_active":"2023-09-29T23:23:45.466694+0000","last_became_peered":"2023-09-29T23:23:45.466694+0000","last_unstale":"2023-09-29T23:23:45.469720+0000","last_undegraded":"2023-09-29T23:23:45.469720+0000","last_fullsized":"2023-09-29T23:23:45.469720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.484451+0000","last_change":"2023-09-29T23:23:45.089622+0000","last_active":"2023-09-29T23:23:45.484451+0000","last_peered":"2023-09-29T23:23:45.484451+0000","last_clean":"2023-09-29T23:23:45.484451+0000","last_became_active":"2023-09-29T23:23:45.089176+0000","last_became_peered":"2023-09-29T23:23:45.089176+0000","last_unstale":"2023-09-29T23:23:45.484451+0000","last_undegraded":"2023-09-29T23:23:45.484451+0000","last_fullsized":"2023-09-29T23:23:45.484451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472323+0000","last_change":"2023-09-29T23:23:45.465798+0000","last_active":"2023-09-29T23:23:45.472323+0000","last_peered":"2023-09-29T23:23:45.472323+0000","last_clean":"2023-09-29T23:23:45.472323+0000","last_became_active":"2023-09-29T23:23:45.465127+0000","last_became_peered":"2023-09-29T23:23:45.465127+0000","last_unstale":"2023-09-29T23:23:45.472323+0000","last_undegraded":"2023-09-29T23:23:45.472323+0000","last_fullsized":"2023-09-29T23:23:45.472323+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:33.901646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450509+0000","last_change":"2023-09-29T23:23:45.075630+0000","last_active":"2023-09-29T23:23:45.450509+0000","last_peered":"2023-09-29T23:23:45.450509+0000","last_clean":"2023-09-29T23:23:45.450509+0000","last_became_active":"2023-09-29T23:23:45.075313+0000","last_became_peered":"2023-09-29T23:23:45.075313+0000","last_unstale":"2023-09-29T23:23:45.450509+0000","last_undegraded":"2023-09-29T23:23:45.450509+0000","last_fullsized":"2023-09-29T23:23:45.450509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:59:03.439349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470041+0000","last_change":"2023-09-29T23:23:45.465956+0000","last_active":"2023-09-29T23:23:45.470041+0000","last_peered":"2023-09-29T23:23:45.470041+0000","last_clean":"2023-09-29T23:23:45.470041+0000","last_became_active":"2023-09-29T23:23:45.465599+0000","last_became_peered":"2023-09-29T23:23:45.465599+0000","last_unstale":"2023-09-29T23:23:45.470041+0000","last_undegraded":"2023-09-29T23:23:45.470041+0000","last_fullsized":"2023-09-29T23:23:45.470041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:29:34.889615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450944+0000","last_change":"2023-09-29T23:23:45.075998+0000","last_active":"2023-09-29T23:23:45.450944+0000","last_peered":"2023-09-29T23:23:45.450944+0000","last_clean":"2023-09-29T23:23:45.450944+0000","last_became_active":"2023-09-29T23:23:45.075772+0000","last_became_peered":"2023-09-29T23:23:45.075772+0000","last_unstale":"2023-09-29T23:23:45.450944+0000","last_undegraded":"2023-09-29T23:23:45.450944+0000","last_fullsized":"2023-09-29T23:23:45.450944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:12:24.809572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.468582+0000","last_change":"2023-09-29T23:23:45.463124+0000","last_active":"2023-09-29T23:23:45.468582+0000","last_peered":"2023-09-29T23:23:45.468582+0000","last_clean":"2023-09-29T23:23:45.468582+0000","last_became_active":"2023-09-29T23:23:45.462583+0000","last_became_peered":"2023-09-29T23:23:45.462583+0000","last_unstale":"2023-09-29T23:23:45.468582+0000","last_undegraded":"2023-09-29T23:23:45.468582+0000","last_fullsized":"2023-09-29T23:23:45.468582+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:01:57.571277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.444191+0000","last_change":"2023-09-29T23:23:45.088750+0000","last_active":"2023-09-29T23:23:45.444191+0000","last_peered":"2023-09-29T23:23:45.444191+0000","last_clean":"2023-09-29T23:23:45.444191+0000","last_became_active":"2023-09-29T23:23:45.088506+0000","last_became_peered":"2023-09-29T23:23:45.088506+0000","last_unstale":"2023-09-29T23:23:45.444191+0000","last_undegraded":"2023-09-29T23:23:45.444191+0000","last_fullsized":"2023-09-29T23:23:45.444191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479465+0000","last_change":"2023-09-29T23:23:45.477617+0000","last_active":"2023-09-29T23:23:45.479465+0000","last_peered":"2023-09-29T23:23:45.479465+0000","last_clean":"2023-09-29T23:23:45.479465+0000","last_became_active":"2023-09-29T23:23:45.477335+0000","last_became_peered":"2023-09-29T23:23:45.477335+0000","last_unstale":"2023-09-29T23:23:45.479465+0000","last_undegraded":"2023-09-29T23:23:45.479465+0000","last_fullsized":"2023-09-29T23:23:45.479465+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:44:09.599636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.447044+0000","last_change":"2023-09-29T23:23:41.047954+0000","last_active":"2023-09-29T23:23:45.447044+0000","last_peered":"2023-09-29T23:23:45.447044+0000","last_clean":"2023-09-29T23:23:45.447044+0000","last_became_active":"2023-09-29T23:23:41.047701+0000","last_became_peered":"2023-09-29T23:23:41.047701+0000","last_unstale":"2023-09-29T23:23:45.447044+0000","last_undegraded":"2023-09-29T23:23:45.447044+0000","last_fullsized":"2023-09-29T23:23:45.447044+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:08:35.252580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:23:46.447573+0000","last_change":"2023-09-29T23:23:45.075607+0000","last_active":"2023-09-29T23:23:46.447573+0000","last_peered":"2023-09-29T23:23:46.447573+0000","last_clean":"2023-09-29T23:23:46.447573+0000","last_became_active":"2023-09-29T23:23:45.075249+0000","last_became_peered":"2023-09-29T23:23:45.075249+0000","last_unstale":"2023-09-29T23:23:46.447573+0000","last_undegraded":"2023-09-29T23:23:46.447573+0000","last_fullsized":"2023-09-29T23:23:46.447573+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:55:12.692421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.465404+0000","last_change":"2023-09-29T23:23:45.460164+0000","last_active":"2023-09-29T23:23:45.465404+0000","last_peered":"2023-09-29T23:23:45.465404+0000","last_clean":"2023-09-29T23:23:45.465404+0000","last_became_active":"2023-09-29T23:23:45.459933+0000","last_became_peered":"2023-09-29T23:23:45.459933+0000","last_unstale":"2023-09-29T23:23:45.465404+0000","last_undegraded":"2023-09-29T23:23:45.465404+0000","last_fullsized":"2023-09-29T23:23:45.465404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:25:22.017530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.453586+0000","last_change":"2023-09-29T23:23:41.051640+0000","last_active":"2023-09-29T23:23:45.453586+0000","last_peered":"2023-09-29T23:23:45.453586+0000","last_clean":"2023-09-29T23:23:45.453586+0000","last_became_active":"2023-09-29T23:23:41.051398+0000","last_became_peered":"2023-09-29T23:23:41.051398+0000","last_unstale":"2023-09-29T23:23:45.453586+0000","last_undegraded":"2023-09-29T23:23:45.453586+0000","last_fullsized":"2023-09-29T23:23:45.453586+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:49:47.548120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.476402+0000","last_change":"2023-09-29T23:23:45.076540+0000","last_active":"2023-09-29T23:23:45.476402+0000","last_peered":"2023-09-29T23:23:45.476402+0000","last_clean":"2023-09-29T23:23:45.476402+0000","last_became_active":"2023-09-29T23:23:45.076293+0000","last_became_peered":"2023-09-29T23:23:45.076293+0000","last_unstale":"2023-09-29T23:23:45.476402+0000","last_undegraded":"2023-09-29T23:23:45.476402+0000","last_fullsized":"2023-09-29T23:23:45.476402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:09.131795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474065+0000","last_change":"2023-09-29T23:23:45.466336+0000","last_active":"2023-09-29T23:23:45.474065+0000","last_peered":"2023-09-29T23:23:45.474065+0000","last_clean":"2023-09-29T23:23:45.474065+0000","last_became_active":"2023-09-29T23:23:45.466115+0000","last_became_peered":"2023-09-29T23:23:45.466115+0000","last_unstale":"2023-09-29T23:23:45.474065+0000","last_undegraded":"2023-09-29T23:23:45.474065+0000","last_fullsized":"2023-09-29T23:23:45.474065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:11.211646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450776+0000","last_change":"2023-09-29T23:23:41.050066+0000","last_active":"2023-09-29T23:23:45.450776+0000","last_peered":"2023-09-29T23:23:45.450776+0000","last_clean":"2023-09-29T23:23:45.450776+0000","last_became_active":"2023-09-29T23:23:41.049786+0000","last_became_peered":"2023-09-29T23:23:41.049786+0000","last_unstale":"2023-09-29T23:23:45.450776+0000","last_undegraded":"2023-09-29T23:23:45.450776+0000","last_fullsized":"2023-09-29T23:23:45.450776+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:22:54.699446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450066+0000","last_change":"2023-09-29T23:23:45.091590+0000","last_active":"2023-09-29T23:23:45.450066+0000","last_peered":"2023-09-29T23:23:45.450066+0000","last_clean":"2023-09-29T23:23:45.450066+0000","last_became_active":"2023-09-29T23:23:45.091162+0000","last_became_peered":"2023-09-29T23:23:45.091162+0000","last_unstale":"2023-09-29T23:23:45.450066+0000","last_undegraded":"2023-09-29T23:23:45.450066+0000","last_fullsized":"2023-09-29T23:23:45.450066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:29:38.240697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479301+0000","last_change":"2023-09-29T23:23:45.474238+0000","last_active":"2023-09-29T23:23:45.479301+0000","last_peered":"2023-09-29T23:23:45.479301+0000","last_clean":"2023-09-29T23:23:45.479301+0000","last_became_active":"2023-09-29T23:23:45.473861+0000","last_became_peered":"2023-09-29T23:23:45.473861+0000","last_unstale":"2023-09-29T23:23:45.479301+0000","last_undegraded":"2023-09-29T23:23:45.479301+0000","last_fullsized":"2023-09-29T23:23:45.479301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:39:43.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.451691+0000","last_change":"2023-09-29T23:23:41.049685+0000","last_active":"2023-09-29T23:23:45.451691+0000","last_peered":"2023-09-29T23:23:45.451691+0000","last_clean":"2023-09-29T23:23:45.451691+0000","last_became_active":"2023-09-29T23:23:41.049442+0000","last_became_peered":"2023-09-29T23:23:41.049442+0000","last_unstale":"2023-09-29T23:23:45.451691+0000","last_undegraded":"2023-09-29T23:23:45.451691+0000","last_fullsized":"2023-09-29T23:23:45.451691+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:52:33.065724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.446401+0000","last_change":"2023-09-29T23:23:45.092293+0000","last_active":"2023-09-29T23:23:45.446401+0000","last_peered":"2023-09-29T23:23:45.446401+0000","last_clean":"2023-09-29T23:23:45.446401+0000","last_became_active":"2023-09-29T23:23:45.092042+0000","last_became_peered":"2023-09-29T23:23:45.092042+0000","last_unstale":"2023-09-29T23:23:45.446401+0000","last_undegraded":"2023-09-29T23:23:45.446401+0000","last_fullsized":"2023-09-29T23:23:45.446401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:07:16.838088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.466547+0000","last_change":"2023-09-29T23:23:45.461917+0000","last_active":"2023-09-29T23:23:45.466547+0000","last_peered":"2023-09-29T23:23:45.466547+0000","last_clean":"2023-09-29T23:23:45.466547+0000","last_became_active":"2023-09-29T23:23:45.461228+0000","last_became_peered":"2023-09-29T23:23:45.461228+0000","last_unstale":"2023-09-29T23:23:45.466547+0000","last_undegraded":"2023-09-29T23:23:45.466547+0000","last_fullsized":"2023-09-29T23:23:45.466547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:54:19.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450606+0000","last_change":"2023-09-29T23:23:41.051041+0000","last_active":"2023-09-29T23:23:45.450606+0000","last_peered":"2023-09-29T23:23:45.450606+0000","last_clean":"2023-09-29T23:23:45.450606+0000","last_became_active":"2023-09-29T23:23:41.050731+0000","last_became_peered":"2023-09-29T23:23:41.050731+0000","last_unstale":"2023-09-29T23:23:45.450606+0000","last_undegraded":"2023-09-29T23:23:45.450606+0000","last_fullsized":"2023-09-29T23:23:45.450606+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:20.303147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450701+0000","last_change":"2023-09-29T23:23:45.088759+0000","last_active":"2023-09-29T23:23:45.450701+0000","last_peered":"2023-09-29T23:23:45.450701+0000","last_clean":"2023-09-29T23:23:45.450701+0000","last_became_active":"2023-09-29T23:23:45.088510+0000","last_became_peered":"2023-09-29T23:23:45.088510+0000","last_unstale":"2023-09-29T23:23:45.450701+0000","last_undegraded":"2023-09-29T23:23:45.450701+0000","last_fullsized":"2023-09-29T23:23:45.450701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:27:56.918672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.477404+0000","last_change":"2023-09-29T23:23:45.472092+0000","last_active":"2023-09-29T23:23:45.477404+0000","last_peered":"2023-09-29T23:23:45.477404+0000","last_clean":"2023-09-29T23:23:45.477404+0000","last_became_active":"2023-09-29T23:23:45.461672+0000","last_became_peered":"2023-09-29T23:23:45.461672+0000","last_unstale":"2023-09-29T23:23:45.477404+0000","last_undegraded":"2023-09-29T23:23:45.477404+0000","last_fullsized":"2023-09-29T23:23:45.477404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:58:16.565151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.446553+0000","last_change":"2023-09-29T23:23:41.047062+0000","last_active":"2023-09-29T23:23:45.446553+0000","last_peered":"2023-09-29T23:23:45.446553+0000","last_clean":"2023-09-29T23:23:45.446553+0000","last_became_active":"2023-09-29T23:23:41.046803+0000","last_became_peered":"2023-09-29T23:23:41.046803+0000","last_unstale":"2023-09-29T23:23:45.446553+0000","last_undegraded":"2023-09-29T23:23:45.446553+0000","last_fullsized":"2023-09-29T23:23:45.446553+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:22:14.657466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.451787+0000","last_change":"2023-09-29T23:23:45.073226+0000","last_active":"2023-09-29T23:23:45.451787+0000","last_peered":"2023-09-29T23:23:45.451787+0000","last_clean":"2023-09-29T23:23:45.451787+0000","last_became_active":"2023-09-29T23:23:45.072973+0000","last_became_peered":"2023-09-29T23:23:45.072973+0000","last_unstale":"2023-09-29T23:23:45.451787+0000","last_undegraded":"2023-09-29T23:23:45.451787+0000","last_fullsized":"2023-09-29T23:23:45.451787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:27:56.918672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479531+0000","last_change":"2023-09-29T23:23:45.477628+0000","last_active":"2023-09-29T23:23:45.479531+0000","last_peered":"2023-09-29T23:23:45.479531+0000","last_clean":"2023-09-29T23:23:45.479531+0000","last_became_active":"2023-09-29T23:23:45.474318+0000","last_became_peered":"2023-09-29T23:23:45.474318+0000","last_unstale":"2023-09-29T23:23:45.479531+0000","last_undegraded":"2023-09-29T23:23:45.479531+0000","last_fullsized":"2023-09-29T23:23:45.479531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:46:02.634499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.457485+0000","last_change":"2023-09-29T23:23:41.050883+0000","last_active":"2023-09-29T23:23:45.457485+0000","last_peered":"2023-09-29T23:23:45.457485+0000","last_clean":"2023-09-29T23:23:45.457485+0000","last_became_active":"2023-09-29T23:23:41.050639+0000","last_became_peered":"2023-09-29T23:23:41.050639+0000","last_unstale":"2023-09-29T23:23:45.457485+0000","last_undegraded":"2023-09-29T23:23:45.457485+0000","last_fullsized":"2023-09-29T23:23:45.457485+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:35:26.897753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.457867+0000","last_change":"2023-09-29T23:23:45.077040+0000","last_active":"2023-09-29T23:23:45.457867+0000","last_peered":"2023-09-29T23:23:45.457867+0000","last_clean":"2023-09-29T23:23:45.457867+0000","last_became_active":"2023-09-29T23:23:45.076806+0000","last_became_peered":"2023-09-29T23:23:45.076806+0000","last_unstale":"2023-09-29T23:23:45.457867+0000","last_undegraded":"2023-09-29T23:23:45.457867+0000","last_fullsized":"2023-09-29T23:23:45.457867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:26:19.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.463631+0000","last_change":"2023-09-29T23:23:45.462067+0000","last_active":"2023-09-29T23:23:45.463631+0000","last_peered":"2023-09-29T23:23:45.463631+0000","last_clean":"2023-09-29T23:23:45.463631+0000","last_became_active":"2023-09-29T23:23:45.460913+0000","last_became_peered":"2023-09-29T23:23:45.460913+0000","last_unstale":"2023-09-29T23:23:45.463631+0000","last_undegraded":"2023-09-29T23:23:45.463631+0000","last_fullsized":"2023-09-29T23:23:45.463631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:06.275738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.458336+0000","last_change":"2023-09-29T23:23:41.050074+0000","last_active":"2023-09-29T23:23:45.458336+0000","last_peered":"2023-09-29T23:23:45.458336+0000","last_clean":"2023-09-29T23:23:45.458336+0000","last_became_active":"2023-09-29T23:23:41.049783+0000","last_became_peered":"2023-09-29T23:23:41.049783+0000","last_unstale":"2023-09-29T23:23:45.458336+0000","last_undegraded":"2023-09-29T23:23:45.458336+0000","last_fullsized":"2023-09-29T23:23:45.458336+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:37:01.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.453746+0000","last_change":"2023-09-29T23:23:45.076087+0000","last_active":"2023-09-29T23:23:45.453746+0000","last_peered":"2023-09-29T23:23:45.453746+0000","last_clean":"2023-09-29T23:23:45.453746+0000","last_became_active":"2023-09-29T23:23:45.075273+0000","last_became_peered":"2023-09-29T23:23:45.075273+0000","last_unstale":"2023-09-29T23:23:45.453746+0000","last_undegraded":"2023-09-29T23:23:45.453746+0000","last_fullsized":"2023-09-29T23:23:45.453746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:27.356997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.466914+0000","last_change":"2023-09-29T23:23:45.459071+0000","last_active":"2023-09-29T23:23:45.466914+0000","last_peered":"2023-09-29T23:23:45.466914+0000","last_clean":"2023-09-29T23:23:45.466914+0000","last_became_active":"2023-09-29T23:23:45.458250+0000","last_became_peered":"2023-09-29T23:23:45.458250+0000","last_unstale":"2023-09-29T23:23:45.466914+0000","last_undegraded":"2023-09-29T23:23:45.466914+0000","last_fullsized":"2023-09-29T23:23:45.466914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.478408+0000","last_change":"2023-09-29T23:23:45.076932+0000","last_active":"2023-09-29T23:23:45.478408+0000","last_peered":"2023-09-29T23:23:45.478408+0000","last_clean":"2023-09-29T23:23:45.478408+0000","last_became_active":"2023-09-29T23:23:45.076638+0000","last_became_peered":"2023-09-29T23:23:45.076638+0000","last_unstale":"2023-09-29T23:23:45.478408+0000","last_undegraded":"2023-09-29T23:23:45.478408+0000","last_fullsized":"2023-09-29T23:23:45.478408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:35:07.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472138+0000","last_change":"2023-09-29T23:23:45.471332+0000","last_active":"2023-09-29T23:23:45.472138+0000","last_peered":"2023-09-29T23:23:45.472138+0000","last_clean":"2023-09-29T23:23:45.472138+0000","last_became_active":"2023-09-29T23:23:45.471013+0000","last_became_peered":"2023-09-29T23:23:45.471013+0000","last_unstale":"2023-09-29T23:23:45.472138+0000","last_undegraded":"2023-09-29T23:23:45.472138+0000","last_fullsized":"2023-09-29T23:23:45.472138+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479907+0000","last_change":"2023-09-29T23:23:45.076405+0000","last_active":"2023-09-29T23:23:45.479907+0000","last_peered":"2023-09-29T23:23:45.479907+0000","last_clean":"2023-09-29T23:23:45.479907+0000","last_became_active":"2023-09-29T23:23:45.076191+0000","last_became_peered":"2023-09-29T23:23:45.076191+0000","last_unstale":"2023-09-29T23:23:45.479907+0000","last_undegraded":"2023-09-29T23:23:45.479907+0000","last_fullsized":"2023-09-29T23:23:45.479907+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:20:23.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.477541+0000","last_change":"2023-09-29T23:23:45.471929+0000","last_active":"2023-09-29T23:23:45.477541+0000","last_peered":"2023-09-29T23:23:45.477541+0000","last_clean":"2023-09-29T23:23:45.477541+0000","last_became_active":"2023-09-29T23:23:45.471673+0000","last_became_peered":"2023-09-29T23:23:45.471673+0000","last_unstale":"2023-09-29T23:23:45.477541+0000","last_undegraded":"2023-09-29T23:23:45.477541+0000","last_fullsized":"2023-09-29T23:23:45.477541+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474262+0000","last_change":"2023-09-29T23:23:45.092434+0000","last_active":"2023-09-29T23:23:45.474262+0000","last_peered":"2023-09-29T23:23:45.474262+0000","last_clean":"2023-09-29T23:23:45.474262+0000","last_became_active":"2023-09-29T23:23:45.092203+0000","last_became_peered":"2023-09-29T23:23:45.092203+0000","last_unstale":"2023-09-29T23:23:45.474262+0000","last_undegraded":"2023-09-29T23:23:45.474262+0000","last_fullsized":"2023-09-29T23:23:45.474262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472769+0000","last_change":"2023-09-29T23:23:45.464734+0000","last_active":"2023-09-29T23:23:45.472769+0000","last_peered":"2023-09-29T23:23:45.472769+0000","last_clean":"2023-09-29T23:23:45.472769+0000","last_became_active":"2023-09-29T23:23:45.464202+0000","last_became_peered":"2023-09-29T23:23:45.464202+0000","last_unstale":"2023-09-29T23:23:45.472769+0000","last_undegraded":"2023-09-29T23:23:45.472769+0000","last_fullsized":"2023-09-29T23:23:45.472769+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:59:25.888959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.480111+0000","last_change":"2023-09-29T23:23:45.074017+0000","last_active":"2023-09-29T23:23:45.480111+0000","last_peered":"2023-09-29T23:23:45.480111+0000","last_clean":"2023-09-29T23:23:45.480111+0000","last_became_active":"2023-09-29T23:23:45.073772+0000","last_became_peered":"2023-09-29T23:23:45.073772+0000","last_unstale":"2023-09-29T23:23:45.480111+0000","last_undegraded":"2023-09-29T23:23:45.480111+0000","last_fullsized":"2023-09-29T23:23:45.480111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467384+0000","last_change":"2023-09-29T23:23:45.460786+0000","last_active":"2023-09-29T23:23:45.467384+0000","last_peered":"2023-09-29T23:23:45.467384+0000","last_clean":"2023-09-29T23:23:45.467384+0000","last_became_active":"2023-09-29T23:23:45.460548+0000","last_became_peered":"2023-09-29T23:23:45.460548+0000","last_unstale":"2023-09-29T23:23:45.467384+0000","last_undegraded":"2023-09-29T23:23:45.467384+0000","last_fullsized":"2023-09-29T23:23:45.467384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:09:25.160546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473995+0000","last_change":"2023-09-29T23:23:45.471512+0000","last_active":"2023-09-29T23:23:45.473995+0000","last_peered":"2023-09-29T23:23:45.473995+0000","last_clean":"2023-09-29T23:23:45.473995+0000","last_became_active":"2023-09-29T23:23:45.471294+0000","last_became_peered":"2023-09-29T23:23:45.471294+0000","last_unstale":"2023-09-29T23:23:45.473995+0000","last_undegraded":"2023-09-29T23:23:45.473995+0000","last_fullsized":"2023-09-29T23:23:45.473995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:29:14.066786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467135+0000","last_change":"2023-09-29T23:23:45.462314+0000","last_active":"2023-09-29T23:23:45.467135+0000","last_peered":"2023-09-29T23:23:45.467135+0000","last_clean":"2023-09-29T23:23:45.467135+0000","last_became_active":"2023-09-29T23:23:45.461188+0000","last_became_peered":"2023-09-29T23:23:45.461188+0000","last_unstale":"2023-09-29T23:23:45.467135+0000","last_undegraded":"2023-09-29T23:23:45.467135+0000","last_fullsized":"2023-09-29T23:23:45.467135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:01:06.913634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479183+0000","last_change":"2023-09-29T23:23:45.473685+0000","last_active":"2023-09-29T23:23:45.479183+0000","last_peered":"2023-09-29T23:23:45.479183+0000","last_clean":"2023-09-29T23:23:45.479183+0000","last_became_active":"2023-09-29T23:23:45.473438+0000","last_became_peered":"2023-09-29T23:23:45.473438+0000","last_unstale":"2023-09-29T23:23:45.479183+0000","last_undegraded":"2023-09-29T23:23:45.479183+0000","last_fullsized":"2023-09-29T23:23:45.479183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:39:59.923188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479548+0000","last_change":"2023-09-29T23:23:45.477880+0000","last_active":"2023-09-29T23:23:45.479548+0000","last_peered":"2023-09-29T23:23:45.479548+0000","last_clean":"2023-09-29T23:23:45.479548+0000","last_became_active":"2023-09-29T23:23:45.474163+0000","last_became_peered":"2023-09-29T23:23:45.474163+0000","last_unstale":"2023-09-29T23:23:45.479548+0000","last_undegraded":"2023-09-29T23:23:45.479548+0000","last_fullsized":"2023-09-29T23:23:45.479548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:40:09.175714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479092+0000","last_change":"2023-09-29T23:23:45.473292+0000","last_active":"2023-09-29T23:23:45.479092+0000","last_peered":"2023-09-29T23:23:45.479092+0000","last_clean":"2023-09-29T23:23:45.479092+0000","last_became_active":"2023-09-29T23:23:45.473063+0000","last_became_peered":"2023-09-29T23:23:45.473063+0000","last_unstale":"2023-09-29T23:23:45.479092+0000","last_undegraded":"2023-09-29T23:23:45.479092+0000","last_fullsized":"2023-09-29T23:23:45.479092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:06:47.738713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.464396+0000","last_change":"2023-09-29T23:23:45.463712+0000","last_active":"2023-09-29T23:23:45.464396+0000","last_peered":"2023-09-29T23:23:45.464396+0000","last_clean":"2023-09-29T23:23:45.464396+0000","last_became_active":"2023-09-29T23:23:45.463269+0000","last_became_peered":"2023-09-29T23:23:45.463269+0000","last_unstale":"2023-09-29T23:23:45.464396+0000","last_undegraded":"2023-09-29T23:23:45.464396+0000","last_fullsized":"2023-09-29T23:23:45.464396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:32.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5556,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852044,"statfs":{"total":107374182400,"available":107368493056,"internally_reserved":0,"allocated":176128,"data_stored":46822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]}]},{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5484,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":104852116,"statfs":{"total":107374182400,"available":107368566784,"internally_reserved":0,"allocated":167936,"data_stored":46190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5544,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852056,"statfs":{"total":107374182400,"available":107368505344,"internally_reserved":0,"allocated":163840,"data_stored":45250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-29T23:23:54.289 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-29T23:23:54.290 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-29T23:23:54.290 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-29T23:23:54.290 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-29T23:23:54.291 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-29T23:23:54.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.437+0000 7f200f1de700 1 Processor -- start 2023-09-29T23:23:54.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.437+0000 7f200f1de700 1 -- start start 2023-09-29T23:23:54.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.437+0000 7f200f1de700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f200812ffc0 0x7f20080a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:54.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.437+0000 7f200f1de700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2008098710 con 0x7f200809fd80 2023-09-29T23:23:54.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.437+0000 7f200f1de700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f200812f340 con 0x7f200812ffc0 2023-09-29T23:23:54.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.438+0000 7f2007fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f200812ffc0 0x7f20080a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:54.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.438+0000 7f200cf7a700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f200809fd80 0x7f200812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54620/0 (socket says 172.21.15.92:54620) 2023-09-29T23:23:54.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.438+0000 7f200cf7a700 1 -- 172.21.15.92:0/1119149627 learned_addr learned my addr 172.21.15.92:0/1119149627 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:54.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.438+0000 7f2007fff700 1 --2- 172.21.15.92:0/1119149627 >> v2:172.21.15.92:3300/0 conn(0x7f200812ffc0 0x7f20080a3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49026/0 (socket says 172.21.15.92:49026) 2023-09-29T23:23:54.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.438+0000 7f2007fff700 1 -- 172.21.15.92:0/1119149627 >> v1:172.21.15.92:6789/0 conn(0x7f200809fd80 legacy=0x7f200812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:54.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.438+0000 7f2007fff700 1 -- 172.21.15.92:0/1119149627 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20080997e0 con 0x7f200812ffc0 2023-09-29T23:23:54.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.438+0000 7f20077fe700 1 -- 172.21.15.92:0/1119149627 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598108526 0 0) 0x7f2008098710 con 0x7f200809fd80 2023-09-29T23:23:54.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.438+0000 7f2007fff700 1 --2- 172.21.15.92:0/1119149627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f200812ffc0 0x7f20080a3090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009860 tx=0x7f1ff40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba296174fcdd7b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:54.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.438+0000 7f20077fe700 1 -- 172.21.15.92:0/1119149627 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ff400b680 con 0x7f200812ffc0 2023-09-29T23:23:54.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.438+0000 7f20077fe700 1 -- 172.21.15.92:0/1119149627 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff400b7e0 con 0x7f200812ffc0 2023-09-29T23:23:54.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.438+0000 7f20077fe700 1 -- 172.21.15.92:0/1119149627 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ff400b990 con 0x7f200812ffc0 2023-09-29T23:23:54.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.439+0000 7f200f1de700 1 -- 172.21.15.92:0/1119149627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f200812ffc0 msgr2=0x7f20080a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:54.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.439+0000 7f200f1de700 1 --2- 172.21.15.92:0/1119149627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f200812ffc0 0x7f20080a3090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009860 tx=0x7f1ff40091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:54.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.439+0000 7f200f1de700 1 -- 172.21.15.92:0/1119149627 shutdown_connections 2023-09-29T23:23:54.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.439+0000 7f200f1de700 1 --2- 172.21.15.92:0/1119149627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f200812ffc0 0x7f20080a3090 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:54.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.439+0000 7f200f1de700 1 -- 172.21.15.92:0/1119149627 >> 172.21.15.92:0/1119149627 conn(0x7f2008068000 msgr2=0x7f20080a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:54.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.439+0000 7f200f1de700 1 -- 172.21.15.92:0/1119149627 shutdown_connections 2023-09-29T23:23:54.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.439+0000 7f200f1de700 1 -- 172.21.15.92:0/1119149627 wait complete. 2023-09-29T23:23:54.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.439+0000 7f200f1de700 1 Processor -- start 2023-09-29T23:23:54.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.440+0000 7f200f1de700 1 -- start start 2023-09-29T23:23:54.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.440+0000 7f200f1de700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f200809fd80 0x7f200813e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:54.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.440+0000 7f200f1de700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200811e2f0 con 0x7f200809fd80 2023-09-29T23:23:54.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.440+0000 7f200cf7a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f200809fd80 0x7f200813e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:54.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.440+0000 7f200cf7a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f200809fd80 0x7f200813e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49042/0 (socket says 172.21.15.92:49042) 2023-09-29T23:23:54.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.440+0000 7f200cf7a700 1 -- 172.21.15.92:0/2538599940 learned_addr learned my addr 172.21.15.92:0/2538599940 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:54.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.440+0000 7f200cf7a700 1 -- 172.21.15.92:0/2538599940 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff4009420 con 0x7f200809fd80 2023-09-29T23:23:54.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.440+0000 7f200cf7a700 1 --2- 172.21.15.92:0/2538599940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f200809fd80 0x7f200813e520 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00c460 tx=0x7f1ffc000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:54.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.441+0000 7f2004ff9700 1 -- 172.21.15.92:0/2538599940 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ffc005c70 con 0x7f200809fd80 2023-09-29T23:23:54.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.441+0000 7f2004ff9700 1 -- 172.21.15.92:0/2538599940 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc005dd0 con 0x7f200809fd80 2023-09-29T23:23:54.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.441+0000 7f200f1de700 1 -- 172.21.15.92:0/2538599940 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f200811c4a0 con 0x7f200809fd80 2023-09-29T23:23:54.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.441+0000 7f2004ff9700 1 -- 172.21.15.92:0/2538599940 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ffc007230 con 0x7f200809fd80 2023-09-29T23:23:54.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.441+0000 7f200f1de700 1 -- 172.21.15.92:0/2538599940 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200811cff0 con 0x7f200809fd80 2023-09-29T23:23:54.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.441+0000 7f2004ff9700 1 -- 172.21.15.92:0/2538599940 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f1ffc007460 con 0x7f200809fd80 2023-09-29T23:23:54.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.441+0000 7f2004ff9700 1 --2- 172.21.15.92:0/2538599940 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1fec0355e0 0x7f1fec037a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:54.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.441+0000 7f2004ff9700 1 -- 172.21.15.92:0/2538599940 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f1ffc046b30 con 0x7f200809fd80 2023-09-29T23:23:54.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.442+0000 7f2007fff700 1 --2- 172.21.15.92:0/2538599940 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1fec0355e0 0x7f1fec037a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:54.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.442+0000 7f200f1de700 1 -- 172.21.15.92:0/2538599940 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20080a1fc0 con 0x7f200809fd80 2023-09-29T23:23:54.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.442+0000 7f2007fff700 1 --2- 172.21.15.92:0/2538599940 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1fec0355e0 0x7f1fec037a90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009860 tx=0x7f1ff4016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:54.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.446+0000 7f2004ff9700 1 -- 172.21.15.92:0/2538599940 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ffc017020 con 0x7f200809fd80 2023-09-29T23:23:54.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.684+0000 7f200f1de700 1 -- 172.21.15.92:0/2538599940 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f200805f230 con 0x7f200809fd80 2023-09-29T23:23:54.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.686+0000 7f2004ff9700 1 -- 172.21.15.92:0/2538599940 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+82344 (secure 0 0 0) 0x7f1ffc0188b0 con 0x7f200809fd80 2023-09-29T23:23:54.687 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:54.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.688+0000 7f200f1de700 1 -- 172.21.15.92:0/2538599940 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1fec0355e0 msgr2=0x7f1fec037a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:54.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.688+0000 7f200f1de700 1 --2- 172.21.15.92:0/2538599940 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1fec0355e0 0x7f1fec037a90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009860 tx=0x7f1ff4016000 comp rx=0 tx=0).stop 2023-09-29T23:23:54.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.688+0000 7f200f1de700 1 -- 172.21.15.92:0/2538599940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f200809fd80 msgr2=0x7f200813e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:54.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.688+0000 7f200f1de700 1 --2- 172.21.15.92:0/2538599940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f200809fd80 0x7f200813e520 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00c460 tx=0x7f1ffc000fe0 comp rx=0 tx=0).stop 2023-09-29T23:23:54.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.688+0000 7f200f1de700 1 -- 172.21.15.92:0/2538599940 shutdown_connections 2023-09-29T23:23:54.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.688+0000 7f200f1de700 1 --2- 172.21.15.92:0/2538599940 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1fec0355e0 0x7f1fec037a90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:54.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.688+0000 7f200f1de700 1 --2- 172.21.15.92:0/2538599940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f200809fd80 0x7f200813e520 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:54.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.688+0000 7f200f1de700 1 -- 172.21.15.92:0/2538599940 >> 172.21.15.92:0/2538599940 conn(0x7f2008068000 msgr2=0x7f2008094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:54.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.688+0000 7f200f1de700 1 -- 172.21.15.92:0/2538599940 shutdown_connections 2023-09-29T23:23:54.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.688+0000 7f200f1de700 1 -- 172.21.15.92:0/2538599940 wait complete. 2023-09-29T23:23:54.700 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":4,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":85403},{"type":"v1","addr":"172.21.15.92:6825","nonce":85403}]},"active_addr":"172.21.15.92:6825/85403","active_change":"2023-09-29T23:23:36.026992+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":4205074657}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":3691501986}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":3607219742}]}]} 2023-09-29T23:23:54.703 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-29T23:23:54.704 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-29T23:23:54.704 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:23:54.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.817+0000 7f669f59e700 1 Processor -- start 2023-09-29T23:23:54.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.817+0000 7f669f59e700 1 -- start start 2023-09-29T23:23:54.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.817+0000 7f669f59e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f66a00a3030 0x7f66a012bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:54.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.817+0000 7f669f59e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a0098320 con 0x7f66a009c600 2023-09-29T23:23:54.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.817+0000 7f669f59e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a009c9d0 con 0x7f66a00a3030 2023-09-29T23:23:54.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.817+0000 7f669dd9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f66a00a3030 0x7f66a012bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:54.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.817+0000 7f669e59c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f66a009c600 0x7f66a012f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54622/0 (socket says 172.21.15.92:54622) 2023-09-29T23:23:54.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.817+0000 7f669e59c700 1 -- 172.21.15.92:0/290589921 learned_addr learned my addr 172.21.15.92:0/290589921 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:54.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.818+0000 7f669dd9b700 1 -- 172.21.15.92:0/290589921 >> v1:172.21.15.92:6789/0 conn(0x7f66a009c600 legacy=0x7f66a012f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:54.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.818+0000 7f669dd9b700 1 -- 172.21.15.92:0/290589921 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a012c620 con 0x7f66a00a3030 2023-09-29T23:23:54.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.818+0000 7f669d59a700 1 -- 172.21.15.92:0/290589921 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615723897 0 0) 0x7f66a0098320 con 0x7f66a009c600 2023-09-29T23:23:54.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.818+0000 7f669dd9b700 1 --2- 172.21.15.92:0/290589921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66a00a3030 0x7f66a012bc80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6688009860 tx=0x7f66880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7040dbe1a345af12 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:54.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.818+0000 7f669d59a700 1 -- 172.21.15.92:0/290589921 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f668800b680 con 0x7f66a00a3030 2023-09-29T23:23:54.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.818+0000 7f669d59a700 1 -- 172.21.15.92:0/290589921 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668800b7e0 con 0x7f66a00a3030 2023-09-29T23:23:54.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.818+0000 7f669d59a700 1 -- 172.21.15.92:0/290589921 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f668800bad0 con 0x7f66a00a3030 2023-09-29T23:23:54.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.818+0000 7f669f59e700 1 -- 172.21.15.92:0/290589921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66a00a3030 msgr2=0x7f66a012bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:54.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.818+0000 7f669f59e700 1 --2- 172.21.15.92:0/290589921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66a00a3030 0x7f66a012bc80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6688009860 tx=0x7f66880091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:54.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.818+0000 7f669f59e700 1 -- 172.21.15.92:0/290589921 shutdown_connections 2023-09-29T23:23:54.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.818+0000 7f669f59e700 1 --2- 172.21.15.92:0/290589921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66a00a3030 0x7f66a012bc80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:54.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.818+0000 7f669f59e700 1 -- 172.21.15.92:0/290589921 >> 172.21.15.92:0/290589921 conn(0x7f66a0068080 msgr2=0x7f66a0096a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:54.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.819+0000 7f669f59e700 1 -- 172.21.15.92:0/290589921 shutdown_connections 2023-09-29T23:23:54.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.819+0000 7f669f59e700 1 -- 172.21.15.92:0/290589921 wait complete. 2023-09-29T23:23:54.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.819+0000 7f669f59e700 1 Processor -- start 2023-09-29T23:23:54.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.819+0000 7f669f59e700 1 -- start start 2023-09-29T23:23:54.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.820+0000 7f669f59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66a009c600 0x7f66a0119970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:54.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.820+0000 7f669f59e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a012bb30 con 0x7f66a009c600 2023-09-29T23:23:54.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.820+0000 7f669e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66a009c600 0x7f66a0119970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:54.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.820+0000 7f669e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66a009c600 0x7f66a0119970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49056/0 (socket says 172.21.15.92:49056) 2023-09-29T23:23:54.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.820+0000 7f669e59c700 1 -- 172.21.15.92:0/2851388059 learned_addr learned my addr 172.21.15.92:0/2851388059 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:54.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.820+0000 7f669e59c700 1 -- 172.21.15.92:0/2851388059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6688009420 con 0x7f66a009c600 2023-09-29T23:23:54.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.820+0000 7f669e59c700 1 --2- 172.21.15.92:0/2851388059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66a009c600 0x7f66a0119970 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f669000cbc0 tx=0x7f66900019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:54.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.820+0000 7f66967fc700 1 -- 172.21.15.92:0/2851388059 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f669000aa20 con 0x7f66a009c600 2023-09-29T23:23:54.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.820+0000 7f66967fc700 1 -- 172.21.15.92:0/2851388059 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669000aba0 con 0x7f66a009c600 2023-09-29T23:23:54.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.820+0000 7f66967fc700 1 -- 172.21.15.92:0/2851388059 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f669000ae90 con 0x7f66a009c600 2023-09-29T23:23:54.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.820+0000 7f669f59e700 1 -- 172.21.15.92:0/2851388059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a011d510 con 0x7f66a009c600 2023-09-29T23:23:54.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.820+0000 7f669f59e700 1 -- 172.21.15.92:0/2851388059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a011acd0 con 0x7f66a009c600 2023-09-29T23:23:54.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.821+0000 7f66967fc700 1 -- 172.21.15.92:0/2851388059 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f66900070f0 con 0x7f66a009c600 2023-09-29T23:23:54.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.821+0000 7f669f59e700 1 -- 172.21.15.92:0/2851388059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a0068b80 con 0x7f66a009c600 2023-09-29T23:23:54.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.821+0000 7f66967fc700 1 --2- 172.21.15.92:0/2851388059 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6680035630 0x7f6680037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:54.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.821+0000 7f66967fc700 1 -- 172.21.15.92:0/2851388059 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f66900479b0 con 0x7f66a009c600 2023-09-29T23:23:54.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.821+0000 7f669dd9b700 1 --2- 172.21.15.92:0/2851388059 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6680035630 0x7f6680037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:54.825 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.822+0000 7f669dd9b700 1 --2- 172.21.15.92:0/2851388059 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6680035630 0x7f6680037ae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f66880091e0 tx=0x7f6688016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:54.826 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:54.826+0000 7f66967fc700 1 -- 172.21.15.92:0/2851388059 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f669001a950 con 0x7f66a009c600 2023-09-29T23:23:55.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.012+0000 7f669f59e700 1 -- 172.21.15.92:0/2851388059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66a005f230 con 0x7f66a009c600 2023-09-29T23:23:55.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.012+0000 7f66967fc700 1 -- 172.21.15.92:0/2851388059 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+9448 (secure 0 0 0) 0x7f66900113a0 con 0x7f66a009c600 2023-09-29T23:23:55.013 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:55.013 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":17,"fsid":"5b80eae7-9a7e-4dc0-8ff1-cd1f82a1fa33","created":"2023-09-29T23:23:30.308760+0000","modified":"2023-09-29T23:23:46.442906+0000","last_up_change":"2023-09-29T23:23:37.693186+0000","last_in_change":"2023-09-29T23:23:31.538675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-09-29T23:23:39.227674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-29T23:23:43.363869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-29T23:23:44.406215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea64f859-a36f-4804-810d-2fe7081c9990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":85726},{"type":"v1","addr":"172.21.15.92:6817","nonce":85726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":85726},{"type":"v1","addr":"172.21.15.92:6819","nonce":85726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":85726},{"type":"v1","addr":"172.21.15.92:6823","nonce":85726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":85726},{"type":"v1","addr":"172.21.15.92:6821","nonce":85726}]},"public_addr":"172.21.15.92:6817/85726","cluster_addr":"172.21.15.92:6819/85726","heartbeat_back_addr":"172.21.15.92:6823/85726","heartbeat_front_addr":"172.21.15.92:6821/85726","state":["exists","up"]},{"osd":1,"uuid":"2e9c0837-2887-469f-9dea-db4bde348578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":85705},{"type":"v1","addr":"172.21.15.92:6809","nonce":85705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":85705},{"type":"v1","addr":"172.21.15.92:6811","nonce":85705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":85705},{"type":"v1","addr":"172.21.15.92:6815","nonce":85705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":85705},{"type":"v1","addr":"172.21.15.92:6813","nonce":85705}]},"public_addr":"172.21.15.92:6809/85705","cluster_addr":"172.21.15.92:6811/85705","heartbeat_back_addr":"172.21.15.92:6815/85705","heartbeat_front_addr":"172.21.15.92:6813/85705","state":["exists","up"]},{"osd":2,"uuid":"81ff42a8-c905-48bb-a021-3f5734761a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":85704},{"type":"v1","addr":"172.21.15.92:6801","nonce":85704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":85704},{"type":"v1","addr":"172.21.15.92:6803","nonce":85704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":85704},{"type":"v1","addr":"172.21.15.92:6807","nonce":85704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":85704},{"type":"v1","addr":"172.21.15.92:6805","nonce":85704}]},"public_addr":"172.21.15.92:6801/85704","cluster_addr":"172.21.15.92:6803/85704","heartbeat_back_addr":"172.21.15.92:6807/85704","heartbeat_front_addr":"172.21.15.92:6805/85704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.911756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.874000+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.680977+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:23:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.014+0000 7f669f59e700 1 -- 172.21.15.92:0/2851388059 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6680035630 msgr2=0x7f6680037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.014+0000 7f669f59e700 1 --2- 172.21.15.92:0/2851388059 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6680035630 0x7f6680037ae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f66880091e0 tx=0x7f6688016000 comp rx=0 tx=0).stop 2023-09-29T23:23:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.014+0000 7f669f59e700 1 -- 172.21.15.92:0/2851388059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66a009c600 msgr2=0x7f66a0119970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.014+0000 7f669f59e700 1 --2- 172.21.15.92:0/2851388059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66a009c600 0x7f66a0119970 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f669000cbc0 tx=0x7f66900019e0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.014+0000 7f669f59e700 1 -- 172.21.15.92:0/2851388059 shutdown_connections 2023-09-29T23:23:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.014+0000 7f669f59e700 1 --2- 172.21.15.92:0/2851388059 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6680035630 0x7f6680037ae0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.014+0000 7f669f59e700 1 --2- 172.21.15.92:0/2851388059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66a009c600 0x7f66a0119970 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.014+0000 7f669f59e700 1 -- 172.21.15.92:0/2851388059 >> 172.21.15.92:0/2851388059 conn(0x7f66a0068080 msgr2=0x7f66a009cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.014+0000 7f669f59e700 1 -- 172.21.15.92:0/2851388059 shutdown_connections 2023-09-29T23:23:55.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.014+0000 7f669f59e700 1 -- 172.21.15.92:0/2851388059 wait complete. 2023-09-29T23:23:55.027 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-29T23:23:55.027 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:23:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.140+0000 7f5a05d9d700 1 Processor -- start 2023-09-29T23:23:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.140+0000 7f5a05d9d700 1 -- start start 2023-09-29T23:23:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.140+0000 7f5a05d9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5a00097bb0 0x7f5a00132130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.140+0000 7f5a05d9d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a000a0e20 con 0x7f5a0006f100 2023-09-29T23:23:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.140+0000 7f5a05d9d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0006f4d0 con 0x7f5a00097bb0 2023-09-29T23:23:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.140+0000 7f59fffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5a00097bb0 0x7f5a00132130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.141+0000 7f5a04d9b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f5a0006f100 0x7f5a000974a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54634/0 (socket says 172.21.15.92:54634) 2023-09-29T23:23:55.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.141+0000 7f5a04d9b700 1 -- 172.21.15.92:0/2993012762 learned_addr learned my addr 172.21.15.92:0/2993012762 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:55.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.141+0000 7f59fffff700 1 -- 172.21.15.92:0/2993012762 >> v1:172.21.15.92:6789/0 conn(0x7f5a0006f100 legacy=0x7f5a000974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.141+0000 7f59ff7fe700 1 -- 172.21.15.92:0/2993012762 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735758531 0 0) 0x7f5a000a0e20 con 0x7f5a0006f100 2023-09-29T23:23:55.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.141+0000 7f59fffff700 1 -- 172.21.15.92:0/2993012762 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a00098570 con 0x7f5a00097bb0 2023-09-29T23:23:55.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.141+0000 7f59fffff700 1 --2- 172.21.15.92:0/2993012762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a00097bb0 0x7f5a00132130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009890 tx=0x7f59ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e561f38d7152ad server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.141+0000 7f59ff7fe700 1 -- 172.21.15.92:0/2993012762 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59ec00b670 con 0x7f5a00097bb0 2023-09-29T23:23:55.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.141+0000 7f59ff7fe700 1 -- 172.21.15.92:0/2993012762 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ec00b7d0 con 0x7f5a00097bb0 2023-09-29T23:23:55.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.141+0000 7f59ff7fe700 1 -- 172.21.15.92:0/2993012762 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59ec00bac0 con 0x7f5a00097bb0 2023-09-29T23:23:55.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.141+0000 7f5a05d9d700 1 -- 172.21.15.92:0/2993012762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a00097bb0 msgr2=0x7f5a00132130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.141+0000 7f5a05d9d700 1 --2- 172.21.15.92:0/2993012762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a00097bb0 0x7f5a00132130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009890 tx=0x7f59ec0091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.142+0000 7f5a05d9d700 1 -- 172.21.15.92:0/2993012762 shutdown_connections 2023-09-29T23:23:55.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.142+0000 7f5a05d9d700 1 --2- 172.21.15.92:0/2993012762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a00097bb0 0x7f5a00132130 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.142+0000 7f5a05d9d700 1 -- 172.21.15.92:0/2993012762 >> 172.21.15.92:0/2993012762 conn(0x7f5a00094a70 msgr2=0x7f5a0006e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:55.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.142+0000 7f5a05d9d700 1 -- 172.21.15.92:0/2993012762 shutdown_connections 2023-09-29T23:23:55.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.142+0000 7f5a05d9d700 1 -- 172.21.15.92:0/2993012762 wait complete. 2023-09-29T23:23:55.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.142+0000 7f5a05d9d700 1 Processor -- start 2023-09-29T23:23:55.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.143+0000 7f5a05d9d700 1 -- start start 2023-09-29T23:23:55.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.143+0000 7f5a05d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a0006f100 0x7f5a0009f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.143+0000 7f5a05d9d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0006a2f0 con 0x7f5a0006f100 2023-09-29T23:23:55.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.143+0000 7f5a04d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a0006f100 0x7f5a0009f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.143+0000 7f5a04d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a0006f100 0x7f5a0009f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49076/0 (socket says 172.21.15.92:49076) 2023-09-29T23:23:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.143+0000 7f5a04d9b700 1 -- 172.21.15.92:0/3932524398 learned_addr learned my addr 172.21.15.92:0/3932524398 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.143+0000 7f5a04d9b700 1 -- 172.21.15.92:0/3932524398 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec009420 con 0x7f5a0006f100 2023-09-29T23:23:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.143+0000 7f5a04d9b700 1 --2- 172.21.15.92:0/3932524398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a0006f100 0x7f5a0009f2b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f59f400c460 tx=0x7f59f4000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.143+0000 7f59fcff9700 1 -- 172.21.15.92:0/3932524398 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59f4005b30 con 0x7f5a0006f100 2023-09-29T23:23:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.144+0000 7f59fcff9700 1 -- 172.21.15.92:0/3932524398 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f4005c90 con 0x7f5a0006f100 2023-09-29T23:23:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.144+0000 7f59fcff9700 1 -- 172.21.15.92:0/3932524398 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59f40070d0 con 0x7f5a0006f100 2023-09-29T23:23:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.144+0000 7f5a05d9d700 1 -- 172.21.15.92:0/3932524398 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a000994d0 con 0x7f5a0006f100 2023-09-29T23:23:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.144+0000 7f5a05d9d700 1 -- 172.21.15.92:0/3932524398 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0012aab0 con 0x7f5a0006f100 2023-09-29T23:23:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.144+0000 7f59fcff9700 1 -- 172.21.15.92:0/3932524398 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f59f4007230 con 0x7f5a0006f100 2023-09-29T23:23:55.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.144+0000 7f59fcff9700 1 --2- 172.21.15.92:0/3932524398 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f59e4035630 0x7f59e4037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.144+0000 7f59fcff9700 1 -- 172.21.15.92:0/3932524398 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f59f4046820 con 0x7f5a0006f100 2023-09-29T23:23:55.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.145+0000 7f59fffff700 1 --2- 172.21.15.92:0/3932524398 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f59e4035630 0x7f59e4037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.145+0000 7f5a05d9d700 1 -- 172.21.15.92:0/3932524398 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0012aab0 con 0x7f5a0006f100 2023-09-29T23:23:55.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.145+0000 7f59fffff700 1 --2- 172.21.15.92:0/3932524398 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f59e4035630 0x7f59e4037ae0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f59ec000c00 tx=0x7f59ec016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.149+0000 7f59fcff9700 1 -- 172.21.15.92:0/3932524398 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a0012aab0 con 0x7f5a0006f100 2023-09-29T23:23:55.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.335+0000 7f5a05d9d700 1 -- 172.21.15.92:0/3932524398 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a0012aab0 con 0x7f5a0006f100 2023-09-29T23:23:55.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.336+0000 7f59fcff9700 1 -- 172.21.15.92:0/3932524398 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+9448 (secure 0 0 0) 0x7f5a0012aab0 con 0x7f5a0006f100 2023-09-29T23:23:55.336 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:55.337 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":17,"fsid":"5b80eae7-9a7e-4dc0-8ff1-cd1f82a1fa33","created":"2023-09-29T23:23:30.308760+0000","modified":"2023-09-29T23:23:46.442906+0000","last_up_change":"2023-09-29T23:23:37.693186+0000","last_in_change":"2023-09-29T23:23:31.538675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-09-29T23:23:39.227674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-29T23:23:43.363869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-29T23:23:44.406215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea64f859-a36f-4804-810d-2fe7081c9990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":85726},{"type":"v1","addr":"172.21.15.92:6817","nonce":85726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":85726},{"type":"v1","addr":"172.21.15.92:6819","nonce":85726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":85726},{"type":"v1","addr":"172.21.15.92:6823","nonce":85726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":85726},{"type":"v1","addr":"172.21.15.92:6821","nonce":85726}]},"public_addr":"172.21.15.92:6817/85726","cluster_addr":"172.21.15.92:6819/85726","heartbeat_back_addr":"172.21.15.92:6823/85726","heartbeat_front_addr":"172.21.15.92:6821/85726","state":["exists","up"]},{"osd":1,"uuid":"2e9c0837-2887-469f-9dea-db4bde348578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":85705},{"type":"v1","addr":"172.21.15.92:6809","nonce":85705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":85705},{"type":"v1","addr":"172.21.15.92:6811","nonce":85705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":85705},{"type":"v1","addr":"172.21.15.92:6815","nonce":85705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":85705},{"type":"v1","addr":"172.21.15.92:6813","nonce":85705}]},"public_addr":"172.21.15.92:6809/85705","cluster_addr":"172.21.15.92:6811/85705","heartbeat_back_addr":"172.21.15.92:6815/85705","heartbeat_front_addr":"172.21.15.92:6813/85705","state":["exists","up"]},{"osd":2,"uuid":"81ff42a8-c905-48bb-a021-3f5734761a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":85704},{"type":"v1","addr":"172.21.15.92:6801","nonce":85704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":85704},{"type":"v1","addr":"172.21.15.92:6803","nonce":85704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":85704},{"type":"v1","addr":"172.21.15.92:6807","nonce":85704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":85704},{"type":"v1","addr":"172.21.15.92:6805","nonce":85704}]},"public_addr":"172.21.15.92:6801/85704","cluster_addr":"172.21.15.92:6803/85704","heartbeat_back_addr":"172.21.15.92:6807/85704","heartbeat_front_addr":"172.21.15.92:6805/85704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.911756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.874000+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.680977+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:23:55.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.338+0000 7f5a05d9d700 1 -- 172.21.15.92:0/3932524398 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f59e4035630 msgr2=0x7f59e4037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.338+0000 7f5a05d9d700 1 --2- 172.21.15.92:0/3932524398 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f59e4035630 0x7f59e4037ae0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f59ec000c00 tx=0x7f59ec016000 comp rx=0 tx=0).stop 2023-09-29T23:23:55.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.338+0000 7f5a05d9d700 1 -- 172.21.15.92:0/3932524398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a0006f100 msgr2=0x7f5a0009f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.338+0000 7f5a05d9d700 1 --2- 172.21.15.92:0/3932524398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a0006f100 0x7f5a0009f2b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f59f400c460 tx=0x7f59f4000fe0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.338+0000 7f5a05d9d700 1 -- 172.21.15.92:0/3932524398 shutdown_connections 2023-09-29T23:23:55.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.338+0000 7f5a05d9d700 1 --2- 172.21.15.92:0/3932524398 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f59e4035630 0x7f59e4037ae0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.338+0000 7f5a05d9d700 1 --2- 172.21.15.92:0/3932524398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a0006f100 0x7f5a0009f2b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.338+0000 7f5a05d9d700 1 -- 172.21.15.92:0/3932524398 >> 172.21.15.92:0/3932524398 conn(0x7f5a00094a70 msgr2=0x7f5a0012c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:55.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.338+0000 7f5a05d9d700 1 -- 172.21.15.92:0/3932524398 shutdown_connections 2023-09-29T23:23:55.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.338+0000 7f5a05d9d700 1 -- 172.21.15.92:0/3932524398 wait complete. 2023-09-29T23:23:55.350 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-29T23:23:55.351 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-29T23:23:55.351 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-29T23:23:55.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.471+0000 7fd929ed6700 1 Processor -- start 2023-09-29T23:23:55.472 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.471+0000 7fd929ed6700 1 -- start start 2023-09-29T23:23:55.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.471+0000 7fd929ed6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd92412ffc0 0x7fd9240a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.471+0000 7fd929ed6700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd924098710 con 0x7fd92409fd80 2023-09-29T23:23:55.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.471+0000 7fd929ed6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd92412f340 con 0x7fd92412ffc0 2023-09-29T23:23:55.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.471+0000 7fd922ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd92412ffc0 0x7fd9240a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.471+0000 7fd9237fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fd92409fd80 0x7fd92412f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54638/0 (socket says 172.21.15.92:54638) 2023-09-29T23:23:55.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.471+0000 7fd9237fe700 1 -- 172.21.15.92:0/3475414953 learned_addr learned my addr 172.21.15.92:0/3475414953 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:55.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.472+0000 7fd922ffd700 1 -- 172.21.15.92:0/3475414953 >> v1:172.21.15.92:6789/0 conn(0x7fd92409fd80 legacy=0x7fd92412f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.472+0000 7fd9227fc700 1 -- 172.21.15.92:0/3475414953 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84151580 0 0) 0x7fd924098710 con 0x7fd92409fd80 2023-09-29T23:23:55.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.472+0000 7fd922ffd700 1 -- 172.21.15.92:0/3475414953 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9240997e0 con 0x7fd92412ffc0 2023-09-29T23:23:55.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.472+0000 7fd922ffd700 1 --2- 172.21.15.92:0/3475414953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd92412ffc0 0x7fd9240a3090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd918009860 tx=0x7fd9180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eaf236ffdc3f618 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.472+0000 7fd9227fc700 1 -- 172.21.15.92:0/3475414953 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd91800b680 con 0x7fd92412ffc0 2023-09-29T23:23:55.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.472+0000 7fd9227fc700 1 -- 172.21.15.92:0/3475414953 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91800b7e0 con 0x7fd92412ffc0 2023-09-29T23:23:55.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.472+0000 7fd9227fc700 1 -- 172.21.15.92:0/3475414953 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd91800b990 con 0x7fd92412ffc0 2023-09-29T23:23:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.473+0000 7fd929ed6700 1 -- 172.21.15.92:0/3475414953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd92412ffc0 msgr2=0x7fd9240a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.473+0000 7fd929ed6700 1 --2- 172.21.15.92:0/3475414953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd92412ffc0 0x7fd9240a3090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd918009860 tx=0x7fd9180091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.473+0000 7fd929ed6700 1 -- 172.21.15.92:0/3475414953 shutdown_connections 2023-09-29T23:23:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.473+0000 7fd929ed6700 1 --2- 172.21.15.92:0/3475414953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd92412ffc0 0x7fd9240a3090 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.473+0000 7fd929ed6700 1 -- 172.21.15.92:0/3475414953 >> 172.21.15.92:0/3475414953 conn(0x7fd924068000 msgr2=0x7fd9240a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.473+0000 7fd929ed6700 1 -- 172.21.15.92:0/3475414953 shutdown_connections 2023-09-29T23:23:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.473+0000 7fd929ed6700 1 -- 172.21.15.92:0/3475414953 wait complete. 2023-09-29T23:23:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.474+0000 7fd929ed6700 1 Processor -- start 2023-09-29T23:23:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.474+0000 7fd929ed6700 1 -- start start 2023-09-29T23:23:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.475+0000 7fd929ed6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd92409fd80 0x7fd92413e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.475+0000 7fd929ed6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92411e360 con 0x7fd92409fd80 2023-09-29T23:23:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.475+0000 7fd9237fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd92409fd80 0x7fd92413e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.475+0000 7fd9237fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd92409fd80 0x7fd92413e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49086/0 (socket says 172.21.15.92:49086) 2023-09-29T23:23:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.475+0000 7fd9237fe700 1 -- 172.21.15.92:0/2696675528 learned_addr learned my addr 172.21.15.92:0/2696675528 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.475+0000 7fd9237fe700 1 -- 172.21.15.92:0/2696675528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd918009420 con 0x7fd92409fd80 2023-09-29T23:23:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.475+0000 7fd9237fe700 1 --2- 172.21.15.92:0/2696675528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd92409fd80 0x7fd92413e4f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd91400c460 tx=0x7fd914000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.475+0000 7fd90b7fe700 1 -- 172.21.15.92:0/2696675528 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd914005c70 con 0x7fd92409fd80 2023-09-29T23:23:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.475+0000 7fd90b7fe700 1 -- 172.21.15.92:0/2696675528 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd914005dd0 con 0x7fd92409fd80 2023-09-29T23:23:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.475+0000 7fd90b7fe700 1 -- 172.21.15.92:0/2696675528 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd914007230 con 0x7fd92409fd80 2023-09-29T23:23:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.475+0000 7fd929ed6700 1 -- 172.21.15.92:0/2696675528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd92411c510 con 0x7fd92409fd80 2023-09-29T23:23:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.475+0000 7fd929ed6700 1 -- 172.21.15.92:0/2696675528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd92411d060 con 0x7fd92409fd80 2023-09-29T23:23:55.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.476+0000 7fd929ed6700 1 -- 172.21.15.92:0/2696675528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9240a19f0 con 0x7fd92409fd80 2023-09-29T23:23:55.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.476+0000 7fd90b7fe700 1 -- 172.21.15.92:0/2696675528 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fd914007390 con 0x7fd92409fd80 2023-09-29T23:23:55.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.477+0000 7fd90b7fe700 1 --2- 172.21.15.92:0/2696675528 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd910035630 0x7fd910037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.477+0000 7fd90b7fe700 1 -- 172.21.15.92:0/2696675528 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7fd914046a50 con 0x7fd92409fd80 2023-09-29T23:23:55.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.477+0000 7fd922ffd700 1 --2- 172.21.15.92:0/2696675528 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd910035630 0x7fd910037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.477+0000 7fd90b7fe700 1 --2- 172.21.15.92:0/2696675528 >> [v2:172.21.15.92:6808/85705,v1:172.21.15.92:6809/85705] conn(0x7fd91003c6a0 0x7fd91003ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.477+0000 7fd90b7fe700 1 -- 172.21.15.92:0/2696675528 --> [v2:172.21.15.92:6808/85705,v1:172.21.15.92:6809/85705] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd91003f1e0 con 0x7fd91003c6a0 2023-09-29T23:23:55.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.477+0000 7fd90b7fe700 1 -- 172.21.15.92:0/2696675528 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd91404b220 con 0x7fd92409fd80 2023-09-29T23:23:55.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.477+0000 7fd923fff700 1 --2- 172.21.15.92:0/2696675528 >> [v2:172.21.15.92:6808/85705,v1:172.21.15.92:6809/85705] conn(0x7fd91003c6a0 0x7fd91003ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.477+0000 7fd922ffd700 1 --2- 172.21.15.92:0/2696675528 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd910035630 0x7fd910037ae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd918009860 tx=0x7fd918016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.477+0000 7fd923fff700 1 --2- 172.21.15.92:0/2696675528 >> [v2:172.21.15.92:6808/85705,v1:172.21.15.92:6809/85705] conn(0x7fd91003c6a0 0x7fd91003ead0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.478+0000 7fd90b7fe700 1 -- 172.21.15.92:0/2696675528 <== osd.1 v2:172.21.15.92:6808/85705 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd91003f1e0 con 0x7fd91003c6a0 2023-09-29T23:23:55.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.479+0000 7f14ff4d8700 1 Processor -- start 2023-09-29T23:23:55.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.479+0000 7f14ff4d8700 1 -- start start 2023-09-29T23:23:55.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.479+0000 7f14ff4d8700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f14f8132530 0x7f14f8134910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.479+0000 7f14ff4d8700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f80a1580 con 0x7f14f8069b30 2023-09-29T23:23:55.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.479+0000 7f14ff4d8700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f809bdd0 con 0x7f14f8132530 2023-09-29T23:23:55.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.480+0000 7f14fca73700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f14f8132530 0x7f14f8134910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.480+0000 7f14fd274700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f14f8069b30 0x7f14f8069f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54652/0 (socket says 172.21.15.92:54652) 2023-09-29T23:23:55.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.480+0000 7f14fd274700 1 -- 172.21.15.92:0/2478467749 learned_addr learned my addr 172.21.15.92:0/2478467749 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:55.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.480+0000 7f14fca73700 1 -- 172.21.15.92:0/2478467749 >> v1:172.21.15.92:6789/0 conn(0x7f14f8069b30 legacy=0x7f14f8069f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.480+0000 7f19fd46c700 1 Processor -- start 2023-09-29T23:23:55.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.480+0000 7f14fca73700 1 -- 172.21.15.92:0/2478467749 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f8069930 con 0x7f14f8132530 2023-09-29T23:23:55.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.480+0000 7f14effff700 1 -- 172.21.15.92:0/2478467749 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731855264 0 0) 0x7f14f80a1580 con 0x7f14f8069b30 2023-09-29T23:23:55.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.480+0000 7f19fd46c700 1 -- start start 2023-09-29T23:23:55.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.480+0000 7f14fca73700 1 --2- 172.21.15.92:0/2478467749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14f8132530 0x7f14f8134910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009860 tx=0x7f14e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6563c3b35c251dd server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.480+0000 7f14effff700 1 -- 172.21.15.92:0/2478467749 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14e800b680 con 0x7f14f8132530 2023-09-29T23:23:55.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.480+0000 7f14effff700 1 -- 172.21.15.92:0/2478467749 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e800b7e0 con 0x7f14f8132530 2023-09-29T23:23:55.483 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.480+0000 7f14effff700 1 -- 172.21.15.92:0/2478467749 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14e800b990 con 0x7f14f8132530 2023-09-29T23:23:55.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f19fd46c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f19f8099070 0x7f19f8096cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f19fd46c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f8096770 con 0x7f19f80971f0 2023-09-29T23:23:55.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f19fd46c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f809ff20 con 0x7f19f8099070 2023-09-29T23:23:55.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f19f77fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f19f80971f0 0x7f19f812bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54654/0 (socket says 172.21.15.92:54654) 2023-09-29T23:23:55.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f19f7fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f19f8099070 0x7f19f8096cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f19f77fe700 1 -- 172.21.15.92:0/1214872275 learned_addr learned my addr 172.21.15.92:0/1214872275 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:55.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f19f7fff700 1 -- 172.21.15.92:0/1214872275 >> v1:172.21.15.92:6789/0 conn(0x7f19f80971f0 legacy=0x7f19f812bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f19f7fff700 1 -- 172.21.15.92:0/1214872275 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f8097a50 con 0x7f19f8099070 2023-09-29T23:23:55.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f14ff4d8700 1 -- 172.21.15.92:0/2478467749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14f8132530 msgr2=0x7f14f8134910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f14ff4d8700 1 --2- 172.21.15.92:0/2478467749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14f8132530 0x7f14f8134910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009860 tx=0x7f14e80091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f19f7fff700 1 --2- 172.21.15.92:0/1214872275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f8099070 0x7f19f8096cb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009860 tx=0x7f19e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb94bf82f702c62e server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f14ff4d8700 1 -- 172.21.15.92:0/2478467749 shutdown_connections 2023-09-29T23:23:55.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f14ff4d8700 1 --2- 172.21.15.92:0/2478467749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14f8132530 0x7f14f8134910 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f14ff4d8700 1 -- 172.21.15.92:0/2478467749 >> 172.21.15.92:0/2478467749 conn(0x7f14f8094a70 msgr2=0x7f14f806eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:55.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f14ff4d8700 1 -- 172.21.15.92:0/2478467749 shutdown_connections 2023-09-29T23:23:55.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f19f6ffd700 1 -- 172.21.15.92:0/1214872275 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19e800b710 con 0x7f19f8099070 2023-09-29T23:23:55.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f14ff4d8700 1 -- 172.21.15.92:0/2478467749 wait complete. 2023-09-29T23:23:55.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f19f6ffd700 1 -- 172.21.15.92:0/1214872275 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e800b870 con 0x7f19f8099070 2023-09-29T23:23:55.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.481+0000 7f19f6ffd700 1 -- 172.21.15.92:0/1214872275 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19e800ba20 con 0x7f19f8099070 2023-09-29T23:23:55.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.482+0000 7f19fd46c700 1 -- 172.21.15.92:0/1214872275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f8099070 msgr2=0x7f19f8096cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.482+0000 7f19fd46c700 1 --2- 172.21.15.92:0/1214872275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f8099070 0x7f19f8096cb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009860 tx=0x7f19e80091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.482+0000 7f19fd46c700 1 -- 172.21.15.92:0/1214872275 shutdown_connections 2023-09-29T23:23:55.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.482+0000 7f19fd46c700 1 --2- 172.21.15.92:0/1214872275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f8099070 0x7f19f8096cb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.482+0000 7f19fd46c700 1 -- 172.21.15.92:0/1214872275 >> 172.21.15.92:0/1214872275 conn(0x7f19f8094df0 msgr2=0x7f19f806d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:55.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.482+0000 7f14ff4d8700 1 Processor -- start 2023-09-29T23:23:55.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.482+0000 7f14ff4d8700 1 -- start start 2023-09-29T23:23:55.488 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.482+0000 7f19fd46c700 1 -- 172.21.15.92:0/1214872275 shutdown_connections 2023-09-29T23:23:55.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.482+0000 7f19fd46c700 1 -- 172.21.15.92:0/1214872275 wait complete. 2023-09-29T23:23:55.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.483+0000 7f14ff4d8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14f8069b30 0x7f14f8117a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.483+0000 7f14ff4d8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f811b390 con 0x7f14f8069b30 2023-09-29T23:23:55.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.483+0000 7f14fd274700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14f8069b30 0x7f14f8117a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.483+0000 7f14fd274700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14f8069b30 0x7f14f8117a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49110/0 (socket says 172.21.15.92:49110) 2023-09-29T23:23:55.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.483+0000 7f14fd274700 1 -- 172.21.15.92:0/1597527029 learned_addr learned my addr 172.21.15.92:0/1597527029 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:55.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.483+0000 7f14fd274700 1 -- 172.21.15.92:0/1597527029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e8009420 con 0x7f14f8069b30 2023-09-29T23:23:55.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.483+0000 7f14fd274700 1 --2- 172.21.15.92:0/1597527029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14f8069b30 0x7f14f8117a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f14f400c710 tx=0x7f14f4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.490 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.483+0000 7f19fd46c700 1 Processor -- start 2023-09-29T23:23:55.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.483+0000 7f14ed7fa700 1 -- 172.21.15.92:0/1597527029 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14f4005d90 con 0x7f14f8069b30 2023-09-29T23:23:55.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.483+0000 7f14ed7fa700 1 -- 172.21.15.92:0/1597527029 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f40070d0 con 0x7f14f8069b30 2023-09-29T23:23:55.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.483+0000 7f14ff4d8700 1 -- 172.21.15.92:0/1597527029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f811c0f0 con 0x7f14f8069b30 2023-09-29T23:23:55.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.483+0000 7f14ed7fa700 1 -- 172.21.15.92:0/1597527029 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14f40073a0 con 0x7f14f8069b30 2023-09-29T23:23:55.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.483+0000 7f14ff4d8700 1 -- 172.21.15.92:0/1597527029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f811c320 con 0x7f14f8069b30 2023-09-29T23:23:55.491 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.484+0000 7f19fd46c700 1 -- start start 2023-09-29T23:23:55.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.484+0000 7f14ff4d8700 1 -- 172.21.15.92:0/1597527029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f14f805f230 con 0x7f14f8069b30 2023-09-29T23:23:55.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.484+0000 7f19fd46c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f80971f0 0x7f19f811bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.484+0000 7f19fd46c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f8119b50 con 0x7f19f80971f0 2023-09-29T23:23:55.492 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.484+0000 7f14ed7fa700 1 -- 172.21.15.92:0/1597527029 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f14f4007500 con 0x7f14f8069b30 2023-09-29T23:23:55.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.484+0000 7f19f7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f80971f0 0x7f19f811bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.484+0000 7f19f7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f80971f0 0x7f19f811bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49118/0 (socket says 172.21.15.92:49118) 2023-09-29T23:23:55.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.484+0000 7f19f7fff700 1 -- 172.21.15.92:0/2718665698 learned_addr learned my addr 172.21.15.92:0/2718665698 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:55.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.484+0000 7f14ed7fa700 1 --2- 172.21.15.92:0/1597527029 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f14dc035640 0x7f14dc037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.493 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.484+0000 7f14ed7fa700 1 -- 172.21.15.92:0/1597527029 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f14f4046ae0 con 0x7f14f8069b30 2023-09-29T23:23:55.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.485+0000 7f19f7fff700 1 -- 172.21.15.92:0/2718665698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8009420 con 0x7f19f80971f0 2023-09-29T23:23:55.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.485+0000 7f14fca73700 1 --2- 172.21.15.92:0/1597527029 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f14dc035640 0x7f14dc037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.485+0000 7f14ed7fa700 1 --2- 172.21.15.92:0/1597527029 >> [v2:172.21.15.92:6800/85704,v1:172.21.15.92:6801/85704] conn(0x7f14dc03c6b0 0x7f14dc03eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.485+0000 7f14ed7fa700 1 -- 172.21.15.92:0/1597527029 --> [v2:172.21.15.92:6800/85704,v1:172.21.15.92:6801/85704] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14dc03f1f0 con 0x7f14dc03c6b0 2023-09-29T23:23:55.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.485+0000 7f14ed7fa700 1 -- 172.21.15.92:0/1597527029 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14f404b220 con 0x7f14f8069b30 2023-09-29T23:23:55.494 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.485+0000 7f14fda75700 1 --2- 172.21.15.92:0/1597527029 >> [v2:172.21.15.92:6800/85704,v1:172.21.15.92:6801/85704] conn(0x7f14dc03c6b0 0x7f14dc03eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.485+0000 7f19f7fff700 1 --2- 172.21.15.92:0/2718665698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f80971f0 0x7f19f811bb20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f19e8000c00 tx=0x7f19e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.485+0000 7f14fca73700 1 --2- 172.21.15.92:0/1597527029 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f14dc035640 0x7f14dc037af0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f14e80030c0 tx=0x7f14e8016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.485+0000 7f19dffff700 1 -- 172.21.15.92:0/2718665698 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19e8024470 con 0x7f19f80971f0 2023-09-29T23:23:55.495 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.485+0000 7f19dffff700 1 -- 172.21.15.92:0/2718665698 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e80245d0 con 0x7f19f80971f0 2023-09-29T23:23:55.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.485+0000 7f19fd46c700 1 -- 172.21.15.92:0/2718665698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f812d530 con 0x7f19f80971f0 2023-09-29T23:23:55.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.485+0000 7f14fda75700 1 --2- 172.21.15.92:0/1597527029 >> [v2:172.21.15.92:6800/85704,v1:172.21.15.92:6801/85704] conn(0x7f14dc03c6b0 0x7f14dc03eae0 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.485+0000 7f19dffff700 1 -- 172.21.15.92:0/2718665698 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19e8024760 con 0x7f19f80971f0 2023-09-29T23:23:55.496 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.485+0000 7f19fd46c700 1 -- 172.21.15.92:0/2718665698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f811c200 con 0x7f19f80971f0 2023-09-29T23:23:55.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.486+0000 7f19fd46c700 1 -- 172.21.15.92:0/2718665698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19f805f230 con 0x7f19f80971f0 2023-09-29T23:23:55.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.486+0000 7f19dffff700 1 -- 172.21.15.92:0/2718665698 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f19e8021070 con 0x7f19f80971f0 2023-09-29T23:23:55.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.486+0000 7f14ed7fa700 1 -- 172.21.15.92:0/1597527029 <== osd.2 v2:172.21.15.92:6800/85704 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f14dc03f1f0 con 0x7f14dc03c6b0 2023-09-29T23:23:55.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.486+0000 7f19dffff700 1 --2- 172.21.15.92:0/2718665698 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f19e4035640 0x7f19e4037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.486+0000 7f19dffff700 1 -- 172.21.15.92:0/2718665698 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f19e8049290 con 0x7f19f80971f0 2023-09-29T23:23:55.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.486+0000 7f19f77fe700 1 --2- 172.21.15.92:0/2718665698 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f19e4035640 0x7f19e4037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.486+0000 7f19dffff700 1 --2- 172.21.15.92:0/2718665698 >> [v2:172.21.15.92:6816/85726,v1:172.21.15.92:6817/85726] conn(0x7f19e403c6b0 0x7f19e403eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.486+0000 7f19dffff700 1 -- 172.21.15.92:0/2718665698 --> [v2:172.21.15.92:6816/85726,v1:172.21.15.92:6817/85726] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19e403f1f0 con 0x7f19e403c6b0 2023-09-29T23:23:55.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.486+0000 7f19dffff700 1 -- 172.21.15.92:0/2718665698 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19e804b850 con 0x7f19f80971f0 2023-09-29T23:23:55.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.487+0000 7f19fcc6b700 1 --2- 172.21.15.92:0/2718665698 >> [v2:172.21.15.92:6816/85726,v1:172.21.15.92:6817/85726] conn(0x7f19e403c6b0 0x7f19e403eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.487+0000 7f19f77fe700 1 --2- 172.21.15.92:0/2718665698 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f19e4035640 0x7f19e4037af0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0016a0 tx=0x7f19ec007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.487+0000 7f19fcc6b700 1 --2- 172.21.15.92:0/2718665698 >> [v2:172.21.15.92:6816/85726,v1:172.21.15.92:6817/85726] conn(0x7f19e403c6b0 0x7f19e403eae0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.488+0000 7f19dffff700 1 -- 172.21.15.92:0/2718665698 <== osd.0 v2:172.21.15.92:6816/85726 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f19e403f1f0 con 0x7f19e403c6b0 2023-09-29T23:23:55.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.502+0000 7f14ff4d8700 1 -- 172.21.15.92:0/1597527029 --> [v2:172.21.15.92:6800/85704,v1:172.21.15.92:6801/85704] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f14f8118f00 con 0x7f14dc03c6b0 2023-09-29T23:23:55.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.502+0000 7f14ed7fa700 1 -- 172.21.15.92:0/1597527029 <== osd.2 v2:172.21.15.92:6800/85704 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f14f8118f00 con 0x7f14dc03c6b0 2023-09-29T23:23:55.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.502+0000 7f14ff4d8700 1 -- 172.21.15.92:0/1597527029 >> [v2:172.21.15.92:6800/85704,v1:172.21.15.92:6801/85704] conn(0x7f14dc03c6b0 msgr2=0x7f14dc03eae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.502+0000 7f14ff4d8700 1 --2- 172.21.15.92:0/1597527029 >> [v2:172.21.15.92:6800/85704,v1:172.21.15.92:6801/85704] conn(0x7f14dc03c6b0 0x7f14dc03eae0 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.502+0000 7f14ff4d8700 1 -- 172.21.15.92:0/1597527029 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f14dc035640 msgr2=0x7f14dc037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.502+0000 7f14ff4d8700 1 --2- 172.21.15.92:0/1597527029 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f14dc035640 0x7f14dc037af0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f14e80030c0 tx=0x7f14e8016000 comp rx=0 tx=0).stop 2023-09-29T23:23:55.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.502+0000 7f14ff4d8700 1 -- 172.21.15.92:0/1597527029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14f8069b30 msgr2=0x7f14f8117a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.502+0000 7f14ff4d8700 1 --2- 172.21.15.92:0/1597527029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14f8069b30 0x7f14f8117a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f14f400c710 tx=0x7f14f4007d90 comp rx=0 tx=0).stop 2023-09-29T23:23:55.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.502+0000 7f14ff4d8700 1 -- 172.21.15.92:0/1597527029 shutdown_connections 2023-09-29T23:23:55.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.502+0000 7f14ff4d8700 1 --2- 172.21.15.92:0/1597527029 >> [v2:172.21.15.92:6800/85704,v1:172.21.15.92:6801/85704] conn(0x7f14dc03c6b0 0x7f14dc03eae0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.502+0000 7f14ff4d8700 1 --2- 172.21.15.92:0/1597527029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14f8069b30 0x7f14f8117a70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.502+0000 7f14ff4d8700 1 --2- 172.21.15.92:0/1597527029 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f14dc035640 0x7f14dc037af0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.502+0000 7f14ff4d8700 1 -- 172.21.15.92:0/1597527029 >> 172.21.15.92:0/1597527029 conn(0x7f14f8094a70 msgr2=0x7f14f8130290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:55.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.502+0000 7f14ff4d8700 1 -- 172.21.15.92:0/1597527029 shutdown_connections 2023-09-29T23:23:55.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.502+0000 7f14ff4d8700 1 -- 172.21.15.92:0/1597527029 wait complete. 2023-09-29T23:23:55.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.503+0000 7fd929ed6700 1 -- 172.21.15.92:0/2696675528 --> [v2:172.21.15.92:6808/85705,v1:172.21.15.92:6809/85705] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd92405f230 con 0x7fd91003c6a0 2023-09-29T23:23:55.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.503+0000 7fd90b7fe700 1 -- 172.21.15.92:0/2696675528 <== osd.1 v2:172.21.15.92:6808/85705 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd92405f230 con 0x7fd91003c6a0 2023-09-29T23:23:55.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.504+0000 7fd929ed6700 1 -- 172.21.15.92:0/2696675528 >> [v2:172.21.15.92:6808/85705,v1:172.21.15.92:6809/85705] conn(0x7fd91003c6a0 msgr2=0x7fd91003ead0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.504+0000 7fd929ed6700 1 --2- 172.21.15.92:0/2696675528 >> [v2:172.21.15.92:6808/85705,v1:172.21.15.92:6809/85705] conn(0x7fd91003c6a0 0x7fd91003ead0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.504+0000 7fd929ed6700 1 -- 172.21.15.92:0/2696675528 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd910035630 msgr2=0x7fd910037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.504+0000 7fd929ed6700 1 --2- 172.21.15.92:0/2696675528 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd910035630 0x7fd910037ae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd918009860 tx=0x7fd918016000 comp rx=0 tx=0).stop 2023-09-29T23:23:55.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.504+0000 7fd929ed6700 1 -- 172.21.15.92:0/2696675528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd92409fd80 msgr2=0x7fd92413e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.504+0000 7fd929ed6700 1 --2- 172.21.15.92:0/2696675528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd92409fd80 0x7fd92413e4f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd91400c460 tx=0x7fd914000fe0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.504+0000 7fd929ed6700 1 -- 172.21.15.92:0/2696675528 shutdown_connections 2023-09-29T23:23:55.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.504+0000 7fd929ed6700 1 --2- 172.21.15.92:0/2696675528 >> [v2:172.21.15.92:6808/85705,v1:172.21.15.92:6809/85705] conn(0x7fd91003c6a0 0x7fd91003ead0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.504+0000 7fd929ed6700 1 --2- 172.21.15.92:0/2696675528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd92409fd80 0x7fd92413e4f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.504+0000 7fd929ed6700 1 --2- 172.21.15.92:0/2696675528 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd910035630 0x7fd910037ae0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.504+0000 7fd929ed6700 1 -- 172.21.15.92:0/2696675528 >> 172.21.15.92:0/2696675528 conn(0x7fd924068000 msgr2=0x7fd924094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:55.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.504+0000 7fd929ed6700 1 -- 172.21.15.92:0/2696675528 shutdown_connections 2023-09-29T23:23:55.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.504+0000 7fd929ed6700 1 -- 172.21.15.92:0/2696675528 wait complete. 2023-09-29T23:23:55.515 INFO:teuthology.orchestra.run.smithi092.stdout:34359738373 2023-09-29T23:23:55.515 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-29T23:23:55.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.515+0000 7f19fd46c700 1 -- 172.21.15.92:0/2718665698 --> [v2:172.21.15.92:6816/85726,v1:172.21.15.92:6817/85726] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f19f804bb40 con 0x7f19e403c6b0 2023-09-29T23:23:55.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.515+0000 7f19dffff700 1 -- 172.21.15.92:0/2718665698 <== osd.0 v2:172.21.15.92:6816/85726 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f19f804bb40 con 0x7f19e403c6b0 2023-09-29T23:23:55.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.515+0000 7f19fd46c700 1 -- 172.21.15.92:0/2718665698 >> [v2:172.21.15.92:6816/85726,v1:172.21.15.92:6817/85726] conn(0x7f19e403c6b0 msgr2=0x7f19e403eae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.515+0000 7f19fd46c700 1 --2- 172.21.15.92:0/2718665698 >> [v2:172.21.15.92:6816/85726,v1:172.21.15.92:6817/85726] conn(0x7f19e403c6b0 0x7f19e403eae0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.516+0000 7f19fd46c700 1 -- 172.21.15.92:0/2718665698 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f19e4035640 msgr2=0x7f19e4037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.516+0000 7f19fd46c700 1 --2- 172.21.15.92:0/2718665698 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f19e4035640 0x7f19e4037af0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0016a0 tx=0x7f19ec007b30 comp rx=0 tx=0).stop 2023-09-29T23:23:55.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.516+0000 7f19fd46c700 1 -- 172.21.15.92:0/2718665698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f80971f0 msgr2=0x7f19f811bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.516+0000 7f19fd46c700 1 --2- 172.21.15.92:0/2718665698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f80971f0 0x7f19f811bb20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f19e8000c00 tx=0x7f19e8016000 comp rx=0 tx=0).stop 2023-09-29T23:23:55.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.516+0000 7f19fd46c700 1 -- 172.21.15.92:0/2718665698 shutdown_connections 2023-09-29T23:23:55.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.516+0000 7f19fd46c700 1 --2- 172.21.15.92:0/2718665698 >> [v2:172.21.15.92:6816/85726,v1:172.21.15.92:6817/85726] conn(0x7f19e403c6b0 0x7f19e403eae0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.516+0000 7f19fd46c700 1 --2- 172.21.15.92:0/2718665698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f80971f0 0x7f19f811bb20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.516+0000 7f19fd46c700 1 --2- 172.21.15.92:0/2718665698 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f19e4035640 0x7f19e4037af0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.516+0000 7f19fd46c700 1 -- 172.21.15.92:0/2718665698 >> 172.21.15.92:0/2718665698 conn(0x7f19f8094df0 msgr2=0x7f19f809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:55.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.516+0000 7f19fd46c700 1 -- 172.21.15.92:0/2718665698 shutdown_connections 2023-09-29T23:23:55.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.516+0000 7f19fd46c700 1 -- 172.21.15.92:0/2718665698 wait complete. 2023-09-29T23:23:55.520 INFO:teuthology.orchestra.run.smithi092.stdout:38654705670 2023-09-29T23:23:55.520 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-29T23:23:55.530 INFO:teuthology.orchestra.run.smithi092.stdout:38654705669 2023-09-29T23:23:55.530 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-29T23:23:55.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.636+0000 7f7a726c8700 1 Processor -- start 2023-09-29T23:23:55.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.636+0000 7f7a726c8700 1 -- start start 2023-09-29T23:23:55.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.636+0000 7f7a726c8700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7a6c09c600 0x7f7a6c0a3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.637+0000 7f7a726c8700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a6c098320 con 0x7f7a6c12bc80 2023-09-29T23:23:55.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.637+0000 7f7a726c8700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a6c09c9d0 con 0x7f7a6c09c600 2023-09-29T23:23:55.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.637+0000 7f7a716c6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7a6c09c600 0x7f7a6c0a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.637+0000 7f7a716c6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7a6c09c600 0x7f7a6c0a3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49134/0 (socket says 172.21.15.92:49134) 2023-09-29T23:23:55.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.637+0000 7f7a716c6700 1 -- 172.21.15.92:0/148075001 learned_addr learned my addr 172.21.15.92:0/148075001 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:55.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.637+0000 7f7a70ec5700 1 --1- 172.21.15.92:0/148075001 >> v1:172.21.15.92:6789/0 conn(0x7f7a6c12bc80 0x7f7a6c12f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54660/0 (socket says 172.21.15.92:54660) 2023-09-29T23:23:55.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.637+0000 7f7a716c6700 1 -- 172.21.15.92:0/148075001 >> v1:172.21.15.92:6789/0 conn(0x7f7a6c12bc80 legacy=0x7f7a6c12f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.638 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.637+0000 7f7a716c6700 1 -- 172.21.15.92:0/148075001 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6c12c120 con 0x7f7a6c09c600 2023-09-29T23:23:55.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.637+0000 7f7a716c6700 1 --2- 172.21.15.92:0/148075001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a6c09c600 0x7f7a6c0a3030 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009930 tx=0x7f7a68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2094eb819fb9c96 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.637+0000 7f7a63fff700 1 -- 172.21.15.92:0/148075001 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a6800b860 con 0x7f7a6c09c600 2023-09-29T23:23:55.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.637+0000 7f7a63fff700 1 -- 172.21.15.92:0/148075001 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6800b9c0 con 0x7f7a6c09c600 2023-09-29T23:23:55.639 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.637+0000 7f7a63fff700 1 -- 172.21.15.92:0/148075001 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a6800bc90 con 0x7f7a6c09c600 2023-09-29T23:23:55.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.638+0000 7f7a726c8700 1 -- 172.21.15.92:0/148075001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a6c09c600 msgr2=0x7f7a6c0a3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.638+0000 7f7a726c8700 1 --2- 172.21.15.92:0/148075001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a6c09c600 0x7f7a6c0a3030 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009930 tx=0x7f7a68009250 comp rx=0 tx=0).stop 2023-09-29T23:23:55.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.638+0000 7f7a726c8700 1 -- 172.21.15.92:0/148075001 shutdown_connections 2023-09-29T23:23:55.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.638+0000 7f7a726c8700 1 --2- 172.21.15.92:0/148075001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a6c09c600 0x7f7a6c0a3030 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.638+0000 7f7a726c8700 1 -- 172.21.15.92:0/148075001 >> 172.21.15.92:0/148075001 conn(0x7f7a6c0680b0 msgr2=0x7f7a6c096a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:55.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.638+0000 7f7a726c8700 1 -- 172.21.15.92:0/148075001 shutdown_connections 2023-09-29T23:23:55.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.638+0000 7f7a726c8700 1 -- 172.21.15.92:0/148075001 wait complete. 2023-09-29T23:23:55.640 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.639+0000 7f7a726c8700 1 Processor -- start 2023-09-29T23:23:55.641 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.640+0000 7f7a726c8700 1 -- start start 2023-09-29T23:23:55.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.640+0000 7f7a726c8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a6c09c600 0x7f7a6c11d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.640+0000 7f7a726c8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6c12b5d0 con 0x7f7a6c09c600 2023-09-29T23:23:55.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.640+0000 7f7a716c6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a6c09c600 0x7f7a6c11d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.641+0000 7f7a716c6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a6c09c600 0x7f7a6c11d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49150/0 (socket says 172.21.15.92:49150) 2023-09-29T23:23:55.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.641+0000 7f7a716c6700 1 -- 172.21.15.92:0/2183487679 learned_addr learned my addr 172.21.15.92:0/2183487679 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:55.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.641+0000 7f7a716c6700 1 -- 172.21.15.92:0/2183487679 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a680094f0 con 0x7f7a6c09c600 2023-09-29T23:23:55.642 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.641+0000 7f7a716c6700 1 --2- 172.21.15.92:0/2183487679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a6c09c600 0x7f7a6c11d1e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7a680094c0 tx=0x7f7a68016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.641+0000 7f7a617fa700 1 -- 172.21.15.92:0/2183487679 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a6800bb30 con 0x7f7a6c09c600 2023-09-29T23:23:55.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.641+0000 7f7a617fa700 1 -- 172.21.15.92:0/2183487679 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6801f070 con 0x7f7a6c09c600 2023-09-29T23:23:55.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.641+0000 7f7a726c8700 1 -- 172.21.15.92:0/2183487679 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a6c11bf10 con 0x7f7a6c09c600 2023-09-29T23:23:55.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.641+0000 7f7a617fa700 1 -- 172.21.15.92:0/2183487679 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a6800bc90 con 0x7f7a6c09c600 2023-09-29T23:23:55.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.641+0000 7f7a726c8700 1 -- 172.21.15.92:0/2183487679 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a6c11cc40 con 0x7f7a6c09c600 2023-09-29T23:23:55.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.642+0000 7f7a726c8700 1 -- 172.21.15.92:0/2183487679 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a6c09aa80 con 0x7f7a6c09c600 2023-09-29T23:23:55.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.643+0000 7f7a617fa700 1 -- 172.21.15.92:0/2183487679 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f7a68021030 con 0x7f7a6c09c600 2023-09-29T23:23:55.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.643+0000 7f7a617fa700 1 --2- 172.21.15.92:0/2183487679 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7a50035640 0x7f7a50037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.643+0000 7f7a617fa700 1 -- 172.21.15.92:0/2183487679 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f7a68049290 con 0x7f7a6c09c600 2023-09-29T23:23:55.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.643+0000 7f7a70ec5700 1 --2- 172.21.15.92:0/2183487679 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7a50035640 0x7f7a50037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.644 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.644+0000 7f7a70ec5700 1 --2- 172.21.15.92:0/2183487679 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7a50035640 0x7f7a50037af0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0016a0 tx=0x7f7a5c007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.647+0000 7f7a617fa700 1 -- 172.21.15.92:0/2183487679 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a68010790 con 0x7f7a6c09c600 2023-09-29T23:23:55.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.689+0000 7fdffb87d700 1 Processor -- start 2023-09-29T23:23:55.690 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.690+0000 7fdffb87d700 1 -- start start 2023-09-29T23:23:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.690+0000 7fdffb87d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fdff4067eb0 0x7fdff412f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.690+0000 7fdffb87d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff409cee0 con 0x7fdff412fc50 2023-09-29T23:23:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.690+0000 7fdffb87d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff4068280 con 0x7fdff4067eb0 2023-09-29T23:23:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.690+0000 7fdff9619700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fdff4067eb0 0x7fdff412f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.690+0000 7fdff8e18700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fdff412fc50 0x7fdff4096310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54674/0 (socket says 172.21.15.92:54674) 2023-09-29T23:23:55.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.690+0000 7fdff8e18700 1 -- 172.21.15.92:0/3224919181 learned_addr learned my addr 172.21.15.92:0/3224919181 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:55.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.690+0000 7fdff9619700 1 -- 172.21.15.92:0/3224919181 >> v1:172.21.15.92:6789/0 conn(0x7fdff412fc50 legacy=0x7fdff4096310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.691+0000 7fdff9619700 1 -- 172.21.15.92:0/3224919181 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff40685e0 con 0x7fdff4067eb0 2023-09-29T23:23:55.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.691+0000 7fdff9619700 1 --2- 172.21.15.92:0/3224919181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdff4067eb0 0x7fdff412f710 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009850 tx=0x7fdfe4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3545199dc23d798 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.691+0000 7fdfebfff700 1 -- 172.21.15.92:0/3224919181 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe4005d50 con 0x7fdff4067eb0 2023-09-29T23:23:55.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.691+0000 7fdfebfff700 1 -- 172.21.15.92:0/3224919181 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe4006030 con 0x7fdff4067eb0 2023-09-29T23:23:55.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.691+0000 7fdfebfff700 1 -- 172.21.15.92:0/3224919181 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe4006300 con 0x7fdff4067eb0 2023-09-29T23:23:55.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.691+0000 7fdffb87d700 1 -- 172.21.15.92:0/3224919181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdff4067eb0 msgr2=0x7fdff412f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.691+0000 7fdffb87d700 1 --2- 172.21.15.92:0/3224919181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdff4067eb0 0x7fdff412f710 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009850 tx=0x7fdfe4009120 comp rx=0 tx=0).stop 2023-09-29T23:23:55.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.691+0000 7fdffb87d700 1 -- 172.21.15.92:0/3224919181 shutdown_connections 2023-09-29T23:23:55.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.691+0000 7fdffb87d700 1 --2- 172.21.15.92:0/3224919181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdff4067eb0 0x7fdff412f710 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.693 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.691+0000 7fdffb87d700 1 -- 172.21.15.92:0/3224919181 >> 172.21.15.92:0/3224919181 conn(0x7fdff406bbd0 msgr2=0x7fdff406dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:55.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.691+0000 7fdffb87d700 1 -- 172.21.15.92:0/3224919181 shutdown_connections 2023-09-29T23:23:55.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.691+0000 7fdffb87d700 1 -- 172.21.15.92:0/3224919181 wait complete. 2023-09-29T23:23:55.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.692+0000 7fdffb87d700 1 Processor -- start 2023-09-29T23:23:55.694 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.692+0000 7fdffb87d700 1 -- start start 2023-09-29T23:23:55.695 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.693+0000 7fdffb87d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdff4067eb0 0x7fdff4117930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.693+0000 7fdffb87d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff411b610 con 0x7fdff4067eb0 2023-09-29T23:23:55.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.693+0000 7fdff9619700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdff4067eb0 0x7fdff4117930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.693+0000 7fdff9619700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdff4067eb0 0x7fdff4117930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49166/0 (socket says 172.21.15.92:49166) 2023-09-29T23:23:55.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.693+0000 7fdff9619700 1 -- 172.21.15.92:0/3222920125 learned_addr learned my addr 172.21.15.92:0/3222920125 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:55.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.693+0000 7fdff9619700 1 -- 172.21.15.92:0/3222920125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe40093c0 con 0x7fdff4067eb0 2023-09-29T23:23:55.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.693+0000 7fdff9619700 1 --2- 172.21.15.92:0/3222920125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdff4067eb0 0x7fdff4117930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009fd0 tx=0x7fdfe4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.693+0000 7fdfe97fa700 1 -- 172.21.15.92:0/3222920125 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe400bb00 con 0x7fdff4067eb0 2023-09-29T23:23:55.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.693+0000 7fdfe97fa700 1 -- 172.21.15.92:0/3222920125 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe400bc80 con 0x7fdff4067eb0 2023-09-29T23:23:55.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.693+0000 7fdffb87d700 1 -- 172.21.15.92:0/3222920125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff411a770 con 0x7fdff4067eb0 2023-09-29T23:23:55.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.693+0000 7fdfe97fa700 1 -- 172.21.15.92:0/3222920125 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfe400be30 con 0x7fdff4067eb0 2023-09-29T23:23:55.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.693+0000 7fdffb87d700 1 -- 172.21.15.92:0/3222920125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff4119ae0 con 0x7fdff4067eb0 2023-09-29T23:23:55.696 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.694+0000 7fdfe97fa700 1 -- 172.21.15.92:0/3222920125 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fdfe401d430 con 0x7fdff4067eb0 2023-09-29T23:23:55.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.694+0000 7fdfe97fa700 1 --2- 172.21.15.92:0/3222920125 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fdfd8035640 0x7fdfd8037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.694+0000 7fdfe97fa700 1 -- 172.21.15.92:0/3222920125 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7fdfe4049470 con 0x7fdff4067eb0 2023-09-29T23:23:55.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.695+0000 7fdff8e18700 1 --2- 172.21.15.92:0/3222920125 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fdfd8035640 0x7fdfd8037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.695+0000 7fdffb87d700 1 -- 172.21.15.92:0/3222920125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff411b750 con 0x7fdff4067eb0 2023-09-29T23:23:55.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.695+0000 7fdff8e18700 1 --2- 172.21.15.92:0/3222920125 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fdfd8035640 0x7fdfd8037af0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdff00016a0 tx=0x7fdff0007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.699+0000 7fdfe97fa700 1 -- 172.21.15.92:0/3222920125 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfe4021070 con 0x7fdff4067eb0 2023-09-29T23:23:55.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.709+0000 7f752f0a2700 1 Processor -- start 2023-09-29T23:23:55.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.709+0000 7f752f0a2700 1 -- start start 2023-09-29T23:23:55.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.709+0000 7f752f0a2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f752809fd80 0x7f75280a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.709+0000 7f752f0a2700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7528098710 con 0x7f752812f8b0 2023-09-29T23:23:55.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.709+0000 7f752f0a2700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752812f340 con 0x7f752809fd80 2023-09-29T23:23:55.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.709+0000 7f752ce3e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f752809fd80 0x7f75280a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.709+0000 7f7527fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f752812f8b0 0x7f7528095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54682/0 (socket says 172.21.15.92:54682) 2023-09-29T23:23:55.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.709+0000 7f7527fff700 1 -- 172.21.15.92:0/2947779613 learned_addr learned my addr 172.21.15.92:0/2947779613 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:55.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.710+0000 7f752ce3e700 1 -- 172.21.15.92:0/2947779613 >> v1:172.21.15.92:6789/0 conn(0x7f752812f8b0 legacy=0x7f7528095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.710+0000 7f752ce3e700 1 -- 172.21.15.92:0/2947779613 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75280997e0 con 0x7f752809fd80 2023-09-29T23:23:55.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.710+0000 7f752ce3e700 1 --2- 172.21.15.92:0/2947779613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f752809fd80 0x7f75280a3090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f751c009860 tx=0x7f751c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806c89e229f0d09a server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.710+0000 7f75277fe700 1 -- 172.21.15.92:0/2947779613 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f751c00b680 con 0x7f752809fd80 2023-09-29T23:23:55.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.710+0000 7f75277fe700 1 -- 172.21.15.92:0/2947779613 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c00b7e0 con 0x7f752809fd80 2023-09-29T23:23:55.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.710+0000 7f75277fe700 1 -- 172.21.15.92:0/2947779613 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f751c00b990 con 0x7f752809fd80 2023-09-29T23:23:55.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.710+0000 7f752f0a2700 1 -- 172.21.15.92:0/2947779613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f752809fd80 msgr2=0x7f75280a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.710+0000 7f752f0a2700 1 --2- 172.21.15.92:0/2947779613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f752809fd80 0x7f75280a3090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f751c009860 tx=0x7f751c0091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.710+0000 7f752f0a2700 1 -- 172.21.15.92:0/2947779613 shutdown_connections 2023-09-29T23:23:55.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.710+0000 7f752f0a2700 1 --2- 172.21.15.92:0/2947779613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f752809fd80 0x7f75280a3090 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.710+0000 7f752f0a2700 1 -- 172.21.15.92:0/2947779613 >> 172.21.15.92:0/2947779613 conn(0x7f7528068000 msgr2=0x7f75280a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:55.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.711+0000 7f752f0a2700 1 -- 172.21.15.92:0/2947779613 shutdown_connections 2023-09-29T23:23:55.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.711+0000 7f752f0a2700 1 -- 172.21.15.92:0/2947779613 wait complete. 2023-09-29T23:23:55.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.711+0000 7f752f0a2700 1 Processor -- start 2023-09-29T23:23:55.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.712+0000 7f752f0a2700 1 -- start start 2023-09-29T23:23:55.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.712+0000 7f752f0a2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f752809fd80 0x7f7528119fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.712+0000 7f752f0a2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752811e610 con 0x7f752809fd80 2023-09-29T23:23:55.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.712+0000 7f752ce3e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f752809fd80 0x7f7528119fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.712+0000 7f752ce3e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f752809fd80 0x7f7528119fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49178/0 (socket says 172.21.15.92:49178) 2023-09-29T23:23:55.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.712+0000 7f752ce3e700 1 -- 172.21.15.92:0/1830491087 learned_addr learned my addr 172.21.15.92:0/1830491087 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:55.715 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.712+0000 7f752ce3e700 1 -- 172.21.15.92:0/1830491087 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c009420 con 0x7f752809fd80 2023-09-29T23:23:55.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.712+0000 7f752ce3e700 1 --2- 172.21.15.92:0/1830491087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f752809fd80 0x7f7528119fa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f751c000c00 tx=0x7f751c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.713+0000 7f7524ff9700 1 -- 172.21.15.92:0/1830491087 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f751c025470 con 0x7f752809fd80 2023-09-29T23:23:55.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.713+0000 7f7524ff9700 1 -- 172.21.15.92:0/1830491087 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c0255d0 con 0x7f752809fd80 2023-09-29T23:23:55.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.713+0000 7f7524ff9700 1 -- 172.21.15.92:0/1830491087 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f751c025880 con 0x7f752809fd80 2023-09-29T23:23:55.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.713+0000 7f752f0a2700 1 -- 172.21.15.92:0/1830491087 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752811ba50 con 0x7f752809fd80 2023-09-29T23:23:55.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.713+0000 7f752f0a2700 1 -- 172.21.15.92:0/1830491087 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752811d460 con 0x7f752809fd80 2023-09-29T23:23:55.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.713+0000 7f7524ff9700 1 -- 172.21.15.92:0/1830491087 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f751c022070 con 0x7f752809fd80 2023-09-29T23:23:55.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.714+0000 7f7524ff9700 1 --2- 172.21.15.92:0/1830491087 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f750c035640 0x7f750c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:55.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.714+0000 7f7524ff9700 1 -- 172.21.15.92:0/1830491087 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f751c049570 con 0x7f752809fd80 2023-09-29T23:23:55.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.714+0000 7f7527fff700 1 --2- 172.21.15.92:0/1830491087 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f750c035640 0x7f750c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:55.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.714+0000 7f752f0a2700 1 -- 172.21.15.92:0/1830491087 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752805f230 con 0x7f752809fd80 2023-09-29T23:23:55.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.714+0000 7f7527fff700 1 --2- 172.21.15.92:0/1830491087 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f750c035640 0x7f750c037af0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f75140016a0 tx=0x7f7514007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:55.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.719+0000 7f7524ff9700 1 -- 172.21.15.92:0/1830491087 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f751c010970 con 0x7f752809fd80 2023-09-29T23:23:55.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.884+0000 7f7a726c8700 1 -- 172.21.15.92:0/2183487679 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7a6c09ad90 con 0x7f7a6c09c600 2023-09-29T23:23:55.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.885+0000 7f7a617fa700 1 -- 172.21.15.92:0/2183487679 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7a680233d0 con 0x7f7a6c09c600 2023-09-29T23:23:55.885 INFO:teuthology.orchestra.run.smithi092.stdout:34359738372 2023-09-29T23:23:55.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.888+0000 7f7a726c8700 1 -- 172.21.15.92:0/2183487679 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7a50035640 msgr2=0x7f7a50037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.888+0000 7f7a726c8700 1 --2- 172.21.15.92:0/2183487679 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7a50035640 0x7f7a50037af0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0016a0 tx=0x7f7a5c007b30 comp rx=0 tx=0).stop 2023-09-29T23:23:55.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.888+0000 7f7a726c8700 1 -- 172.21.15.92:0/2183487679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a6c09c600 msgr2=0x7f7a6c11d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.888+0000 7f7a726c8700 1 --2- 172.21.15.92:0/2183487679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a6c09c600 0x7f7a6c11d1e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7a680094c0 tx=0x7f7a68016000 comp rx=0 tx=0).stop 2023-09-29T23:23:55.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.888+0000 7f7a726c8700 1 -- 172.21.15.92:0/2183487679 shutdown_connections 2023-09-29T23:23:55.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.888+0000 7f7a726c8700 1 --2- 172.21.15.92:0/2183487679 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7a50035640 0x7f7a50037af0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.888+0000 7f7a726c8700 1 --2- 172.21.15.92:0/2183487679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a6c09c600 0x7f7a6c11d1e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.888+0000 7f7a726c8700 1 -- 172.21.15.92:0/2183487679 >> 172.21.15.92:0/2183487679 conn(0x7f7a6c0680b0 msgr2=0x7f7a6c09cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:55.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.888+0000 7f7a726c8700 1 -- 172.21.15.92:0/2183487679 shutdown_connections 2023-09-29T23:23:55.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.888+0000 7f7a726c8700 1 -- 172.21.15.92:0/2183487679 wait complete. 2023-09-29T23:23:55.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.899+0000 7fdffb87d700 1 -- 172.21.15.92:0/3222920125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdff405f230 con 0x7fdff4067eb0 2023-09-29T23:23:55.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.899+0000 7fdfe97fa700 1 -- 172.21.15.92:0/3222920125 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdfe4010790 con 0x7fdff4067eb0 2023-09-29T23:23:55.899 INFO:teuthology.orchestra.run.smithi092.stdout:38654705668 2023-09-29T23:23:55.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.902+0000 7fdffb87d700 1 -- 172.21.15.92:0/3222920125 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fdfd8035640 msgr2=0x7fdfd8037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.902+0000 7fdffb87d700 1 --2- 172.21.15.92:0/3222920125 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fdfd8035640 0x7fdfd8037af0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdff00016a0 tx=0x7fdff0007b30 comp rx=0 tx=0).stop 2023-09-29T23:23:55.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.902+0000 7fdffb87d700 1 -- 172.21.15.92:0/3222920125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdff4067eb0 msgr2=0x7fdff4117930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.902+0000 7fdffb87d700 1 --2- 172.21.15.92:0/3222920125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdff4067eb0 0x7fdff4117930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009fd0 tx=0x7fdfe4015000 comp rx=0 tx=0).stop 2023-09-29T23:23:55.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.902+0000 7fdffb87d700 1 -- 172.21.15.92:0/3222920125 shutdown_connections 2023-09-29T23:23:55.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.902+0000 7fdffb87d700 1 --2- 172.21.15.92:0/3222920125 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fdfd8035640 0x7fdfd8037af0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.902+0000 7fdffb87d700 1 --2- 172.21.15.92:0/3222920125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdff4067eb0 0x7fdff4117930 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.902+0000 7fdffb87d700 1 -- 172.21.15.92:0/3222920125 >> 172.21.15.92:0/3222920125 conn(0x7fdff406bbd0 msgr2=0x7fdff412e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:55.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.902+0000 7fdffb87d700 1 -- 172.21.15.92:0/3222920125 shutdown_connections 2023-09-29T23:23:55.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.902+0000 7fdffb87d700 1 -- 172.21.15.92:0/3222920125 wait complete. 2023-09-29T23:23:55.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.2 2023-09-29T23:23:55.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2023-09-29T23:23:55.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.931+0000 7f752f0a2700 1 -- 172.21.15.92:0/1830491087 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f752804bb40 con 0x7f752809fd80 2023-09-29T23:23:55.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.931+0000 7f7524ff9700 1 -- 172.21.15.92:0/1830491087 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f751c0193b0 con 0x7f752809fd80 2023-09-29T23:23:55.932 INFO:teuthology.orchestra.run.smithi092.stdout:38654705669 2023-09-29T23:23:55.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.933+0000 7f752f0a2700 1 -- 172.21.15.92:0/1830491087 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f750c035640 msgr2=0x7f750c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.933+0000 7f752f0a2700 1 --2- 172.21.15.92:0/1830491087 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f750c035640 0x7f750c037af0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f75140016a0 tx=0x7f7514007b30 comp rx=0 tx=0).stop 2023-09-29T23:23:55.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.933+0000 7f752f0a2700 1 -- 172.21.15.92:0/1830491087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f752809fd80 msgr2=0x7f7528119fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:55.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.933+0000 7f752f0a2700 1 --2- 172.21.15.92:0/1830491087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f752809fd80 0x7f7528119fa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f751c000c00 tx=0x7f751c016000 comp rx=0 tx=0).stop 2023-09-29T23:23:55.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.933+0000 7f752f0a2700 1 -- 172.21.15.92:0/1830491087 shutdown_connections 2023-09-29T23:23:55.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.933+0000 7f752f0a2700 1 --2- 172.21.15.92:0/1830491087 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f750c035640 0x7f750c037af0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.933+0000 7f752f0a2700 1 --2- 172.21.15.92:0/1830491087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f752809fd80 0x7f7528119fa0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:55.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.934+0000 7f752f0a2700 1 -- 172.21.15.92:0/1830491087 >> 172.21.15.92:0/1830491087 conn(0x7f7528068000 msgr2=0x7f7528094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:55.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.934+0000 7f752f0a2700 1 -- 172.21.15.92:0/1830491087 shutdown_connections 2023-09-29T23:23:55.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:55.934+0000 7f752f0a2700 1 -- 172.21.15.92:0/1830491087 wait complete. 2023-09-29T23:23:55.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.1 2023-09-29T23:23:56.905 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-29T23:23:56.915 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-29T23:23:56.946 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-29T23:23:57.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.026+0000 7f2822fd9700 1 Processor -- start 2023-09-29T23:23:57.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.026+0000 7f2822fd9700 1 -- start start 2023-09-29T23:23:57.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.026+0000 7f2822fd9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f281c12ffc0 0x7f281c0a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:57.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.026+0000 7f2822fd9700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f281c098710 con 0x7f281c09fd80 2023-09-29T23:23:57.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.027+0000 7f2822fd9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281c12f340 con 0x7f281c12ffc0 2023-09-29T23:23:57.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.027+0000 7f281bfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f281c12ffc0 0x7f281c0a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:57.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.027+0000 7f281bfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f281c12ffc0 0x7f281c0a3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49188/0 (socket says 172.21.15.92:49188) 2023-09-29T23:23:57.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.027+0000 7f281bfff700 1 -- 172.21.15.92:0/3160768359 learned_addr learned my addr 172.21.15.92:0/3160768359 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:57.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.027+0000 7f281bfff700 1 -- 172.21.15.92:0/3160768359 >> v1:172.21.15.92:6789/0 conn(0x7f281c09fd80 legacy=0x7f281c12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:57.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.027+0000 7f281bfff700 1 -- 172.21.15.92:0/3160768359 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c0997e0 con 0x7f281c12ffc0 2023-09-29T23:23:57.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.027+0000 7f281bfff700 1 --2- 172.21.15.92:0/3160768359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281c12ffc0 0x7f281c0a3090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2808009930 tx=0x7f2808009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3adffd47a42b86 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:57.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.027+0000 7f281b7fe700 1 -- 172.21.15.92:0/3160768359 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f280800b860 con 0x7f281c12ffc0 2023-09-29T23:23:57.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.027+0000 7f281b7fe700 1 -- 172.21.15.92:0/3160768359 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280800b9c0 con 0x7f281c12ffc0 2023-09-29T23:23:57.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.027+0000 7f281b7fe700 1 -- 172.21.15.92:0/3160768359 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f280800bb50 con 0x7f281c12ffc0 2023-09-29T23:23:57.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.028+0000 7f2822fd9700 1 -- 172.21.15.92:0/3160768359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281c12ffc0 msgr2=0x7f281c0a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:57.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.028+0000 7f2822fd9700 1 --2- 172.21.15.92:0/3160768359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281c12ffc0 0x7f281c0a3090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2808009930 tx=0x7f2808009250 comp rx=0 tx=0).stop 2023-09-29T23:23:57.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.028+0000 7f2822fd9700 1 -- 172.21.15.92:0/3160768359 shutdown_connections 2023-09-29T23:23:57.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.028+0000 7f2822fd9700 1 --2- 172.21.15.92:0/3160768359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281c12ffc0 0x7f281c0a3090 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:57.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.028+0000 7f2822fd9700 1 -- 172.21.15.92:0/3160768359 >> 172.21.15.92:0/3160768359 conn(0x7f281c068000 msgr2=0x7f281c0a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:57.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.028+0000 7f2822fd9700 1 -- 172.21.15.92:0/3160768359 shutdown_connections 2023-09-29T23:23:57.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.028+0000 7f2822fd9700 1 -- 172.21.15.92:0/3160768359 wait complete. 2023-09-29T23:23:57.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.029+0000 7f2822fd9700 1 Processor -- start 2023-09-29T23:23:57.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.029+0000 7f2822fd9700 1 -- start start 2023-09-29T23:23:57.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.029+0000 7f2822fd9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281c09fd80 0x7f281c11def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:57.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.029+0000 7f2822fd9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c11cb30 con 0x7f281c09fd80 2023-09-29T23:23:57.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.029+0000 7f2820d75700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281c09fd80 0x7f281c11def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:57.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.029+0000 7f2820d75700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281c09fd80 0x7f281c11def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49200/0 (socket says 172.21.15.92:49200) 2023-09-29T23:23:57.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.029+0000 7f2820d75700 1 -- 172.21.15.92:0/3667015046 learned_addr learned my addr 172.21.15.92:0/3667015046 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:57.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.030+0000 7f2820d75700 1 -- 172.21.15.92:0/3667015046 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28080094f0 con 0x7f281c09fd80 2023-09-29T23:23:57.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.030+0000 7f2820d75700 1 --2- 172.21.15.92:0/3667015046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281c09fd80 0x7f281c11def0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f281000c3e0 tx=0x7f281000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:57.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.030+0000 7f2818ff9700 1 -- 172.21.15.92:0/3667015046 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2810011590 con 0x7f281c09fd80 2023-09-29T23:23:57.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.030+0000 7f2822fd9700 1 -- 172.21.15.92:0/3667015046 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c11da60 con 0x7f281c09fd80 2023-09-29T23:23:57.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.030+0000 7f2818ff9700 1 -- 172.21.15.92:0/3667015046 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2810011710 con 0x7f281c09fd80 2023-09-29T23:23:57.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.030+0000 7f2818ff9700 1 -- 172.21.15.92:0/3667015046 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2810011a00 con 0x7f281c09fd80 2023-09-29T23:23:57.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.030+0000 7f2822fd9700 1 -- 172.21.15.92:0/3667015046 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281c11a750 con 0x7f281c09fd80 2023-09-29T23:23:57.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.031+0000 7f2818ff9700 1 -- 172.21.15.92:0/3667015046 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f2810011b60 con 0x7f281c09fd80 2023-09-29T23:23:57.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.031+0000 7f2818ff9700 1 --2- 172.21.15.92:0/3667015046 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f28000355f0 0x7f2800037aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:57.033 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.031+0000 7f2818ff9700 1 -- 172.21.15.92:0/3667015046 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f28100469e0 con 0x7f281c09fd80 2023-09-29T23:23:57.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.031+0000 7f281bfff700 1 --2- 172.21.15.92:0/3667015046 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f28000355f0 0x7f2800037aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:57.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.031+0000 7f2822fd9700 1 -- 172.21.15.92:0/3667015046 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281c0a30e0 con 0x7f281c09fd80 2023-09-29T23:23:57.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.032+0000 7f281bfff700 1 --2- 172.21.15.92:0/3667015046 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f28000355f0 0x7f2800037aa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f281c0a0170 tx=0x7f2808016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:57.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.036+0000 7f2818ff9700 1 -- 172.21.15.92:0/3667015046 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2810017020 con 0x7f281c09fd80 2023-09-29T23:23:57.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.068+0000 7f3d54185700 1 Processor -- start 2023-09-29T23:23:57.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.068+0000 7f31afee2700 1 Processor -- start 2023-09-29T23:23:57.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.068+0000 7f3d54185700 1 -- start start 2023-09-29T23:23:57.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.069+0000 7f31afee2700 1 -- start start 2023-09-29T23:23:57.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.069+0000 7f3d54185700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3d4c09fd80 0x7f3d4c0a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:57.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.069+0000 7f3d54185700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4c098710 con 0x7f3d4c12f8b0 2023-09-29T23:23:57.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.069+0000 7f3d54185700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4c12f340 con 0x7f3d4c09fd80 2023-09-29T23:23:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.069+0000 7f31afee2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f31a812f3a0 0x7f31a8131780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.069+0000 7f31afee2700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a8097fa0 con 0x7f31a8096d20 2023-09-29T23:23:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.069+0000 7f31afee2700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a8096930 con 0x7f31a812f3a0 2023-09-29T23:23:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.069+0000 7f31ad47d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f31a812f3a0 0x7f31a8131780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.069+0000 7f31ad47d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f31a812f3a0 0x7f31a8131780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49224/0 (socket says 172.21.15.92:49224) 2023-09-29T23:23:57.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.069+0000 7f3d51f21700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3d4c09fd80 0x7f3d4c0a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:57.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.069+0000 7f31ad47d700 1 -- 172.21.15.92:0/2548611188 learned_addr learned my addr 172.21.15.92:0/2548611188 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:57.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.069+0000 7f3d51720700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f3d4c12f8b0 0x7f3d4c095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54688/0 (socket says 172.21.15.92:54688) 2023-09-29T23:23:57.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.069+0000 7f3d51720700 1 -- 172.21.15.92:0/3222660312 learned_addr learned my addr 172.21.15.92:0/3222660312 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:57.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.069+0000 7f31ad47d700 1 -- 172.21.15.92:0/2548611188 >> v1:172.21.15.92:6789/0 conn(0x7f31a8096d20 legacy=0x7f31a80970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:57.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.069+0000 7f31ad47d700 1 -- 172.21.15.92:0/2548611188 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a80952f0 con 0x7f31a812f3a0 2023-09-29T23:23:57.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.070+0000 7f3d51f21700 1 -- 172.21.15.92:0/3222660312 >> v1:172.21.15.92:6789/0 conn(0x7f3d4c12f8b0 legacy=0x7f3d4c095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:57.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.070+0000 7f3d51f21700 1 -- 172.21.15.92:0/3222660312 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c0997e0 con 0x7f3d4c09fd80 2023-09-29T23:23:57.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.070+0000 7f31ad47d700 1 --2- 172.21.15.92:0/2548611188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a812f3a0 0x7f31a8131780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3198009930 tx=0x7f3198009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35c778c09e9e73a server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:57.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.070+0000 7f3d51f21700 1 --2- 172.21.15.92:0/3222660312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d4c09fd80 0x7f3d4c0a3090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009860 tx=0x7f3d480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb46881bba0d7ffa server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:57.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.070+0000 7f31acc7c700 1 -- 172.21.15.92:0/2548611188 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f319800b860 con 0x7f31a812f3a0 2023-09-29T23:23:57.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.070+0000 7f31acc7c700 1 -- 172.21.15.92:0/2548611188 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319800b9c0 con 0x7f31a812f3a0 2023-09-29T23:23:57.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.070+0000 7f31acc7c700 1 -- 172.21.15.92:0/2548611188 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f319800bb50 con 0x7f31a812f3a0 2023-09-29T23:23:57.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.070+0000 7f3d50f1f700 1 -- 172.21.15.92:0/3222660312 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d4800b680 con 0x7f3d4c09fd80 2023-09-29T23:23:57.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.070+0000 7f3d50f1f700 1 -- 172.21.15.92:0/3222660312 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4800b7e0 con 0x7f3d4c09fd80 2023-09-29T23:23:57.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.070+0000 7f3d50f1f700 1 -- 172.21.15.92:0/3222660312 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d4800b990 con 0x7f3d4c09fd80 2023-09-29T23:23:57.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.070+0000 7f31afee2700 1 -- 172.21.15.92:0/2548611188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a812f3a0 msgr2=0x7f31a8131780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:57.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.070+0000 7f31afee2700 1 --2- 172.21.15.92:0/2548611188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a812f3a0 0x7f31a8131780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3198009930 tx=0x7f3198009250 comp rx=0 tx=0).stop 2023-09-29T23:23:57.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.071+0000 7f31afee2700 1 -- 172.21.15.92:0/2548611188 shutdown_connections 2023-09-29T23:23:57.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.071+0000 7f31afee2700 1 --2- 172.21.15.92:0/2548611188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a812f3a0 0x7f31a8131780 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:57.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.071+0000 7f31afee2700 1 -- 172.21.15.92:0/2548611188 >> 172.21.15.92:0/2548611188 conn(0x7f31a806bbd0 msgr2=0x7f31a806dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:57.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.071+0000 7f3d54185700 1 -- 172.21.15.92:0/3222660312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d4c09fd80 msgr2=0x7f3d4c0a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:57.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.071+0000 7f3d54185700 1 --2- 172.21.15.92:0/3222660312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d4c09fd80 0x7f3d4c0a3090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009860 tx=0x7f3d480091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:57.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.071+0000 7f31afee2700 1 -- 172.21.15.92:0/2548611188 shutdown_connections 2023-09-29T23:23:57.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.071+0000 7f3d54185700 1 -- 172.21.15.92:0/3222660312 shutdown_connections 2023-09-29T23:23:57.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.071+0000 7f3d54185700 1 --2- 172.21.15.92:0/3222660312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d4c09fd80 0x7f3d4c0a3090 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:57.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.071+0000 7f3d54185700 1 -- 172.21.15.92:0/3222660312 >> 172.21.15.92:0/3222660312 conn(0x7f3d4c068000 msgr2=0x7f3d4c0a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:57.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.071+0000 7f31afee2700 1 -- 172.21.15.92:0/2548611188 wait complete. 2023-09-29T23:23:57.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.071+0000 7f3d54185700 1 -- 172.21.15.92:0/3222660312 shutdown_connections 2023-09-29T23:23:57.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.071+0000 7f3d54185700 1 -- 172.21.15.92:0/3222660312 wait complete. 2023-09-29T23:23:57.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.071+0000 7f31afee2700 1 Processor -- start 2023-09-29T23:23:57.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.072+0000 7f31afee2700 1 -- start start 2023-09-29T23:23:57.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.072+0000 7f3d54185700 1 Processor -- start 2023-09-29T23:23:57.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.072+0000 7f3d54185700 1 -- start start 2023-09-29T23:23:57.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.072+0000 7f31afee2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a8096d20 0x7f31a8115ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:57.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.072+0000 7f31afee2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a81192b0 con 0x7f31a8096d20 2023-09-29T23:23:57.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.072+0000 7f3d54185700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d4c09fd80 0x7f3d4c119fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:57.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.072+0000 7f3d54185700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c11e610 con 0x7f3d4c09fd80 2023-09-29T23:23:57.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.072+0000 7f31adc7e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a8096d20 0x7f31a8115ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:57.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.072+0000 7f31adc7e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a8096d20 0x7f31a8115ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49230/0 (socket says 172.21.15.92:49230) 2023-09-29T23:23:57.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.072+0000 7f31adc7e700 1 -- 172.21.15.92:0/1270860294 learned_addr learned my addr 172.21.15.92:0/1270860294 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:57.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.072+0000 7f3d51f21700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d4c09fd80 0x7f3d4c119fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:57.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.072+0000 7f3d51f21700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d4c09fd80 0x7f3d4c119fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49236/0 (socket says 172.21.15.92:49236) 2023-09-29T23:23:57.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.072+0000 7f3d51f21700 1 -- 172.21.15.92:0/229974763 learned_addr learned my addr 172.21.15.92:0/229974763 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:57.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.072+0000 7f31adc7e700 1 -- 172.21.15.92:0/1270860294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31980094f0 con 0x7f31a8096d20 2023-09-29T23:23:57.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.072+0000 7f3d51f21700 1 -- 172.21.15.92:0/229974763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d48009420 con 0x7f3d4c09fd80 2023-09-29T23:23:57.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.072+0000 7f31adc7e700 1 --2- 172.21.15.92:0/1270860294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a8096d20 0x7f31a8115ba0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f31a400c6c0 tx=0x7f31a4007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:57.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.073+0000 7f3d51f21700 1 --2- 172.21.15.92:0/229974763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d4c09fd80 0x7f3d4c119fa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d48000c00 tx=0x7f3d48016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:57.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.073+0000 7f319dffb700 1 -- 172.21.15.92:0/1270860294 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31a400e5e0 con 0x7f31a8096d20 2023-09-29T23:23:57.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.073+0000 7f319dffb700 1 -- 172.21.15.92:0/1270860294 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a400e740 con 0x7f31a8096d20 2023-09-29T23:23:57.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.073+0000 7f319dffb700 1 -- 172.21.15.92:0/1270860294 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31a400ea10 con 0x7f31a8096d20 2023-09-29T23:23:57.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.073+0000 7f3d41ffb700 1 -- 172.21.15.92:0/229974763 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d48025470 con 0x7f3d4c09fd80 2023-09-29T23:23:57.085 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.073+0000 7f3d41ffb700 1 -- 172.21.15.92:0/229974763 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d480255d0 con 0x7f3d4c09fd80 2023-09-29T23:23:57.085 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.073+0000 7f31afee2700 1 -- 172.21.15.92:0/1270860294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a8117650 con 0x7f31a8096d20 2023-09-29T23:23:57.085 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.073+0000 7f3d54185700 1 -- 172.21.15.92:0/229974763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4c11ba50 con 0x7f3d4c09fd80 2023-09-29T23:23:57.085 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.073+0000 7f31afee2700 1 -- 172.21.15.92:0/1270860294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a811a2b0 con 0x7f31a8096d20 2023-09-29T23:23:57.086 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.073+0000 7f3d41ffb700 1 -- 172.21.15.92:0/229974763 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d48025880 con 0x7f3d4c09fd80 2023-09-29T23:23:57.086 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.073+0000 7f3d54185700 1 -- 172.21.15.92:0/229974763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4c11d460 con 0x7f3d4c09fd80 2023-09-29T23:23:57.086 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.074+0000 7f3d41ffb700 1 -- 172.21.15.92:0/229974763 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f3d48022070 con 0x7f3d4c09fd80 2023-09-29T23:23:57.086 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.074+0000 7f3d41ffb700 1 --2- 172.21.15.92:0/229974763 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3d30035640 0x7f3d30037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:57.086 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.074+0000 7f3d41ffb700 1 -- 172.21.15.92:0/229974763 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f3d48049590 con 0x7f3d4c09fd80 2023-09-29T23:23:57.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.074+0000 7f31afee2700 1 -- 172.21.15.92:0/1270860294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a8117480 con 0x7f31a8096d20 2023-09-29T23:23:57.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.074+0000 7f3d54185700 1 -- 172.21.15.92:0/229974763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4c05f230 con 0x7f3d4c09fd80 2023-09-29T23:23:57.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.075+0000 7f3d51720700 1 --2- 172.21.15.92:0/229974763 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3d30035640 0x7f3d30037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:57.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.075+0000 7f319dffb700 1 -- 172.21.15.92:0/1270860294 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f31a400eb70 con 0x7f31a8096d20 2023-09-29T23:23:57.088 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.075+0000 7f319dffb700 1 --2- 172.21.15.92:0/1270860294 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f318c035630 0x7f318c037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:57.088 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.075+0000 7f3d51720700 1 --2- 172.21.15.92:0/229974763 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3d30035640 0x7f3d30037af0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0016a0 tx=0x7f3d3c007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:57.088 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.075+0000 7f31ad47d700 1 --2- 172.21.15.92:0/1270860294 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f318c035630 0x7f318c037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:57.088 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.075+0000 7f31ad47d700 1 --2- 172.21.15.92:0/1270860294 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f318c035630 0x7f318c037ae0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3198009930 tx=0x7f3198016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:57.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.079+0000 7f319dffb700 1 -- 172.21.15.92:0/1270860294 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f31a4010300 con 0x7f31a8096d20 2023-09-29T23:23:57.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.079+0000 7f3d41ffb700 1 -- 172.21.15.92:0/229974763 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d48010970 con 0x7f3d4c09fd80 2023-09-29T23:23:57.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.083+0000 7f319dffb700 1 -- 172.21.15.92:0/1270860294 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31a404c060 con 0x7f31a8096d20 2023-09-29T23:23:57.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.231+0000 7f2822fd9700 1 -- 172.21.15.92:0/3667015046 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f281c0a1ba0 con 0x7f281c09fd80 2023-09-29T23:23:57.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.232+0000 7f2818ff9700 1 -- 172.21.15.92:0/3667015046 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2810011e60 con 0x7f281c09fd80 2023-09-29T23:23:57.232 INFO:teuthology.orchestra.run.smithi092.stdout:34359738373 2023-09-29T23:23:57.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.234+0000 7f2822fd9700 1 -- 172.21.15.92:0/3667015046 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f28000355f0 msgr2=0x7f2800037aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:57.234 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.234+0000 7f2822fd9700 1 --2- 172.21.15.92:0/3667015046 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f28000355f0 0x7f2800037aa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f281c0a0170 tx=0x7f2808016000 comp rx=0 tx=0).stop 2023-09-29T23:23:57.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.234+0000 7f2822fd9700 1 -- 172.21.15.92:0/3667015046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281c09fd80 msgr2=0x7f281c11def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:57.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.234+0000 7f2822fd9700 1 --2- 172.21.15.92:0/3667015046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281c09fd80 0x7f281c11def0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f281000c3e0 tx=0x7f281000c7a0 comp rx=0 tx=0).stop 2023-09-29T23:23:57.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.234+0000 7f2822fd9700 1 -- 172.21.15.92:0/3667015046 shutdown_connections 2023-09-29T23:23:57.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.234+0000 7f2822fd9700 1 --2- 172.21.15.92:0/3667015046 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f28000355f0 0x7f2800037aa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:57.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.234+0000 7f2822fd9700 1 --2- 172.21.15.92:0/3667015046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281c09fd80 0x7f281c11def0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:57.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.234+0000 7f2822fd9700 1 -- 172.21.15.92:0/3667015046 >> 172.21.15.92:0/3667015046 conn(0x7f281c068000 msgr2=0x7f281c12def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:57.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.234+0000 7f2822fd9700 1 -- 172.21.15.92:0/3667015046 shutdown_connections 2023-09-29T23:23:57.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.234+0000 7f2822fd9700 1 -- 172.21.15.92:0/3667015046 wait complete. 2023-09-29T23:23:57.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.2 2023-09-29T23:23:57.246 DEBUG:teuthology.parallel:result is None 2023-09-29T23:23:57.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.272+0000 7f3d54185700 1 -- 172.21.15.92:0/229974763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3d4c04bb40 con 0x7f3d4c09fd80 2023-09-29T23:23:57.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.273+0000 7f3d41ffb700 1 -- 172.21.15.92:0/229974763 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d480193b0 con 0x7f3d4c09fd80 2023-09-29T23:23:57.273 INFO:teuthology.orchestra.run.smithi092.stdout:38654705670 2023-09-29T23:23:57.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.274+0000 7f3d54185700 1 -- 172.21.15.92:0/229974763 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3d30035640 msgr2=0x7f3d30037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:57.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.274+0000 7f3d54185700 1 --2- 172.21.15.92:0/229974763 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3d30035640 0x7f3d30037af0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0016a0 tx=0x7f3d3c007b30 comp rx=0 tx=0).stop 2023-09-29T23:23:57.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.274+0000 7f3d54185700 1 -- 172.21.15.92:0/229974763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d4c09fd80 msgr2=0x7f3d4c119fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:57.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.274+0000 7f3d54185700 1 --2- 172.21.15.92:0/229974763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d4c09fd80 0x7f3d4c119fa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d48000c00 tx=0x7f3d48016000 comp rx=0 tx=0).stop 2023-09-29T23:23:57.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.275+0000 7f3d54185700 1 -- 172.21.15.92:0/229974763 shutdown_connections 2023-09-29T23:23:57.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.275+0000 7f3d54185700 1 --2- 172.21.15.92:0/229974763 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3d30035640 0x7f3d30037af0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:57.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.275+0000 7f3d54185700 1 --2- 172.21.15.92:0/229974763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d4c09fd80 0x7f3d4c119fa0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:57.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.275+0000 7f3d54185700 1 -- 172.21.15.92:0/229974763 >> 172.21.15.92:0/229974763 conn(0x7f3d4c068000 msgr2=0x7f3d4c094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:57.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.275+0000 7f3d54185700 1 -- 172.21.15.92:0/229974763 shutdown_connections 2023-09-29T23:23:57.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.275+0000 7f3d54185700 1 -- 172.21.15.92:0/229974763 wait complete. 2023-09-29T23:23:57.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.279+0000 7f31afee2700 1 -- 172.21.15.92:0/1270860294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f31a805f230 con 0x7f31a8096d20 2023-09-29T23:23:57.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.279+0000 7f319dffb700 1 -- 172.21.15.92:0/1270860294 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f31a404c020 con 0x7f31a8096d20 2023-09-29T23:23:57.280 INFO:teuthology.orchestra.run.smithi092.stdout:38654705669 2023-09-29T23:23:57.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.282+0000 7f31afee2700 1 -- 172.21.15.92:0/1270860294 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f318c035630 msgr2=0x7f318c037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:57.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.282+0000 7f31afee2700 1 --2- 172.21.15.92:0/1270860294 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f318c035630 0x7f318c037ae0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3198009930 tx=0x7f3198016000 comp rx=0 tx=0).stop 2023-09-29T23:23:57.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.282+0000 7f31afee2700 1 -- 172.21.15.92:0/1270860294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a8096d20 msgr2=0x7f31a8115ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.282+0000 7f31afee2700 1 --2- 172.21.15.92:0/1270860294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a8096d20 0x7f31a8115ba0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f31a400c6c0 tx=0x7f31a4007f00 comp rx=0 tx=0).stop 2023-09-29T23:23:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.282+0000 7f31afee2700 1 -- 172.21.15.92:0/1270860294 shutdown_connections 2023-09-29T23:23:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.282+0000 7f31afee2700 1 --2- 172.21.15.92:0/1270860294 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f318c035630 0x7f318c037ae0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.282+0000 7f31afee2700 1 --2- 172.21.15.92:0/1270860294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a8096d20 0x7f31a8115ba0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.282+0000 7f31afee2700 1 -- 172.21.15.92:0/1270860294 >> 172.21.15.92:0/1270860294 conn(0x7f31a806bbd0 msgr2=0x7f31a8099d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.282+0000 7f31afee2700 1 -- 172.21.15.92:0/1270860294 shutdown_connections 2023-09-29T23:23:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.282+0000 7f31afee2700 1 -- 172.21.15.92:0/1270860294 wait complete. 2023-09-29T23:23:57.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.1 2023-09-29T23:23:57.287 DEBUG:teuthology.parallel:result is None 2023-09-29T23:23:57.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2023-09-29T23:23:57.295 DEBUG:teuthology.parallel:result is None 2023-09-29T23:23:57.295 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-29T23:23:57.295 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:23:57.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.448+0000 7fa1bec32700 1 Processor -- start 2023-09-29T23:23:57.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.448+0000 7fa1bec32700 1 -- start start 2023-09-29T23:23:57.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.449+0000 7fa1bec32700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa1b80964d0 0x7fa1b80968a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:57.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.449+0000 7fa1bec32700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b806fc60 con 0x7fa1b812b7e0 2023-09-29T23:23:57.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.449+0000 7fa1bec32700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b806a120 con 0x7fa1b80964d0 2023-09-29T23:23:57.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.449+0000 7fa1bc9ce700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa1b80964d0 0x7fa1b80968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:57.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.449+0000 7fa1affff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fa1b812b7e0 0x7fa1b812bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54710/0 (socket says 172.21.15.92:54710) 2023-09-29T23:23:57.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.449+0000 7fa1affff700 1 -- 172.21.15.92:0/3957117160 learned_addr learned my addr 172.21.15.92:0/3957117160 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:57.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.449+0000 7fa1bc9ce700 1 -- 172.21.15.92:0/3957117160 >> v1:172.21.15.92:6789/0 conn(0x7fa1b812b7e0 legacy=0x7fa1b812bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:57.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.449+0000 7fa1bc9ce700 1 -- 172.21.15.92:0/3957117160 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b80972d0 con 0x7fa1b80964d0 2023-09-29T23:23:57.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.449+0000 7fa1bc9ce700 1 --2- 172.21.15.92:0/3957117160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1b80964d0 0x7fa1b80968a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4009e30 tx=0x7fa1b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b831aea2aabcae3f server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:57.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.449+0000 7fa1af7fe700 1 -- 172.21.15.92:0/3957117160 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1b400bc30 con 0x7fa1b80964d0 2023-09-29T23:23:57.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.450+0000 7fa1af7fe700 1 -- 172.21.15.92:0/3957117160 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b400bd90 con 0x7fa1b80964d0 2023-09-29T23:23:57.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.450+0000 7fa1af7fe700 1 -- 172.21.15.92:0/3957117160 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1b4011400 con 0x7fa1b80964d0 2023-09-29T23:23:57.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.450+0000 7fa1bec32700 1 -- 172.21.15.92:0/3957117160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1b80964d0 msgr2=0x7fa1b80968a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:57.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.450+0000 7fa1bec32700 1 --2- 172.21.15.92:0/3957117160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1b80964d0 0x7fa1b80968a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4009e30 tx=0x7fa1b4009780 comp rx=0 tx=0).stop 2023-09-29T23:23:57.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.450+0000 7fa1bec32700 1 -- 172.21.15.92:0/3957117160 shutdown_connections 2023-09-29T23:23:57.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.450+0000 7fa1bec32700 1 --2- 172.21.15.92:0/3957117160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1b80964d0 0x7fa1b80968a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:57.452 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.450+0000 7fa1bec32700 1 -- 172.21.15.92:0/3957117160 >> 172.21.15.92:0/3957117160 conn(0x7fa1b806bd70 msgr2=0x7fa1b806e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:57.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.450+0000 7fa1bec32700 1 -- 172.21.15.92:0/3957117160 shutdown_connections 2023-09-29T23:23:57.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.450+0000 7fa1bec32700 1 -- 172.21.15.92:0/3957117160 wait complete. 2023-09-29T23:23:57.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.451+0000 7fa1bec32700 1 Processor -- start 2023-09-29T23:23:57.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.451+0000 7fa1bec32700 1 -- start start 2023-09-29T23:23:57.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.452+0000 7fa1bec32700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1b80964d0 0x7fa1b8086a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:57.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.452+0000 7fa1bec32700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b8128150 con 0x7fa1b80964d0 2023-09-29T23:23:57.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.452+0000 7fa1bc9ce700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1b80964d0 0x7fa1b8086a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:57.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.452+0000 7fa1bc9ce700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1b80964d0 0x7fa1b8086a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49258/0 (socket says 172.21.15.92:49258) 2023-09-29T23:23:57.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.452+0000 7fa1bc9ce700 1 -- 172.21.15.92:0/4134363482 learned_addr learned my addr 172.21.15.92:0/4134363482 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:57.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.452+0000 7fa1bc9ce700 1 -- 172.21.15.92:0/4134363482 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b4009a20 con 0x7fa1b80964d0 2023-09-29T23:23:57.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.452+0000 7fa1bc9ce700 1 --2- 172.21.15.92:0/4134363482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1b80964d0 0x7fa1b8086a60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40099f0 tx=0x7fa1b4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:57.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.452+0000 7fa1acff9700 1 -- 172.21.15.92:0/4134363482 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1b4020070 con 0x7fa1b80964d0 2023-09-29T23:23:57.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.452+0000 7fa1acff9700 1 -- 172.21.15.92:0/4134363482 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b4011e80 con 0x7fa1b80964d0 2023-09-29T23:23:57.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.452+0000 7fa1acff9700 1 -- 172.21.15.92:0/4134363482 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1b400bc30 con 0x7fa1b80964d0 2023-09-29T23:23:57.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.452+0000 7fa1bec32700 1 -- 172.21.15.92:0/4134363482 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b8093e90 con 0x7fa1b80964d0 2023-09-29T23:23:57.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.452+0000 7fa1bec32700 1 -- 172.21.15.92:0/4134363482 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b80864c0 con 0x7fa1b80964d0 2023-09-29T23:23:57.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.453+0000 7fa1acff9700 1 -- 172.21.15.92:0/4134363482 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fa1b401b960 con 0x7fa1b80964d0 2023-09-29T23:23:57.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.453+0000 7fa1acff9700 1 --2- 172.21.15.92:0/4134363482 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa1a4035630 0x7fa1a4037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:57.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.453+0000 7fa1acff9700 1 -- 172.21.15.92:0/4134363482 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7fa1b4049240 con 0x7fa1b80964d0 2023-09-29T23:23:57.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.453+0000 7fa1affff700 1 --2- 172.21.15.92:0/4134363482 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa1a4035630 0x7fa1a4037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:57.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.453+0000 7fa1bec32700 1 -- 172.21.15.92:0/4134363482 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b8096230 con 0x7fa1b80964d0 2023-09-29T23:23:57.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.454+0000 7fa1affff700 1 --2- 172.21.15.92:0/4134363482 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa1a4035630 0x7fa1a4037ae0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa1a80016a0 tx=0x7fa1a8007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:57.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.458+0000 7fa1acff9700 1 -- 172.21.15.92:0/4134363482 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa1b4029020 con 0x7fa1b80964d0 2023-09-29T23:23:57.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.636+0000 7fa1bec32700 1 -- 172.21.15.92:0/4134363482 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1b805f230 con 0x7fa1a4035630 2023-09-29T23:23:57.643 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.643+0000 7fa1acff9700 1 -- 172.21.15.92:0/4134363482 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+262467 (secure 0 0 0) 0x7fa1b805f230 con 0x7fa1a4035630 2023-09-29T23:23:57.646 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:57.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.646+0000 7fa1bec32700 1 -- 172.21.15.92:0/4134363482 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa1a4035630 msgr2=0x7fa1a4037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:57.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.646+0000 7fa1bec32700 1 --2- 172.21.15.92:0/4134363482 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa1a4035630 0x7fa1a4037ae0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa1a80016a0 tx=0x7fa1a8007b30 comp rx=0 tx=0).stop 2023-09-29T23:23:57.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.646+0000 7fa1bec32700 1 -- 172.21.15.92:0/4134363482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1b80964d0 msgr2=0x7fa1b8086a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:57.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.646+0000 7fa1bec32700 1 --2- 172.21.15.92:0/4134363482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1b80964d0 0x7fa1b8086a60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40099f0 tx=0x7fa1b4019000 comp rx=0 tx=0).stop 2023-09-29T23:23:57.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.646+0000 7fa1bec32700 1 -- 172.21.15.92:0/4134363482 shutdown_connections 2023-09-29T23:23:57.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.646+0000 7fa1bec32700 1 --2- 172.21.15.92:0/4134363482 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa1a4035630 0x7fa1a4037ae0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:57.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.646+0000 7fa1bec32700 1 --2- 172.21.15.92:0/4134363482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1b80964d0 0x7fa1b8086a60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:57.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.646+0000 7fa1bec32700 1 -- 172.21.15.92:0/4134363482 >> 172.21.15.92:0/4134363482 conn(0x7fa1b806bd70 msgr2=0x7fa1b809e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:57.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.646+0000 7fa1bec32700 1 -- 172.21.15.92:0/4134363482 shutdown_connections 2023-09-29T23:23:57.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.646+0000 7fa1bec32700 1 -- 172.21.15.92:0/4134363482 wait complete. 2023-09-29T23:23:57.649 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-09-29T23:23:57.658 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-09-29T23:23:56.037339+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":208,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":16584,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":16064,"kb_avail":314556216,"statfs":{"total":322122547200,"available":322105565184,"internally_reserved":0,"allocated":507904,"data_stored":138262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16449536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":770,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001892"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473355+0000","last_change":"2023-09-29T23:23:45.465624+0000","last_active":"2023-09-29T23:23:45.473355+0000","last_peered":"2023-09-29T23:23:45.473355+0000","last_clean":"2023-09-29T23:23:45.473355+0000","last_became_active":"2023-09-29T23:23:45.464271+0000","last_became_peered":"2023-09-29T23:23:45.464271+0000","last_unstale":"2023-09-29T23:23:45.473355+0000","last_undegraded":"2023-09-29T23:23:45.473355+0000","last_fullsized":"2023-09-29T23:23:45.473355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:54:19.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.469593+0000","last_change":"2023-09-29T23:23:45.466587+0000","last_active":"2023-09-29T23:23:45.469593+0000","last_peered":"2023-09-29T23:23:45.469593+0000","last_clean":"2023-09-29T23:23:45.469593+0000","last_became_active":"2023-09-29T23:23:45.466338+0000","last_became_peered":"2023-09-29T23:23:45.466338+0000","last_unstale":"2023-09-29T23:23:45.469593+0000","last_undegraded":"2023-09-29T23:23:45.469593+0000","last_fullsized":"2023-09-29T23:23:45.469593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479450+0000","last_change":"2023-09-29T23:23:45.477248+0000","last_active":"2023-09-29T23:23:45.479450+0000","last_peered":"2023-09-29T23:23:45.479450+0000","last_clean":"2023-09-29T23:23:45.479450+0000","last_became_active":"2023-09-29T23:23:45.474129+0000","last_became_peered":"2023-09-29T23:23:45.474129+0000","last_unstale":"2023-09-29T23:23:45.479450+0000","last_undegraded":"2023-09-29T23:23:45.479450+0000","last_fullsized":"2023-09-29T23:23:45.479450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:09:27.600159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474474+0000","last_change":"2023-09-29T23:23:45.471200+0000","last_active":"2023-09-29T23:23:45.474474+0000","last_peered":"2023-09-29T23:23:45.474474+0000","last_clean":"2023-09-29T23:23:45.474474+0000","last_became_active":"2023-09-29T23:23:45.470971+0000","last_became_peered":"2023-09-29T23:23:45.470971+0000","last_unstale":"2023-09-29T23:23:45.474474+0000","last_undegraded":"2023-09-29T23:23:45.474474+0000","last_fullsized":"2023-09-29T23:23:45.474474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:29:34.531515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479230+0000","last_change":"2023-09-29T23:23:45.473831+0000","last_active":"2023-09-29T23:23:45.479230+0000","last_peered":"2023-09-29T23:23:45.479230+0000","last_clean":"2023-09-29T23:23:45.479230+0000","last_became_active":"2023-09-29T23:23:45.473570+0000","last_became_peered":"2023-09-29T23:23:45.473570+0000","last_unstale":"2023-09-29T23:23:45.479230+0000","last_undegraded":"2023-09-29T23:23:45.479230+0000","last_fullsized":"2023-09-29T23:23:45.479230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:51:36.401360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472105+0000","last_change":"2023-09-29T23:23:45.470583+0000","last_active":"2023-09-29T23:23:45.472105+0000","last_peered":"2023-09-29T23:23:45.472105+0000","last_clean":"2023-09-29T23:23:45.472105+0000","last_became_active":"2023-09-29T23:23:45.470349+0000","last_became_peered":"2023-09-29T23:23:45.470349+0000","last_unstale":"2023-09-29T23:23:45.472105+0000","last_undegraded":"2023-09-29T23:23:45.472105+0000","last_fullsized":"2023-09-29T23:23:45.472105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:50:32.868236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473871+0000","last_change":"2023-09-29T23:23:45.465376+0000","last_active":"2023-09-29T23:23:45.473871+0000","last_peered":"2023-09-29T23:23:45.473871+0000","last_clean":"2023-09-29T23:23:45.473871+0000","last_became_active":"2023-09-29T23:23:45.464893+0000","last_became_peered":"2023-09-29T23:23:45.464893+0000","last_unstale":"2023-09-29T23:23:45.473871+0000","last_undegraded":"2023-09-29T23:23:45.473871+0000","last_fullsized":"2023-09-29T23:23:45.473871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:34:22.460877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.469721+0000","last_change":"2023-09-29T23:23:45.463286+0000","last_active":"2023-09-29T23:23:45.469721+0000","last_peered":"2023-09-29T23:23:45.469721+0000","last_clean":"2023-09-29T23:23:45.469721+0000","last_became_active":"2023-09-29T23:23:45.462888+0000","last_became_peered":"2023-09-29T23:23:45.462888+0000","last_unstale":"2023-09-29T23:23:45.469721+0000","last_undegraded":"2023-09-29T23:23:45.469721+0000","last_fullsized":"2023-09-29T23:23:45.469721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470175+0000","last_change":"2023-09-29T23:23:45.468860+0000","last_active":"2023-09-29T23:23:45.470175+0000","last_peered":"2023-09-29T23:23:45.470175+0000","last_clean":"2023-09-29T23:23:45.470175+0000","last_became_active":"2023-09-29T23:23:45.468303+0000","last_became_peered":"2023-09-29T23:23:45.468303+0000","last_unstale":"2023-09-29T23:23:45.470175+0000","last_undegraded":"2023-09-29T23:23:45.470175+0000","last_fullsized":"2023-09-29T23:23:45.470175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:34:22.460877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479380+0000","last_change":"2023-09-29T23:23:45.475091+0000","last_active":"2023-09-29T23:23:45.479380+0000","last_peered":"2023-09-29T23:23:45.479380+0000","last_clean":"2023-09-29T23:23:45.479380+0000","last_became_active":"2023-09-29T23:23:45.474757+0000","last_became_peered":"2023-09-29T23:23:45.474757+0000","last_unstale":"2023-09-29T23:23:45.479380+0000","last_undegraded":"2023-09-29T23:23:45.479380+0000","last_fullsized":"2023-09-29T23:23:45.479380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:59:29.779691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473519+0000","last_change":"2023-09-29T23:23:45.467858+0000","last_active":"2023-09-29T23:23:45.473519+0000","last_peered":"2023-09-29T23:23:45.473519+0000","last_clean":"2023-09-29T23:23:45.473519+0000","last_became_active":"2023-09-29T23:23:45.464083+0000","last_became_peered":"2023-09-29T23:23:45.464083+0000","last_unstale":"2023-09-29T23:23:45.473519+0000","last_undegraded":"2023-09-29T23:23:45.473519+0000","last_fullsized":"2023-09-29T23:23:45.473519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:30:57.865969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473409+0000","last_change":"2023-09-29T23:23:45.466588+0000","last_active":"2023-09-29T23:23:45.473409+0000","last_peered":"2023-09-29T23:23:45.473409+0000","last_clean":"2023-09-29T23:23:45.473409+0000","last_became_active":"2023-09-29T23:23:45.466161+0000","last_became_peered":"2023-09-29T23:23:45.466161+0000","last_unstale":"2023-09-29T23:23:45.473409+0000","last_undegraded":"2023-09-29T23:23:45.473409+0000","last_fullsized":"2023-09-29T23:23:45.473409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:13.284557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473383+0000","last_change":"2023-09-29T23:23:45.467402+0000","last_active":"2023-09-29T23:23:45.473383+0000","last_peered":"2023-09-29T23:23:45.473383+0000","last_clean":"2023-09-29T23:23:45.473383+0000","last_became_active":"2023-09-29T23:23:45.467178+0000","last_became_peered":"2023-09-29T23:23:45.467178+0000","last_unstale":"2023-09-29T23:23:45.473383+0000","last_undegraded":"2023-09-29T23:23:45.473383+0000","last_fullsized":"2023-09-29T23:23:45.473383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472302+0000","last_change":"2023-09-29T23:23:45.465231+0000","last_active":"2023-09-29T23:23:45.472302+0000","last_peered":"2023-09-29T23:23:45.472302+0000","last_clean":"2023-09-29T23:23:45.472302+0000","last_became_active":"2023-09-29T23:23:45.464523+0000","last_became_peered":"2023-09-29T23:23:45.464523+0000","last_unstale":"2023-09-29T23:23:45.472302+0000","last_undegraded":"2023-09-29T23:23:45.472302+0000","last_fullsized":"2023-09-29T23:23:45.472302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:32.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471955+0000","last_change":"2023-09-29T23:23:45.470349+0000","last_active":"2023-09-29T23:23:45.471955+0000","last_peered":"2023-09-29T23:23:45.471955+0000","last_clean":"2023-09-29T23:23:45.471955+0000","last_became_active":"2023-09-29T23:23:45.467004+0000","last_became_peered":"2023-09-29T23:23:45.467004+0000","last_unstale":"2023-09-29T23:23:45.471955+0000","last_undegraded":"2023-09-29T23:23:45.471955+0000","last_fullsized":"2023-09-29T23:23:45.471955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474011+0000","last_change":"2023-09-29T23:23:45.471536+0000","last_active":"2023-09-29T23:23:45.474011+0000","last_peered":"2023-09-29T23:23:45.474011+0000","last_clean":"2023-09-29T23:23:45.474011+0000","last_became_active":"2023-09-29T23:23:45.471334+0000","last_became_peered":"2023-09-29T23:23:45.471334+0000","last_unstale":"2023-09-29T23:23:45.474011+0000","last_undegraded":"2023-09-29T23:23:45.474011+0000","last_fullsized":"2023-09-29T23:23:45.474011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470193+0000","last_change":"2023-09-29T23:23:45.468857+0000","last_active":"2023-09-29T23:23:45.470193+0000","last_peered":"2023-09-29T23:23:45.470193+0000","last_clean":"2023-09-29T23:23:45.470193+0000","last_became_active":"2023-09-29T23:23:45.468001+0000","last_became_peered":"2023-09-29T23:23:45.468001+0000","last_unstale":"2023-09-29T23:23:45.470193+0000","last_undegraded":"2023-09-29T23:23:45.470193+0000","last_fullsized":"2023-09-29T23:23:45.470193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:11.211646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470618+0000","last_change":"2023-09-29T23:23:45.467819+0000","last_active":"2023-09-29T23:23:45.470618+0000","last_peered":"2023-09-29T23:23:45.470618+0000","last_clean":"2023-09-29T23:23:45.470618+0000","last_became_active":"2023-09-29T23:23:45.467434+0000","last_became_peered":"2023-09-29T23:23:45.467434+0000","last_unstale":"2023-09-29T23:23:45.470618+0000","last_undegraded":"2023-09-29T23:23:45.470618+0000","last_fullsized":"2023-09-29T23:23:45.470618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479225+0000","last_change":"2023-09-29T23:23:45.473751+0000","last_active":"2023-09-29T23:23:45.479225+0000","last_peered":"2023-09-29T23:23:45.479225+0000","last_clean":"2023-09-29T23:23:45.479225+0000","last_became_active":"2023-09-29T23:23:45.473326+0000","last_became_peered":"2023-09-29T23:23:45.473326+0000","last_unstale":"2023-09-29T23:23:45.479225+0000","last_undegraded":"2023-09-29T23:23:45.479225+0000","last_fullsized":"2023-09-29T23:23:45.479225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:21:17.261104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473427+0000","last_change":"2023-09-29T23:23:45.467719+0000","last_active":"2023-09-29T23:23:45.473427+0000","last_peered":"2023-09-29T23:23:45.473427+0000","last_clean":"2023-09-29T23:23:45.473427+0000","last_became_active":"2023-09-29T23:23:45.467494+0000","last_became_peered":"2023-09-29T23:23:45.467494+0000","last_unstale":"2023-09-29T23:23:45.473427+0000","last_undegraded":"2023-09-29T23:23:45.473427+0000","last_fullsized":"2023-09-29T23:23:45.473427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479563+0000","last_change":"2023-09-29T23:23:45.478055+0000","last_active":"2023-09-29T23:23:45.479563+0000","last_peered":"2023-09-29T23:23:45.479563+0000","last_clean":"2023-09-29T23:23:45.479563+0000","last_became_active":"2023-09-29T23:23:45.477408+0000","last_became_peered":"2023-09-29T23:23:45.477408+0000","last_unstale":"2023-09-29T23:23:45.479563+0000","last_undegraded":"2023-09-29T23:23:45.479563+0000","last_fullsized":"2023-09-29T23:23:45.479563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:14:56.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474548+0000","last_change":"2023-09-29T23:23:45.471232+0000","last_active":"2023-09-29T23:23:45.474548+0000","last_peered":"2023-09-29T23:23:45.474548+0000","last_clean":"2023-09-29T23:23:45.474548+0000","last_became_active":"2023-09-29T23:23:45.470574+0000","last_became_peered":"2023-09-29T23:23:45.470574+0000","last_unstale":"2023-09-29T23:23:45.474548+0000","last_undegraded":"2023-09-29T23:23:45.474548+0000","last_fullsized":"2023-09-29T23:23:45.474548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:25:25.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479248+0000","last_change":"2023-09-29T23:23:45.474093+0000","last_active":"2023-09-29T23:23:45.479248+0000","last_peered":"2023-09-29T23:23:45.479248+0000","last_clean":"2023-09-29T23:23:45.479248+0000","last_became_active":"2023-09-29T23:23:45.473789+0000","last_became_peered":"2023-09-29T23:23:45.473789+0000","last_unstale":"2023-09-29T23:23:45.479248+0000","last_undegraded":"2023-09-29T23:23:45.479248+0000","last_fullsized":"2023-09-29T23:23:45.479248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:46.564456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472272+0000","last_change":"2023-09-29T23:23:45.465993+0000","last_active":"2023-09-29T23:23:45.472272+0000","last_peered":"2023-09-29T23:23:45.472272+0000","last_clean":"2023-09-29T23:23:45.472272+0000","last_became_active":"2023-09-29T23:23:45.465443+0000","last_became_peered":"2023-09-29T23:23:45.465443+0000","last_unstale":"2023-09-29T23:23:45.472272+0000","last_undegraded":"2023-09-29T23:23:45.472272+0000","last_fullsized":"2023-09-29T23:23:45.472272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:12:18.769461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.460342+0000","last_change":"2023-09-29T23:23:45.458032+0000","last_active":"2023-09-29T23:23:45.460342+0000","last_peered":"2023-09-29T23:23:45.460342+0000","last_clean":"2023-09-29T23:23:45.460342+0000","last_became_active":"2023-09-29T23:23:45.457799+0000","last_became_peered":"2023-09-29T23:23:45.457799+0000","last_unstale":"2023-09-29T23:23:45.460342+0000","last_undegraded":"2023-09-29T23:23:45.460342+0000","last_fullsized":"2023-09-29T23:23:45.460342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:21:07.207937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470656+0000","last_change":"2023-09-29T23:23:45.467967+0000","last_active":"2023-09-29T23:23:45.470656+0000","last_peered":"2023-09-29T23:23:45.470656+0000","last_clean":"2023-09-29T23:23:45.470656+0000","last_became_active":"2023-09-29T23:23:45.467730+0000","last_became_peered":"2023-09-29T23:23:45.467730+0000","last_unstale":"2023-09-29T23:23:45.470656+0000","last_undegraded":"2023-09-29T23:23:45.470656+0000","last_fullsized":"2023-09-29T23:23:45.470656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:23:19.840400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475084+0000","last_change":"2023-09-29T23:23:45.076072+0000","last_active":"2023-09-29T23:23:45.475084+0000","last_peered":"2023-09-29T23:23:45.475084+0000","last_clean":"2023-09-29T23:23:45.475084+0000","last_became_active":"2023-09-29T23:23:45.075848+0000","last_became_peered":"2023-09-29T23:23:45.075848+0000","last_unstale":"2023-09-29T23:23:45.475084+0000","last_undegraded":"2023-09-29T23:23:45.475084+0000","last_fullsized":"2023-09-29T23:23:45.475084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:29:13.914085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.464208+0000","last_change":"2023-09-29T23:23:45.462781+0000","last_active":"2023-09-29T23:23:45.464208+0000","last_peered":"2023-09-29T23:23:45.464208+0000","last_clean":"2023-09-29T23:23:45.464208+0000","last_became_active":"2023-09-29T23:23:45.462155+0000","last_became_peered":"2023-09-29T23:23:45.462155+0000","last_unstale":"2023-09-29T23:23:45.464208+0000","last_undegraded":"2023-09-29T23:23:45.464208+0000","last_fullsized":"2023-09-29T23:23:45.464208+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:13.284557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467209+0000","last_change":"2023-09-29T23:23:45.092553+0000","last_active":"2023-09-29T23:23:45.467209+0000","last_peered":"2023-09-29T23:23:45.467209+0000","last_clean":"2023-09-29T23:23:45.467209+0000","last_became_active":"2023-09-29T23:23:45.092273+0000","last_became_peered":"2023-09-29T23:23:45.092273+0000","last_unstale":"2023-09-29T23:23:45.467209+0000","last_undegraded":"2023-09-29T23:23:45.467209+0000","last_fullsized":"2023-09-29T23:23:45.467209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472939+0000","last_change":"2023-09-29T23:23:45.464637+0000","last_active":"2023-09-29T23:23:45.472939+0000","last_peered":"2023-09-29T23:23:45.472939+0000","last_clean":"2023-09-29T23:23:45.472939+0000","last_became_active":"2023-09-29T23:23:45.464027+0000","last_became_peered":"2023-09-29T23:23:45.464027+0000","last_unstale":"2023-09-29T23:23:45.472939+0000","last_undegraded":"2023-09-29T23:23:45.472939+0000","last_fullsized":"2023-09-29T23:23:45.472939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.449247+0000","last_change":"2023-09-29T23:23:45.088658+0000","last_active":"2023-09-29T23:23:45.449247+0000","last_peered":"2023-09-29T23:23:45.449247+0000","last_clean":"2023-09-29T23:23:45.449247+0000","last_became_active":"2023-09-29T23:23:45.088405+0000","last_became_peered":"2023-09-29T23:23:45.088405+0000","last_unstale":"2023-09-29T23:23:45.449247+0000","last_undegraded":"2023-09-29T23:23:45.449247+0000","last_fullsized":"2023-09-29T23:23:45.449247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473976+0000","last_change":"2023-09-29T23:23:45.471459+0000","last_active":"2023-09-29T23:23:45.473976+0000","last_peered":"2023-09-29T23:23:45.473976+0000","last_clean":"2023-09-29T23:23:45.473976+0000","last_became_active":"2023-09-29T23:23:45.470917+0000","last_became_peered":"2023-09-29T23:23:45.470917+0000","last_unstale":"2023-09-29T23:23:45.473976+0000","last_undegraded":"2023-09-29T23:23:45.473976+0000","last_fullsized":"2023-09-29T23:23:45.473976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:29:34.889615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.444294+0000","last_change":"2023-09-29T23:23:45.070764+0000","last_active":"2023-09-29T23:23:45.444294+0000","last_peered":"2023-09-29T23:23:45.444294+0000","last_clean":"2023-09-29T23:23:45.444294+0000","last_became_active":"2023-09-29T23:23:45.070610+0000","last_became_peered":"2023-09-29T23:23:45.070610+0000","last_unstale":"2023-09-29T23:23:45.444294+0000","last_undegraded":"2023-09-29T23:23:45.444294+0000","last_fullsized":"2023-09-29T23:23:45.444294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:26:19.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.477784+0000","last_change":"2023-09-29T23:23:45.475877+0000","last_active":"2023-09-29T23:23:45.477784+0000","last_peered":"2023-09-29T23:23:45.477784+0000","last_clean":"2023-09-29T23:23:45.477784+0000","last_became_active":"2023-09-29T23:23:45.475634+0000","last_became_peered":"2023-09-29T23:23:45.475634+0000","last_unstale":"2023-09-29T23:23:45.477784+0000","last_undegraded":"2023-09-29T23:23:45.477784+0000","last_fullsized":"2023-09-29T23:23:45.477784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:59:25.888959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.458483+0000","last_change":"2023-09-29T23:23:45.091556+0000","last_active":"2023-09-29T23:23:45.458483+0000","last_peered":"2023-09-29T23:23:45.458483+0000","last_clean":"2023-09-29T23:23:45.458483+0000","last_became_active":"2023-09-29T23:23:45.091317+0000","last_became_peered":"2023-09-29T23:23:45.091317+0000","last_unstale":"2023-09-29T23:23:45.458483+0000","last_undegraded":"2023-09-29T23:23:45.458483+0000","last_fullsized":"2023-09-29T23:23:45.458483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:53.097532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467362+0000","last_change":"2023-09-29T23:23:45.458805+0000","last_active":"2023-09-29T23:23:45.467362+0000","last_peered":"2023-09-29T23:23:45.467362+0000","last_clean":"2023-09-29T23:23:45.467362+0000","last_became_active":"2023-09-29T23:23:45.458585+0000","last_became_peered":"2023-09-29T23:23:45.458585+0000","last_unstale":"2023-09-29T23:23:45.467362+0000","last_undegraded":"2023-09-29T23:23:45.467362+0000","last_fullsized":"2023-09-29T23:23:45.467362+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:05:18.350431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.446151+0000","last_change":"2023-09-29T23:23:45.071269+0000","last_active":"2023-09-29T23:23:45.446151+0000","last_peered":"2023-09-29T23:23:45.446151+0000","last_clean":"2023-09-29T23:23:45.446151+0000","last_became_active":"2023-09-29T23:23:45.070986+0000","last_became_peered":"2023-09-29T23:23:45.070986+0000","last_unstale":"2023-09-29T23:23:45.446151+0000","last_undegraded":"2023-09-29T23:23:45.446151+0000","last_fullsized":"2023-09-29T23:23:45.446151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:29.355473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472807+0000","last_change":"2023-09-29T23:23:45.464917+0000","last_active":"2023-09-29T23:23:45.472807+0000","last_peered":"2023-09-29T23:23:45.472807+0000","last_clean":"2023-09-29T23:23:45.472807+0000","last_became_active":"2023-09-29T23:23:45.464510+0000","last_became_peered":"2023-09-29T23:23:45.464510+0000","last_unstale":"2023-09-29T23:23:45.472807+0000","last_undegraded":"2023-09-29T23:23:45.472807+0000","last_fullsized":"2023-09-29T23:23:45.472807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:58:16.565151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475769+0000","last_change":"2023-09-29T23:23:45.077097+0000","last_active":"2023-09-29T23:23:45.475769+0000","last_peered":"2023-09-29T23:23:45.475769+0000","last_clean":"2023-09-29T23:23:45.475769+0000","last_became_active":"2023-09-29T23:23:45.076856+0000","last_became_peered":"2023-09-29T23:23:45.076856+0000","last_unstale":"2023-09-29T23:23:45.475769+0000","last_undegraded":"2023-09-29T23:23:45.475769+0000","last_fullsized":"2023-09-29T23:23:45.475769+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:00:28.816753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.464231+0000","last_change":"2023-09-29T23:23:45.462198+0000","last_active":"2023-09-29T23:23:45.464231+0000","last_peered":"2023-09-29T23:23:45.464231+0000","last_clean":"2023-09-29T23:23:45.464231+0000","last_became_active":"2023-09-29T23:23:45.461199+0000","last_became_peered":"2023-09-29T23:23:45.461199+0000","last_unstale":"2023-09-29T23:23:45.464231+0000","last_undegraded":"2023-09-29T23:23:45.464231+0000","last_fullsized":"2023-09-29T23:23:45.464231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:33.901646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.484403+0000","last_change":"2023-09-29T23:23:45.093720+0000","last_active":"2023-09-29T23:23:45.484403+0000","last_peered":"2023-09-29T23:23:45.484403+0000","last_clean":"2023-09-29T23:23:45.484403+0000","last_became_active":"2023-09-29T23:23:45.093487+0000","last_became_peered":"2023-09-29T23:23:45.093487+0000","last_unstale":"2023-09-29T23:23:45.484403+0000","last_undegraded":"2023-09-29T23:23:45.484403+0000","last_fullsized":"2023-09-29T23:23:45.484403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473468+0000","last_change":"2023-09-29T23:23:45.466875+0000","last_active":"2023-09-29T23:23:45.473468+0000","last_peered":"2023-09-29T23:23:45.473468+0000","last_clean":"2023-09-29T23:23:45.473468+0000","last_became_active":"2023-09-29T23:23:45.466667+0000","last_became_peered":"2023-09-29T23:23:45.466667+0000","last_unstale":"2023-09-29T23:23:45.473468+0000","last_undegraded":"2023-09-29T23:23:45.473468+0000","last_fullsized":"2023-09-29T23:23:45.473468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:19.696930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.480207+0000","last_change":"2023-09-29T23:23:45.089727+0000","last_active":"2023-09-29T23:23:45.480207+0000","last_peered":"2023-09-29T23:23:45.480207+0000","last_clean":"2023-09-29T23:23:45.480207+0000","last_became_active":"2023-09-29T23:23:45.089450+0000","last_became_peered":"2023-09-29T23:23:45.089450+0000","last_unstale":"2023-09-29T23:23:45.480207+0000","last_undegraded":"2023-09-29T23:23:45.480207+0000","last_fullsized":"2023-09-29T23:23:45.480207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473639+0000","last_change":"2023-09-29T23:23:45.468316+0000","last_active":"2023-09-29T23:23:45.473639+0000","last_peered":"2023-09-29T23:23:45.473639+0000","last_clean":"2023-09-29T23:23:45.473639+0000","last_became_active":"2023-09-29T23:23:45.464801+0000","last_became_peered":"2023-09-29T23:23:45.464801+0000","last_unstale":"2023-09-29T23:23:45.473639+0000","last_undegraded":"2023-09-29T23:23:45.473639+0000","last_fullsized":"2023-09-29T23:23:45.473639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.451089+0000","last_change":"2023-09-29T23:23:45.093148+0000","last_active":"2023-09-29T23:23:45.451089+0000","last_peered":"2023-09-29T23:23:45.451089+0000","last_clean":"2023-09-29T23:23:45.451089+0000","last_became_active":"2023-09-29T23:23:45.092902+0000","last_became_peered":"2023-09-29T23:23:45.092902+0000","last_unstale":"2023-09-29T23:23:45.451089+0000","last_undegraded":"2023-09-29T23:23:45.451089+0000","last_fullsized":"2023-09-29T23:23:45.451089+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470060+0000","last_change":"2023-09-29T23:23:45.466007+0000","last_active":"2023-09-29T23:23:45.470060+0000","last_peered":"2023-09-29T23:23:45.470060+0000","last_clean":"2023-09-29T23:23:45.470060+0000","last_became_active":"2023-09-29T23:23:45.465743+0000","last_became_peered":"2023-09-29T23:23:45.465743+0000","last_unstale":"2023-09-29T23:23:45.470060+0000","last_undegraded":"2023-09-29T23:23:45.470060+0000","last_fullsized":"2023-09-29T23:23:45.470060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.448899+0000","last_change":"2023-09-29T23:23:45.072234+0000","last_active":"2023-09-29T23:23:45.448899+0000","last_peered":"2023-09-29T23:23:45.448899+0000","last_clean":"2023-09-29T23:23:45.448899+0000","last_became_active":"2023-09-29T23:23:45.072009+0000","last_became_peered":"2023-09-29T23:23:45.072009+0000","last_unstale":"2023-09-29T23:23:45.448899+0000","last_undegraded":"2023-09-29T23:23:45.448899+0000","last_fullsized":"2023-09-29T23:23:45.448899+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471991+0000","last_change":"2023-09-29T23:23:45.466374+0000","last_active":"2023-09-29T23:23:45.471991+0000","last_peered":"2023-09-29T23:23:45.471991+0000","last_clean":"2023-09-29T23:23:45.471991+0000","last_became_active":"2023-09-29T23:23:45.466169+0000","last_became_peered":"2023-09-29T23:23:45.466169+0000","last_unstale":"2023-09-29T23:23:45.471991+0000","last_undegraded":"2023-09-29T23:23:45.471991+0000","last_fullsized":"2023-09-29T23:23:45.471991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475698+0000","last_change":"2023-09-29T23:23:45.091762+0000","last_active":"2023-09-29T23:23:45.475698+0000","last_peered":"2023-09-29T23:23:45.475698+0000","last_clean":"2023-09-29T23:23:45.475698+0000","last_became_active":"2023-09-29T23:23:45.091386+0000","last_became_peered":"2023-09-29T23:23:45.091386+0000","last_unstale":"2023-09-29T23:23:45.475698+0000","last_undegraded":"2023-09-29T23:23:45.475698+0000","last_fullsized":"2023-09-29T23:23:45.475698+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467101+0000","last_change":"2023-09-29T23:23:45.461421+0000","last_active":"2023-09-29T23:23:45.467101+0000","last_peered":"2023-09-29T23:23:45.467101+0000","last_clean":"2023-09-29T23:23:45.467101+0000","last_became_active":"2023-09-29T23:23:45.460643+0000","last_became_peered":"2023-09-29T23:23:45.460643+0000","last_unstale":"2023-09-29T23:23:45.467101+0000","last_undegraded":"2023-09-29T23:23:45.467101+0000","last_fullsized":"2023-09-29T23:23:45.467101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:12:32.105911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.480077+0000","last_change":"2023-09-29T23:23:45.078091+0000","last_active":"2023-09-29T23:23:45.480077+0000","last_peered":"2023-09-29T23:23:45.480077+0000","last_clean":"2023-09-29T23:23:45.480077+0000","last_became_active":"2023-09-29T23:23:45.077734+0000","last_became_peered":"2023-09-29T23:23:45.077734+0000","last_unstale":"2023-09-29T23:23:45.480077+0000","last_undegraded":"2023-09-29T23:23:45.480077+0000","last_fullsized":"2023-09-29T23:23:45.480077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:53.097532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470638+0000","last_change":"2023-09-29T23:23:45.467950+0000","last_active":"2023-09-29T23:23:45.470638+0000","last_peered":"2023-09-29T23:23:45.470638+0000","last_clean":"2023-09-29T23:23:45.470638+0000","last_became_active":"2023-09-29T23:23:45.467555+0000","last_became_peered":"2023-09-29T23:23:45.467555+0000","last_unstale":"2023-09-29T23:23:45.470638+0000","last_undegraded":"2023-09-29T23:23:45.470638+0000","last_fullsized":"2023-09-29T23:23:45.470638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474184+0000","last_change":"2023-09-29T23:23:45.092471+0000","last_active":"2023-09-29T23:23:45.474184+0000","last_peered":"2023-09-29T23:23:45.474184+0000","last_clean":"2023-09-29T23:23:45.474184+0000","last_became_active":"2023-09-29T23:23:45.092185+0000","last_became_peered":"2023-09-29T23:23:45.092185+0000","last_unstale":"2023-09-29T23:23:45.474184+0000","last_undegraded":"2023-09-29T23:23:45.474184+0000","last_fullsized":"2023-09-29T23:23:45.474184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472722+0000","last_change":"2023-09-29T23:23:45.464504+0000","last_active":"2023-09-29T23:23:45.472722+0000","last_peered":"2023-09-29T23:23:45.472722+0000","last_clean":"2023-09-29T23:23:45.472722+0000","last_became_active":"2023-09-29T23:23:45.463806+0000","last_became_peered":"2023-09-29T23:23:45.463806+0000","last_unstale":"2023-09-29T23:23:45.472722+0000","last_undegraded":"2023-09-29T23:23:45.472722+0000","last_fullsized":"2023-09-29T23:23:45.472722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:25:25.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475877+0000","last_change":"2023-09-29T23:23:45.088776+0000","last_active":"2023-09-29T23:23:45.475877+0000","last_peered":"2023-09-29T23:23:45.475877+0000","last_clean":"2023-09-29T23:23:45.475877+0000","last_became_active":"2023-09-29T23:23:45.088535+0000","last_became_peered":"2023-09-29T23:23:45.088535+0000","last_unstale":"2023-09-29T23:23:45.475877+0000","last_undegraded":"2023-09-29T23:23:45.475877+0000","last_fullsized":"2023-09-29T23:23:45.475877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:35:07.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473390+0000","last_change":"2023-09-29T23:23:45.466379+0000","last_active":"2023-09-29T23:23:45.473390+0000","last_peered":"2023-09-29T23:23:45.473390+0000","last_clean":"2023-09-29T23:23:45.473390+0000","last_became_active":"2023-09-29T23:23:45.465855+0000","last_became_peered":"2023-09-29T23:23:45.465855+0000","last_unstale":"2023-09-29T23:23:45.473390+0000","last_undegraded":"2023-09-29T23:23:45.473390+0000","last_fullsized":"2023-09-29T23:23:45.473390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:06.275738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.447311+0000","last_change":"2023-09-29T23:23:45.092714+0000","last_active":"2023-09-29T23:23:45.447311+0000","last_peered":"2023-09-29T23:23:45.447311+0000","last_clean":"2023-09-29T23:23:45.447311+0000","last_became_active":"2023-09-29T23:23:45.092476+0000","last_became_peered":"2023-09-29T23:23:45.092476+0000","last_unstale":"2023-09-29T23:23:45.447311+0000","last_undegraded":"2023-09-29T23:23:45.447311+0000","last_fullsized":"2023-09-29T23:23:45.447311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:20:23.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.469720+0000","last_change":"2023-09-29T23:23:45.467010+0000","last_active":"2023-09-29T23:23:45.469720+0000","last_peered":"2023-09-29T23:23:45.469720+0000","last_clean":"2023-09-29T23:23:45.469720+0000","last_became_active":"2023-09-29T23:23:45.466694+0000","last_became_peered":"2023-09-29T23:23:45.466694+0000","last_unstale":"2023-09-29T23:23:45.469720+0000","last_undegraded":"2023-09-29T23:23:45.469720+0000","last_fullsized":"2023-09-29T23:23:45.469720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.484451+0000","last_change":"2023-09-29T23:23:45.089622+0000","last_active":"2023-09-29T23:23:45.484451+0000","last_peered":"2023-09-29T23:23:45.484451+0000","last_clean":"2023-09-29T23:23:45.484451+0000","last_became_active":"2023-09-29T23:23:45.089176+0000","last_became_peered":"2023-09-29T23:23:45.089176+0000","last_unstale":"2023-09-29T23:23:45.484451+0000","last_undegraded":"2023-09-29T23:23:45.484451+0000","last_fullsized":"2023-09-29T23:23:45.484451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472323+0000","last_change":"2023-09-29T23:23:45.465798+0000","last_active":"2023-09-29T23:23:45.472323+0000","last_peered":"2023-09-29T23:23:45.472323+0000","last_clean":"2023-09-29T23:23:45.472323+0000","last_became_active":"2023-09-29T23:23:45.465127+0000","last_became_peered":"2023-09-29T23:23:45.465127+0000","last_unstale":"2023-09-29T23:23:45.472323+0000","last_undegraded":"2023-09-29T23:23:45.472323+0000","last_fullsized":"2023-09-29T23:23:45.472323+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:33.901646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450509+0000","last_change":"2023-09-29T23:23:45.075630+0000","last_active":"2023-09-29T23:23:45.450509+0000","last_peered":"2023-09-29T23:23:45.450509+0000","last_clean":"2023-09-29T23:23:45.450509+0000","last_became_active":"2023-09-29T23:23:45.075313+0000","last_became_peered":"2023-09-29T23:23:45.075313+0000","last_unstale":"2023-09-29T23:23:45.450509+0000","last_undegraded":"2023-09-29T23:23:45.450509+0000","last_fullsized":"2023-09-29T23:23:45.450509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:59:03.439349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470041+0000","last_change":"2023-09-29T23:23:45.465956+0000","last_active":"2023-09-29T23:23:45.470041+0000","last_peered":"2023-09-29T23:23:45.470041+0000","last_clean":"2023-09-29T23:23:45.470041+0000","last_became_active":"2023-09-29T23:23:45.465599+0000","last_became_peered":"2023-09-29T23:23:45.465599+0000","last_unstale":"2023-09-29T23:23:45.470041+0000","last_undegraded":"2023-09-29T23:23:45.470041+0000","last_fullsized":"2023-09-29T23:23:45.470041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:29:34.889615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450944+0000","last_change":"2023-09-29T23:23:45.075998+0000","last_active":"2023-09-29T23:23:45.450944+0000","last_peered":"2023-09-29T23:23:45.450944+0000","last_clean":"2023-09-29T23:23:45.450944+0000","last_became_active":"2023-09-29T23:23:45.075772+0000","last_became_peered":"2023-09-29T23:23:45.075772+0000","last_unstale":"2023-09-29T23:23:45.450944+0000","last_undegraded":"2023-09-29T23:23:45.450944+0000","last_fullsized":"2023-09-29T23:23:45.450944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:12:24.809572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.468582+0000","last_change":"2023-09-29T23:23:45.463124+0000","last_active":"2023-09-29T23:23:45.468582+0000","last_peered":"2023-09-29T23:23:45.468582+0000","last_clean":"2023-09-29T23:23:45.468582+0000","last_became_active":"2023-09-29T23:23:45.462583+0000","last_became_peered":"2023-09-29T23:23:45.462583+0000","last_unstale":"2023-09-29T23:23:45.468582+0000","last_undegraded":"2023-09-29T23:23:45.468582+0000","last_fullsized":"2023-09-29T23:23:45.468582+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:01:57.571277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.444191+0000","last_change":"2023-09-29T23:23:45.088750+0000","last_active":"2023-09-29T23:23:45.444191+0000","last_peered":"2023-09-29T23:23:45.444191+0000","last_clean":"2023-09-29T23:23:45.444191+0000","last_became_active":"2023-09-29T23:23:45.088506+0000","last_became_peered":"2023-09-29T23:23:45.088506+0000","last_unstale":"2023-09-29T23:23:45.444191+0000","last_undegraded":"2023-09-29T23:23:45.444191+0000","last_fullsized":"2023-09-29T23:23:45.444191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479465+0000","last_change":"2023-09-29T23:23:45.477617+0000","last_active":"2023-09-29T23:23:45.479465+0000","last_peered":"2023-09-29T23:23:45.479465+0000","last_clean":"2023-09-29T23:23:45.479465+0000","last_became_active":"2023-09-29T23:23:45.477335+0000","last_became_peered":"2023-09-29T23:23:45.477335+0000","last_unstale":"2023-09-29T23:23:45.479465+0000","last_undegraded":"2023-09-29T23:23:45.479465+0000","last_fullsized":"2023-09-29T23:23:45.479465+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:44:09.599636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.447044+0000","last_change":"2023-09-29T23:23:41.047954+0000","last_active":"2023-09-29T23:23:45.447044+0000","last_peered":"2023-09-29T23:23:45.447044+0000","last_clean":"2023-09-29T23:23:45.447044+0000","last_became_active":"2023-09-29T23:23:41.047701+0000","last_became_peered":"2023-09-29T23:23:41.047701+0000","last_unstale":"2023-09-29T23:23:45.447044+0000","last_undegraded":"2023-09-29T23:23:45.447044+0000","last_fullsized":"2023-09-29T23:23:45.447044+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:08:35.252580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:23:46.447573+0000","last_change":"2023-09-29T23:23:45.075607+0000","last_active":"2023-09-29T23:23:46.447573+0000","last_peered":"2023-09-29T23:23:46.447573+0000","last_clean":"2023-09-29T23:23:46.447573+0000","last_became_active":"2023-09-29T23:23:45.075249+0000","last_became_peered":"2023-09-29T23:23:45.075249+0000","last_unstale":"2023-09-29T23:23:46.447573+0000","last_undegraded":"2023-09-29T23:23:46.447573+0000","last_fullsized":"2023-09-29T23:23:46.447573+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:55:12.692421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.465404+0000","last_change":"2023-09-29T23:23:45.460164+0000","last_active":"2023-09-29T23:23:45.465404+0000","last_peered":"2023-09-29T23:23:45.465404+0000","last_clean":"2023-09-29T23:23:45.465404+0000","last_became_active":"2023-09-29T23:23:45.459933+0000","last_became_peered":"2023-09-29T23:23:45.459933+0000","last_unstale":"2023-09-29T23:23:45.465404+0000","last_undegraded":"2023-09-29T23:23:45.465404+0000","last_fullsized":"2023-09-29T23:23:45.465404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:25:22.017530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.453586+0000","last_change":"2023-09-29T23:23:41.051640+0000","last_active":"2023-09-29T23:23:45.453586+0000","last_peered":"2023-09-29T23:23:45.453586+0000","last_clean":"2023-09-29T23:23:45.453586+0000","last_became_active":"2023-09-29T23:23:41.051398+0000","last_became_peered":"2023-09-29T23:23:41.051398+0000","last_unstale":"2023-09-29T23:23:45.453586+0000","last_undegraded":"2023-09-29T23:23:45.453586+0000","last_fullsized":"2023-09-29T23:23:45.453586+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:49:47.548120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.476402+0000","last_change":"2023-09-29T23:23:45.076540+0000","last_active":"2023-09-29T23:23:45.476402+0000","last_peered":"2023-09-29T23:23:45.476402+0000","last_clean":"2023-09-29T23:23:45.476402+0000","last_became_active":"2023-09-29T23:23:45.076293+0000","last_became_peered":"2023-09-29T23:23:45.076293+0000","last_unstale":"2023-09-29T23:23:45.476402+0000","last_undegraded":"2023-09-29T23:23:45.476402+0000","last_fullsized":"2023-09-29T23:23:45.476402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:09.131795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474065+0000","last_change":"2023-09-29T23:23:45.466336+0000","last_active":"2023-09-29T23:23:45.474065+0000","last_peered":"2023-09-29T23:23:45.474065+0000","last_clean":"2023-09-29T23:23:45.474065+0000","last_became_active":"2023-09-29T23:23:45.466115+0000","last_became_peered":"2023-09-29T23:23:45.466115+0000","last_unstale":"2023-09-29T23:23:45.474065+0000","last_undegraded":"2023-09-29T23:23:45.474065+0000","last_fullsized":"2023-09-29T23:23:45.474065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:11.211646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450776+0000","last_change":"2023-09-29T23:23:41.050066+0000","last_active":"2023-09-29T23:23:45.450776+0000","last_peered":"2023-09-29T23:23:45.450776+0000","last_clean":"2023-09-29T23:23:45.450776+0000","last_became_active":"2023-09-29T23:23:41.049786+0000","last_became_peered":"2023-09-29T23:23:41.049786+0000","last_unstale":"2023-09-29T23:23:45.450776+0000","last_undegraded":"2023-09-29T23:23:45.450776+0000","last_fullsized":"2023-09-29T23:23:45.450776+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:22:54.699446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450066+0000","last_change":"2023-09-29T23:23:45.091590+0000","last_active":"2023-09-29T23:23:45.450066+0000","last_peered":"2023-09-29T23:23:45.450066+0000","last_clean":"2023-09-29T23:23:45.450066+0000","last_became_active":"2023-09-29T23:23:45.091162+0000","last_became_peered":"2023-09-29T23:23:45.091162+0000","last_unstale":"2023-09-29T23:23:45.450066+0000","last_undegraded":"2023-09-29T23:23:45.450066+0000","last_fullsized":"2023-09-29T23:23:45.450066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:29:38.240697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479301+0000","last_change":"2023-09-29T23:23:45.474238+0000","last_active":"2023-09-29T23:23:45.479301+0000","last_peered":"2023-09-29T23:23:45.479301+0000","last_clean":"2023-09-29T23:23:45.479301+0000","last_became_active":"2023-09-29T23:23:45.473861+0000","last_became_peered":"2023-09-29T23:23:45.473861+0000","last_unstale":"2023-09-29T23:23:45.479301+0000","last_undegraded":"2023-09-29T23:23:45.479301+0000","last_fullsized":"2023-09-29T23:23:45.479301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:39:43.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.451691+0000","last_change":"2023-09-29T23:23:41.049685+0000","last_active":"2023-09-29T23:23:45.451691+0000","last_peered":"2023-09-29T23:23:45.451691+0000","last_clean":"2023-09-29T23:23:45.451691+0000","last_became_active":"2023-09-29T23:23:41.049442+0000","last_became_peered":"2023-09-29T23:23:41.049442+0000","last_unstale":"2023-09-29T23:23:45.451691+0000","last_undegraded":"2023-09-29T23:23:45.451691+0000","last_fullsized":"2023-09-29T23:23:45.451691+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:52:33.065724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.446401+0000","last_change":"2023-09-29T23:23:45.092293+0000","last_active":"2023-09-29T23:23:45.446401+0000","last_peered":"2023-09-29T23:23:45.446401+0000","last_clean":"2023-09-29T23:23:45.446401+0000","last_became_active":"2023-09-29T23:23:45.092042+0000","last_became_peered":"2023-09-29T23:23:45.092042+0000","last_unstale":"2023-09-29T23:23:45.446401+0000","last_undegraded":"2023-09-29T23:23:45.446401+0000","last_fullsized":"2023-09-29T23:23:45.446401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:07:16.838088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.466547+0000","last_change":"2023-09-29T23:23:45.461917+0000","last_active":"2023-09-29T23:23:45.466547+0000","last_peered":"2023-09-29T23:23:45.466547+0000","last_clean":"2023-09-29T23:23:45.466547+0000","last_became_active":"2023-09-29T23:23:45.461228+0000","last_became_peered":"2023-09-29T23:23:45.461228+0000","last_unstale":"2023-09-29T23:23:45.466547+0000","last_undegraded":"2023-09-29T23:23:45.466547+0000","last_fullsized":"2023-09-29T23:23:45.466547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:54:19.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450606+0000","last_change":"2023-09-29T23:23:41.051041+0000","last_active":"2023-09-29T23:23:45.450606+0000","last_peered":"2023-09-29T23:23:45.450606+0000","last_clean":"2023-09-29T23:23:45.450606+0000","last_became_active":"2023-09-29T23:23:41.050731+0000","last_became_peered":"2023-09-29T23:23:41.050731+0000","last_unstale":"2023-09-29T23:23:45.450606+0000","last_undegraded":"2023-09-29T23:23:45.450606+0000","last_fullsized":"2023-09-29T23:23:45.450606+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:20.303147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450701+0000","last_change":"2023-09-29T23:23:45.088759+0000","last_active":"2023-09-29T23:23:45.450701+0000","last_peered":"2023-09-29T23:23:45.450701+0000","last_clean":"2023-09-29T23:23:45.450701+0000","last_became_active":"2023-09-29T23:23:45.088510+0000","last_became_peered":"2023-09-29T23:23:45.088510+0000","last_unstale":"2023-09-29T23:23:45.450701+0000","last_undegraded":"2023-09-29T23:23:45.450701+0000","last_fullsized":"2023-09-29T23:23:45.450701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:27:56.918672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.477404+0000","last_change":"2023-09-29T23:23:45.472092+0000","last_active":"2023-09-29T23:23:45.477404+0000","last_peered":"2023-09-29T23:23:45.477404+0000","last_clean":"2023-09-29T23:23:45.477404+0000","last_became_active":"2023-09-29T23:23:45.461672+0000","last_became_peered":"2023-09-29T23:23:45.461672+0000","last_unstale":"2023-09-29T23:23:45.477404+0000","last_undegraded":"2023-09-29T23:23:45.477404+0000","last_fullsized":"2023-09-29T23:23:45.477404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:58:16.565151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.446553+0000","last_change":"2023-09-29T23:23:41.047062+0000","last_active":"2023-09-29T23:23:45.446553+0000","last_peered":"2023-09-29T23:23:45.446553+0000","last_clean":"2023-09-29T23:23:45.446553+0000","last_became_active":"2023-09-29T23:23:41.046803+0000","last_became_peered":"2023-09-29T23:23:41.046803+0000","last_unstale":"2023-09-29T23:23:45.446553+0000","last_undegraded":"2023-09-29T23:23:45.446553+0000","last_fullsized":"2023-09-29T23:23:45.446553+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:22:14.657466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.451787+0000","last_change":"2023-09-29T23:23:45.073226+0000","last_active":"2023-09-29T23:23:45.451787+0000","last_peered":"2023-09-29T23:23:45.451787+0000","last_clean":"2023-09-29T23:23:45.451787+0000","last_became_active":"2023-09-29T23:23:45.072973+0000","last_became_peered":"2023-09-29T23:23:45.072973+0000","last_unstale":"2023-09-29T23:23:45.451787+0000","last_undegraded":"2023-09-29T23:23:45.451787+0000","last_fullsized":"2023-09-29T23:23:45.451787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:27:56.918672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479531+0000","last_change":"2023-09-29T23:23:45.477628+0000","last_active":"2023-09-29T23:23:45.479531+0000","last_peered":"2023-09-29T23:23:45.479531+0000","last_clean":"2023-09-29T23:23:45.479531+0000","last_became_active":"2023-09-29T23:23:45.474318+0000","last_became_peered":"2023-09-29T23:23:45.474318+0000","last_unstale":"2023-09-29T23:23:45.479531+0000","last_undegraded":"2023-09-29T23:23:45.479531+0000","last_fullsized":"2023-09-29T23:23:45.479531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:46:02.634499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.457485+0000","last_change":"2023-09-29T23:23:41.050883+0000","last_active":"2023-09-29T23:23:45.457485+0000","last_peered":"2023-09-29T23:23:45.457485+0000","last_clean":"2023-09-29T23:23:45.457485+0000","last_became_active":"2023-09-29T23:23:41.050639+0000","last_became_peered":"2023-09-29T23:23:41.050639+0000","last_unstale":"2023-09-29T23:23:45.457485+0000","last_undegraded":"2023-09-29T23:23:45.457485+0000","last_fullsized":"2023-09-29T23:23:45.457485+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:35:26.897753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.457867+0000","last_change":"2023-09-29T23:23:45.077040+0000","last_active":"2023-09-29T23:23:45.457867+0000","last_peered":"2023-09-29T23:23:45.457867+0000","last_clean":"2023-09-29T23:23:45.457867+0000","last_became_active":"2023-09-29T23:23:45.076806+0000","last_became_peered":"2023-09-29T23:23:45.076806+0000","last_unstale":"2023-09-29T23:23:45.457867+0000","last_undegraded":"2023-09-29T23:23:45.457867+0000","last_fullsized":"2023-09-29T23:23:45.457867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:26:19.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.463631+0000","last_change":"2023-09-29T23:23:45.462067+0000","last_active":"2023-09-29T23:23:45.463631+0000","last_peered":"2023-09-29T23:23:45.463631+0000","last_clean":"2023-09-29T23:23:45.463631+0000","last_became_active":"2023-09-29T23:23:45.460913+0000","last_became_peered":"2023-09-29T23:23:45.460913+0000","last_unstale":"2023-09-29T23:23:45.463631+0000","last_undegraded":"2023-09-29T23:23:45.463631+0000","last_fullsized":"2023-09-29T23:23:45.463631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:06.275738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.458336+0000","last_change":"2023-09-29T23:23:41.050074+0000","last_active":"2023-09-29T23:23:45.458336+0000","last_peered":"2023-09-29T23:23:45.458336+0000","last_clean":"2023-09-29T23:23:45.458336+0000","last_became_active":"2023-09-29T23:23:41.049783+0000","last_became_peered":"2023-09-29T23:23:41.049783+0000","last_unstale":"2023-09-29T23:23:45.458336+0000","last_undegraded":"2023-09-29T23:23:45.458336+0000","last_fullsized":"2023-09-29T23:23:45.458336+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:37:01.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.453746+0000","last_change":"2023-09-29T23:23:45.076087+0000","last_active":"2023-09-29T23:23:45.453746+0000","last_peered":"2023-09-29T23:23:45.453746+0000","last_clean":"2023-09-29T23:23:45.453746+0000","last_became_active":"2023-09-29T23:23:45.075273+0000","last_became_peered":"2023-09-29T23:23:45.075273+0000","last_unstale":"2023-09-29T23:23:45.453746+0000","last_undegraded":"2023-09-29T23:23:45.453746+0000","last_fullsized":"2023-09-29T23:23:45.453746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:27.356997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.466914+0000","last_change":"2023-09-29T23:23:45.459071+0000","last_active":"2023-09-29T23:23:45.466914+0000","last_peered":"2023-09-29T23:23:45.466914+0000","last_clean":"2023-09-29T23:23:45.466914+0000","last_became_active":"2023-09-29T23:23:45.458250+0000","last_became_peered":"2023-09-29T23:23:45.458250+0000","last_unstale":"2023-09-29T23:23:45.466914+0000","last_undegraded":"2023-09-29T23:23:45.466914+0000","last_fullsized":"2023-09-29T23:23:45.466914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.478408+0000","last_change":"2023-09-29T23:23:45.076932+0000","last_active":"2023-09-29T23:23:45.478408+0000","last_peered":"2023-09-29T23:23:45.478408+0000","last_clean":"2023-09-29T23:23:45.478408+0000","last_became_active":"2023-09-29T23:23:45.076638+0000","last_became_peered":"2023-09-29T23:23:45.076638+0000","last_unstale":"2023-09-29T23:23:45.478408+0000","last_undegraded":"2023-09-29T23:23:45.478408+0000","last_fullsized":"2023-09-29T23:23:45.478408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:35:07.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472138+0000","last_change":"2023-09-29T23:23:45.471332+0000","last_active":"2023-09-29T23:23:45.472138+0000","last_peered":"2023-09-29T23:23:45.472138+0000","last_clean":"2023-09-29T23:23:45.472138+0000","last_became_active":"2023-09-29T23:23:45.471013+0000","last_became_peered":"2023-09-29T23:23:45.471013+0000","last_unstale":"2023-09-29T23:23:45.472138+0000","last_undegraded":"2023-09-29T23:23:45.472138+0000","last_fullsized":"2023-09-29T23:23:45.472138+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479907+0000","last_change":"2023-09-29T23:23:45.076405+0000","last_active":"2023-09-29T23:23:45.479907+0000","last_peered":"2023-09-29T23:23:45.479907+0000","last_clean":"2023-09-29T23:23:45.479907+0000","last_became_active":"2023-09-29T23:23:45.076191+0000","last_became_peered":"2023-09-29T23:23:45.076191+0000","last_unstale":"2023-09-29T23:23:45.479907+0000","last_undegraded":"2023-09-29T23:23:45.479907+0000","last_fullsized":"2023-09-29T23:23:45.479907+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:20:23.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.477541+0000","last_change":"2023-09-29T23:23:45.471929+0000","last_active":"2023-09-29T23:23:45.477541+0000","last_peered":"2023-09-29T23:23:45.477541+0000","last_clean":"2023-09-29T23:23:45.477541+0000","last_became_active":"2023-09-29T23:23:45.471673+0000","last_became_peered":"2023-09-29T23:23:45.471673+0000","last_unstale":"2023-09-29T23:23:45.477541+0000","last_undegraded":"2023-09-29T23:23:45.477541+0000","last_fullsized":"2023-09-29T23:23:45.477541+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474262+0000","last_change":"2023-09-29T23:23:45.092434+0000","last_active":"2023-09-29T23:23:45.474262+0000","last_peered":"2023-09-29T23:23:45.474262+0000","last_clean":"2023-09-29T23:23:45.474262+0000","last_became_active":"2023-09-29T23:23:45.092203+0000","last_became_peered":"2023-09-29T23:23:45.092203+0000","last_unstale":"2023-09-29T23:23:45.474262+0000","last_undegraded":"2023-09-29T23:23:45.474262+0000","last_fullsized":"2023-09-29T23:23:45.474262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472769+0000","last_change":"2023-09-29T23:23:45.464734+0000","last_active":"2023-09-29T23:23:45.472769+0000","last_peered":"2023-09-29T23:23:45.472769+0000","last_clean":"2023-09-29T23:23:45.472769+0000","last_became_active":"2023-09-29T23:23:45.464202+0000","last_became_peered":"2023-09-29T23:23:45.464202+0000","last_unstale":"2023-09-29T23:23:45.472769+0000","last_undegraded":"2023-09-29T23:23:45.472769+0000","last_fullsized":"2023-09-29T23:23:45.472769+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:59:25.888959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.480111+0000","last_change":"2023-09-29T23:23:45.074017+0000","last_active":"2023-09-29T23:23:45.480111+0000","last_peered":"2023-09-29T23:23:45.480111+0000","last_clean":"2023-09-29T23:23:45.480111+0000","last_became_active":"2023-09-29T23:23:45.073772+0000","last_became_peered":"2023-09-29T23:23:45.073772+0000","last_unstale":"2023-09-29T23:23:45.480111+0000","last_undegraded":"2023-09-29T23:23:45.480111+0000","last_fullsized":"2023-09-29T23:23:45.480111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467384+0000","last_change":"2023-09-29T23:23:45.460786+0000","last_active":"2023-09-29T23:23:45.467384+0000","last_peered":"2023-09-29T23:23:45.467384+0000","last_clean":"2023-09-29T23:23:45.467384+0000","last_became_active":"2023-09-29T23:23:45.460548+0000","last_became_peered":"2023-09-29T23:23:45.460548+0000","last_unstale":"2023-09-29T23:23:45.467384+0000","last_undegraded":"2023-09-29T23:23:45.467384+0000","last_fullsized":"2023-09-29T23:23:45.467384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:09:25.160546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473995+0000","last_change":"2023-09-29T23:23:45.471512+0000","last_active":"2023-09-29T23:23:45.473995+0000","last_peered":"2023-09-29T23:23:45.473995+0000","last_clean":"2023-09-29T23:23:45.473995+0000","last_became_active":"2023-09-29T23:23:45.471294+0000","last_became_peered":"2023-09-29T23:23:45.471294+0000","last_unstale":"2023-09-29T23:23:45.473995+0000","last_undegraded":"2023-09-29T23:23:45.473995+0000","last_fullsized":"2023-09-29T23:23:45.473995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:29:14.066786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467135+0000","last_change":"2023-09-29T23:23:45.462314+0000","last_active":"2023-09-29T23:23:45.467135+0000","last_peered":"2023-09-29T23:23:45.467135+0000","last_clean":"2023-09-29T23:23:45.467135+0000","last_became_active":"2023-09-29T23:23:45.461188+0000","last_became_peered":"2023-09-29T23:23:45.461188+0000","last_unstale":"2023-09-29T23:23:45.467135+0000","last_undegraded":"2023-09-29T23:23:45.467135+0000","last_fullsized":"2023-09-29T23:23:45.467135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:01:06.913634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479183+0000","last_change":"2023-09-29T23:23:45.473685+0000","last_active":"2023-09-29T23:23:45.479183+0000","last_peered":"2023-09-29T23:23:45.479183+0000","last_clean":"2023-09-29T23:23:45.479183+0000","last_became_active":"2023-09-29T23:23:45.473438+0000","last_became_peered":"2023-09-29T23:23:45.473438+0000","last_unstale":"2023-09-29T23:23:45.479183+0000","last_undegraded":"2023-09-29T23:23:45.479183+0000","last_fullsized":"2023-09-29T23:23:45.479183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:39:59.923188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479548+0000","last_change":"2023-09-29T23:23:45.477880+0000","last_active":"2023-09-29T23:23:45.479548+0000","last_peered":"2023-09-29T23:23:45.479548+0000","last_clean":"2023-09-29T23:23:45.479548+0000","last_became_active":"2023-09-29T23:23:45.474163+0000","last_became_peered":"2023-09-29T23:23:45.474163+0000","last_unstale":"2023-09-29T23:23:45.479548+0000","last_undegraded":"2023-09-29T23:23:45.479548+0000","last_fullsized":"2023-09-29T23:23:45.479548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:40:09.175714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479092+0000","last_change":"2023-09-29T23:23:45.473292+0000","last_active":"2023-09-29T23:23:45.479092+0000","last_peered":"2023-09-29T23:23:45.479092+0000","last_clean":"2023-09-29T23:23:45.479092+0000","last_became_active":"2023-09-29T23:23:45.473063+0000","last_became_peered":"2023-09-29T23:23:45.473063+0000","last_unstale":"2023-09-29T23:23:45.479092+0000","last_undegraded":"2023-09-29T23:23:45.479092+0000","last_fullsized":"2023-09-29T23:23:45.479092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:06:47.738713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.464396+0000","last_change":"2023-09-29T23:23:45.463712+0000","last_active":"2023-09-29T23:23:45.464396+0000","last_peered":"2023-09-29T23:23:45.464396+0000","last_clean":"2023-09-29T23:23:45.464396+0000","last_became_active":"2023-09-29T23:23:45.463269+0000","last_became_peered":"2023-09-29T23:23:45.463269+0000","last_unstale":"2023-09-29T23:23:45.464396+0000","last_undegraded":"2023-09-29T23:23:45.464396+0000","last_fullsized":"2023-09-29T23:23:45.464396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:32.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5556,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852044,"statfs":{"total":107374182400,"available":107368493056,"internally_reserved":0,"allocated":176128,"data_stored":46822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]}]},{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5484,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":104852116,"statfs":{"total":107374182400,"available":107368566784,"internally_reserved":0,"allocated":167936,"data_stored":46190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5544,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852056,"statfs":{"total":107374182400,"available":107368505344,"internally_reserved":0,"allocated":163840,"data_stored":45250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-29T23:23:57.665 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:23:57.814 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.812+0000 7f6faa4f4700 1 Processor -- start 2023-09-29T23:23:57.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.812+0000 7f6faa4f4700 1 -- start start 2023-09-29T23:23:57.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.813+0000 7f6faa4f4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6fa406a040 0x7f6fa4134560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:57.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.813+0000 7f6faa4f4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa40a1580 con 0x7f6fa406f210 2023-09-29T23:23:57.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.813+0000 7f6faa4f4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa406f5e0 con 0x7f6fa406a040 2023-09-29T23:23:57.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.813+0000 7f6fa37fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6fa406a040 0x7f6fa4134560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:57.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.813+0000 7f6fa3fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f6fa406f210 0x7f6fa4069930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54726/0 (socket says 172.21.15.92:54726) 2023-09-29T23:23:57.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.813+0000 7f6fa3fff700 1 -- 172.21.15.92:0/1534610498 learned_addr learned my addr 172.21.15.92:0/1534610498 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:57.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.813+0000 7f6fa37fe700 1 -- 172.21.15.92:0/1534610498 >> v1:172.21.15.92:6789/0 conn(0x7f6fa406f210 legacy=0x7f6fa4069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:57.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.813+0000 7f6fa2ffd700 1 -- 172.21.15.92:0/1534610498 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277408962 0 0) 0x7f6fa40a1580 con 0x7f6fa406f210 2023-09-29T23:23:57.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.813+0000 7f6fa37fe700 1 -- 172.21.15.92:0/1534610498 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa409cc70 con 0x7f6fa406a040 2023-09-29T23:23:57.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.813+0000 7f6fa37fe700 1 --2- 172.21.15.92:0/1534610498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fa406a040 0x7f6fa4134560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009860 tx=0x7f6f980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d14654d57bc5062 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:57.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.814+0000 7f6fa2ffd700 1 -- 172.21.15.92:0/1534610498 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f9800b680 con 0x7f6fa406a040 2023-09-29T23:23:57.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.814+0000 7f6fa2ffd700 1 -- 172.21.15.92:0/1534610498 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9800b7e0 con 0x7f6fa406a040 2023-09-29T23:23:57.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.814+0000 7f6fa2ffd700 1 -- 172.21.15.92:0/1534610498 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f9800bad0 con 0x7f6fa406a040 2023-09-29T23:23:57.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.814+0000 7f6faa4f4700 1 -- 172.21.15.92:0/1534610498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fa406a040 msgr2=0x7f6fa4134560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:57.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.814+0000 7f6faa4f4700 1 --2- 172.21.15.92:0/1534610498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fa406a040 0x7f6fa4134560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009860 tx=0x7f6f980091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:57.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.814+0000 7f6faa4f4700 1 -- 172.21.15.92:0/1534610498 shutdown_connections 2023-09-29T23:23:57.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.814+0000 7f6faa4f4700 1 --2- 172.21.15.92:0/1534610498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fa406a040 0x7f6fa4134560 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:57.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.814+0000 7f6faa4f4700 1 -- 172.21.15.92:0/1534610498 >> 172.21.15.92:0/1534610498 conn(0x7f6fa4094a70 msgr2=0x7f6fa406eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:57.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.814+0000 7f6faa4f4700 1 -- 172.21.15.92:0/1534610498 shutdown_connections 2023-09-29T23:23:57.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.814+0000 7f6faa4f4700 1 -- 172.21.15.92:0/1534610498 wait complete. 2023-09-29T23:23:57.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.815+0000 7f6faa4f4700 1 Processor -- start 2023-09-29T23:23:57.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.815+0000 7f6faa4f4700 1 -- start start 2023-09-29T23:23:57.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.815+0000 7f6faa4f4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fa406a040 0x7f6fa4116f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:57.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.815+0000 7f6faa4f4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa411b130 con 0x7f6fa406a040 2023-09-29T23:23:57.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.815+0000 7f6fa3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fa406a040 0x7f6fa4116f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:57.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.816+0000 7f6fa3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fa406a040 0x7f6fa4116f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49286/0 (socket says 172.21.15.92:49286) 2023-09-29T23:23:57.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.816+0000 7f6fa3fff700 1 -- 172.21.15.92:0/2735807744 learned_addr learned my addr 172.21.15.92:0/2735807744 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:57.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.816+0000 7f6fa3fff700 1 -- 172.21.15.92:0/2735807744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98009420 con 0x7f6fa406a040 2023-09-29T23:23:57.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.816+0000 7f6fa3fff700 1 --2- 172.21.15.92:0/2735807744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fa406a040 0x7f6fa4116f20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400c710 tx=0x7f6f94007c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:57.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.816+0000 7f6f8bfff700 1 -- 172.21.15.92:0/2735807744 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f94007610 con 0x7f6fa406a040 2023-09-29T23:23:57.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.816+0000 7f6f8bfff700 1 -- 172.21.15.92:0/2735807744 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f940057f0 con 0x7f6fa406a040 2023-09-29T23:23:57.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.816+0000 7f6f8bfff700 1 -- 172.21.15.92:0/2735807744 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f94005ae0 con 0x7f6fa406a040 2023-09-29T23:23:57.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.816+0000 7f6faa4f4700 1 -- 172.21.15.92:0/2735807744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa4118320 con 0x7f6fa406a040 2023-09-29T23:23:57.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.816+0000 7f6faa4f4700 1 -- 172.21.15.92:0/2735807744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa411b440 con 0x7f6fa406a040 2023-09-29T23:23:57.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.817+0000 7f6f8bfff700 1 -- 172.21.15.92:0/2735807744 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f6f94005c40 con 0x7f6fa406a040 2023-09-29T23:23:57.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.817+0000 7f6faa4f4700 1 -- 172.21.15.92:0/2735807744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa412cde0 con 0x7f6fa406a040 2023-09-29T23:23:57.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.817+0000 7f6f8bfff700 1 --2- 172.21.15.92:0/2735807744 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6f90035640 0x7f6f90037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:57.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.817+0000 7f6f8bfff700 1 -- 172.21.15.92:0/2735807744 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f6f94046a70 con 0x7f6fa406a040 2023-09-29T23:23:57.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.817+0000 7f6fa37fe700 1 --2- 172.21.15.92:0/2735807744 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6f90035640 0x7f6f90037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:57.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.817+0000 7f6fa37fe700 1 --2- 172.21.15.92:0/2735807744 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6f90035640 0x7f6f90037af0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6f98006eb0 tx=0x7f6f98016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:57.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.822+0000 7f6f8bfff700 1 -- 172.21.15.92:0/2735807744 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f94018a40 con 0x7f6fa406a040 2023-09-29T23:23:57.999 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:57.998+0000 7f6faa4f4700 1 -- 172.21.15.92:0/2735807744 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6fa411b280 con 0x7f6f90035640 2023-09-29T23:23:58.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.005+0000 7f6f8bfff700 1 -- 172.21.15.92:0/2735807744 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+262467 (secure 0 0 0) 0x7f6fa411b280 con 0x7f6f90035640 2023-09-29T23:23:58.008 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:58.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.009+0000 7f6faa4f4700 1 -- 172.21.15.92:0/2735807744 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6f90035640 msgr2=0x7f6f90037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:58.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.009+0000 7f6faa4f4700 1 --2- 172.21.15.92:0/2735807744 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6f90035640 0x7f6f90037af0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6f98006eb0 tx=0x7f6f98016000 comp rx=0 tx=0).stop 2023-09-29T23:23:58.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.009+0000 7f6faa4f4700 1 -- 172.21.15.92:0/2735807744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fa406a040 msgr2=0x7f6fa4116f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:58.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.009+0000 7f6faa4f4700 1 --2- 172.21.15.92:0/2735807744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fa406a040 0x7f6fa4116f20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400c710 tx=0x7f6f94007c00 comp rx=0 tx=0).stop 2023-09-29T23:23:58.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.009+0000 7f6faa4f4700 1 -- 172.21.15.92:0/2735807744 shutdown_connections 2023-09-29T23:23:58.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.009+0000 7f6faa4f4700 1 --2- 172.21.15.92:0/2735807744 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6f90035640 0x7f6f90037af0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:58.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.009+0000 7f6faa4f4700 1 --2- 172.21.15.92:0/2735807744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fa406a040 0x7f6fa4116f20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:58.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.009+0000 7f6faa4f4700 1 -- 172.21.15.92:0/2735807744 >> 172.21.15.92:0/2735807744 conn(0x7f6fa4094a70 msgr2=0x7f6fa412ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:58.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.009+0000 7f6faa4f4700 1 -- 172.21.15.92:0/2735807744 shutdown_connections 2023-09-29T23:23:58.011 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.009+0000 7f6faa4f4700 1 -- 172.21.15.92:0/2735807744 wait complete. 2023-09-29T23:23:58.012 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-09-29T23:23:58.021 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-09-29T23:23:56.037339+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":208,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":16584,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":16064,"kb_avail":314556216,"statfs":{"total":322122547200,"available":322105565184,"internally_reserved":0,"allocated":507904,"data_stored":138262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16449536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":770,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001892"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473355+0000","last_change":"2023-09-29T23:23:45.465624+0000","last_active":"2023-09-29T23:23:45.473355+0000","last_peered":"2023-09-29T23:23:45.473355+0000","last_clean":"2023-09-29T23:23:45.473355+0000","last_became_active":"2023-09-29T23:23:45.464271+0000","last_became_peered":"2023-09-29T23:23:45.464271+0000","last_unstale":"2023-09-29T23:23:45.473355+0000","last_undegraded":"2023-09-29T23:23:45.473355+0000","last_fullsized":"2023-09-29T23:23:45.473355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:54:19.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.469593+0000","last_change":"2023-09-29T23:23:45.466587+0000","last_active":"2023-09-29T23:23:45.469593+0000","last_peered":"2023-09-29T23:23:45.469593+0000","last_clean":"2023-09-29T23:23:45.469593+0000","last_became_active":"2023-09-29T23:23:45.466338+0000","last_became_peered":"2023-09-29T23:23:45.466338+0000","last_unstale":"2023-09-29T23:23:45.469593+0000","last_undegraded":"2023-09-29T23:23:45.469593+0000","last_fullsized":"2023-09-29T23:23:45.469593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479450+0000","last_change":"2023-09-29T23:23:45.477248+0000","last_active":"2023-09-29T23:23:45.479450+0000","last_peered":"2023-09-29T23:23:45.479450+0000","last_clean":"2023-09-29T23:23:45.479450+0000","last_became_active":"2023-09-29T23:23:45.474129+0000","last_became_peered":"2023-09-29T23:23:45.474129+0000","last_unstale":"2023-09-29T23:23:45.479450+0000","last_undegraded":"2023-09-29T23:23:45.479450+0000","last_fullsized":"2023-09-29T23:23:45.479450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:09:27.600159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474474+0000","last_change":"2023-09-29T23:23:45.471200+0000","last_active":"2023-09-29T23:23:45.474474+0000","last_peered":"2023-09-29T23:23:45.474474+0000","last_clean":"2023-09-29T23:23:45.474474+0000","last_became_active":"2023-09-29T23:23:45.470971+0000","last_became_peered":"2023-09-29T23:23:45.470971+0000","last_unstale":"2023-09-29T23:23:45.474474+0000","last_undegraded":"2023-09-29T23:23:45.474474+0000","last_fullsized":"2023-09-29T23:23:45.474474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:29:34.531515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479230+0000","last_change":"2023-09-29T23:23:45.473831+0000","last_active":"2023-09-29T23:23:45.479230+0000","last_peered":"2023-09-29T23:23:45.479230+0000","last_clean":"2023-09-29T23:23:45.479230+0000","last_became_active":"2023-09-29T23:23:45.473570+0000","last_became_peered":"2023-09-29T23:23:45.473570+0000","last_unstale":"2023-09-29T23:23:45.479230+0000","last_undegraded":"2023-09-29T23:23:45.479230+0000","last_fullsized":"2023-09-29T23:23:45.479230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:51:36.401360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472105+0000","last_change":"2023-09-29T23:23:45.470583+0000","last_active":"2023-09-29T23:23:45.472105+0000","last_peered":"2023-09-29T23:23:45.472105+0000","last_clean":"2023-09-29T23:23:45.472105+0000","last_became_active":"2023-09-29T23:23:45.470349+0000","last_became_peered":"2023-09-29T23:23:45.470349+0000","last_unstale":"2023-09-29T23:23:45.472105+0000","last_undegraded":"2023-09-29T23:23:45.472105+0000","last_fullsized":"2023-09-29T23:23:45.472105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:50:32.868236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473871+0000","last_change":"2023-09-29T23:23:45.465376+0000","last_active":"2023-09-29T23:23:45.473871+0000","last_peered":"2023-09-29T23:23:45.473871+0000","last_clean":"2023-09-29T23:23:45.473871+0000","last_became_active":"2023-09-29T23:23:45.464893+0000","last_became_peered":"2023-09-29T23:23:45.464893+0000","last_unstale":"2023-09-29T23:23:45.473871+0000","last_undegraded":"2023-09-29T23:23:45.473871+0000","last_fullsized":"2023-09-29T23:23:45.473871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:34:22.460877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.469721+0000","last_change":"2023-09-29T23:23:45.463286+0000","last_active":"2023-09-29T23:23:45.469721+0000","last_peered":"2023-09-29T23:23:45.469721+0000","last_clean":"2023-09-29T23:23:45.469721+0000","last_became_active":"2023-09-29T23:23:45.462888+0000","last_became_peered":"2023-09-29T23:23:45.462888+0000","last_unstale":"2023-09-29T23:23:45.469721+0000","last_undegraded":"2023-09-29T23:23:45.469721+0000","last_fullsized":"2023-09-29T23:23:45.469721+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470175+0000","last_change":"2023-09-29T23:23:45.468860+0000","last_active":"2023-09-29T23:23:45.470175+0000","last_peered":"2023-09-29T23:23:45.470175+0000","last_clean":"2023-09-29T23:23:45.470175+0000","last_became_active":"2023-09-29T23:23:45.468303+0000","last_became_peered":"2023-09-29T23:23:45.468303+0000","last_unstale":"2023-09-29T23:23:45.470175+0000","last_undegraded":"2023-09-29T23:23:45.470175+0000","last_fullsized":"2023-09-29T23:23:45.470175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:34:22.460877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479380+0000","last_change":"2023-09-29T23:23:45.475091+0000","last_active":"2023-09-29T23:23:45.479380+0000","last_peered":"2023-09-29T23:23:45.479380+0000","last_clean":"2023-09-29T23:23:45.479380+0000","last_became_active":"2023-09-29T23:23:45.474757+0000","last_became_peered":"2023-09-29T23:23:45.474757+0000","last_unstale":"2023-09-29T23:23:45.479380+0000","last_undegraded":"2023-09-29T23:23:45.479380+0000","last_fullsized":"2023-09-29T23:23:45.479380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:59:29.779691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473519+0000","last_change":"2023-09-29T23:23:45.467858+0000","last_active":"2023-09-29T23:23:45.473519+0000","last_peered":"2023-09-29T23:23:45.473519+0000","last_clean":"2023-09-29T23:23:45.473519+0000","last_became_active":"2023-09-29T23:23:45.464083+0000","last_became_peered":"2023-09-29T23:23:45.464083+0000","last_unstale":"2023-09-29T23:23:45.473519+0000","last_undegraded":"2023-09-29T23:23:45.473519+0000","last_fullsized":"2023-09-29T23:23:45.473519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:30:57.865969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473409+0000","last_change":"2023-09-29T23:23:45.466588+0000","last_active":"2023-09-29T23:23:45.473409+0000","last_peered":"2023-09-29T23:23:45.473409+0000","last_clean":"2023-09-29T23:23:45.473409+0000","last_became_active":"2023-09-29T23:23:45.466161+0000","last_became_peered":"2023-09-29T23:23:45.466161+0000","last_unstale":"2023-09-29T23:23:45.473409+0000","last_undegraded":"2023-09-29T23:23:45.473409+0000","last_fullsized":"2023-09-29T23:23:45.473409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:13.284557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473383+0000","last_change":"2023-09-29T23:23:45.467402+0000","last_active":"2023-09-29T23:23:45.473383+0000","last_peered":"2023-09-29T23:23:45.473383+0000","last_clean":"2023-09-29T23:23:45.473383+0000","last_became_active":"2023-09-29T23:23:45.467178+0000","last_became_peered":"2023-09-29T23:23:45.467178+0000","last_unstale":"2023-09-29T23:23:45.473383+0000","last_undegraded":"2023-09-29T23:23:45.473383+0000","last_fullsized":"2023-09-29T23:23:45.473383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472302+0000","last_change":"2023-09-29T23:23:45.465231+0000","last_active":"2023-09-29T23:23:45.472302+0000","last_peered":"2023-09-29T23:23:45.472302+0000","last_clean":"2023-09-29T23:23:45.472302+0000","last_became_active":"2023-09-29T23:23:45.464523+0000","last_became_peered":"2023-09-29T23:23:45.464523+0000","last_unstale":"2023-09-29T23:23:45.472302+0000","last_undegraded":"2023-09-29T23:23:45.472302+0000","last_fullsized":"2023-09-29T23:23:45.472302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:32.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471955+0000","last_change":"2023-09-29T23:23:45.470349+0000","last_active":"2023-09-29T23:23:45.471955+0000","last_peered":"2023-09-29T23:23:45.471955+0000","last_clean":"2023-09-29T23:23:45.471955+0000","last_became_active":"2023-09-29T23:23:45.467004+0000","last_became_peered":"2023-09-29T23:23:45.467004+0000","last_unstale":"2023-09-29T23:23:45.471955+0000","last_undegraded":"2023-09-29T23:23:45.471955+0000","last_fullsized":"2023-09-29T23:23:45.471955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474011+0000","last_change":"2023-09-29T23:23:45.471536+0000","last_active":"2023-09-29T23:23:45.474011+0000","last_peered":"2023-09-29T23:23:45.474011+0000","last_clean":"2023-09-29T23:23:45.474011+0000","last_became_active":"2023-09-29T23:23:45.471334+0000","last_became_peered":"2023-09-29T23:23:45.471334+0000","last_unstale":"2023-09-29T23:23:45.474011+0000","last_undegraded":"2023-09-29T23:23:45.474011+0000","last_fullsized":"2023-09-29T23:23:45.474011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470193+0000","last_change":"2023-09-29T23:23:45.468857+0000","last_active":"2023-09-29T23:23:45.470193+0000","last_peered":"2023-09-29T23:23:45.470193+0000","last_clean":"2023-09-29T23:23:45.470193+0000","last_became_active":"2023-09-29T23:23:45.468001+0000","last_became_peered":"2023-09-29T23:23:45.468001+0000","last_unstale":"2023-09-29T23:23:45.470193+0000","last_undegraded":"2023-09-29T23:23:45.470193+0000","last_fullsized":"2023-09-29T23:23:45.470193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:11.211646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470618+0000","last_change":"2023-09-29T23:23:45.467819+0000","last_active":"2023-09-29T23:23:45.470618+0000","last_peered":"2023-09-29T23:23:45.470618+0000","last_clean":"2023-09-29T23:23:45.470618+0000","last_became_active":"2023-09-29T23:23:45.467434+0000","last_became_peered":"2023-09-29T23:23:45.467434+0000","last_unstale":"2023-09-29T23:23:45.470618+0000","last_undegraded":"2023-09-29T23:23:45.470618+0000","last_fullsized":"2023-09-29T23:23:45.470618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479225+0000","last_change":"2023-09-29T23:23:45.473751+0000","last_active":"2023-09-29T23:23:45.479225+0000","last_peered":"2023-09-29T23:23:45.479225+0000","last_clean":"2023-09-29T23:23:45.479225+0000","last_became_active":"2023-09-29T23:23:45.473326+0000","last_became_peered":"2023-09-29T23:23:45.473326+0000","last_unstale":"2023-09-29T23:23:45.479225+0000","last_undegraded":"2023-09-29T23:23:45.479225+0000","last_fullsized":"2023-09-29T23:23:45.479225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:21:17.261104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473427+0000","last_change":"2023-09-29T23:23:45.467719+0000","last_active":"2023-09-29T23:23:45.473427+0000","last_peered":"2023-09-29T23:23:45.473427+0000","last_clean":"2023-09-29T23:23:45.473427+0000","last_became_active":"2023-09-29T23:23:45.467494+0000","last_became_peered":"2023-09-29T23:23:45.467494+0000","last_unstale":"2023-09-29T23:23:45.473427+0000","last_undegraded":"2023-09-29T23:23:45.473427+0000","last_fullsized":"2023-09-29T23:23:45.473427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479563+0000","last_change":"2023-09-29T23:23:45.478055+0000","last_active":"2023-09-29T23:23:45.479563+0000","last_peered":"2023-09-29T23:23:45.479563+0000","last_clean":"2023-09-29T23:23:45.479563+0000","last_became_active":"2023-09-29T23:23:45.477408+0000","last_became_peered":"2023-09-29T23:23:45.477408+0000","last_unstale":"2023-09-29T23:23:45.479563+0000","last_undegraded":"2023-09-29T23:23:45.479563+0000","last_fullsized":"2023-09-29T23:23:45.479563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:14:56.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474548+0000","last_change":"2023-09-29T23:23:45.471232+0000","last_active":"2023-09-29T23:23:45.474548+0000","last_peered":"2023-09-29T23:23:45.474548+0000","last_clean":"2023-09-29T23:23:45.474548+0000","last_became_active":"2023-09-29T23:23:45.470574+0000","last_became_peered":"2023-09-29T23:23:45.470574+0000","last_unstale":"2023-09-29T23:23:45.474548+0000","last_undegraded":"2023-09-29T23:23:45.474548+0000","last_fullsized":"2023-09-29T23:23:45.474548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:25:25.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479248+0000","last_change":"2023-09-29T23:23:45.474093+0000","last_active":"2023-09-29T23:23:45.479248+0000","last_peered":"2023-09-29T23:23:45.479248+0000","last_clean":"2023-09-29T23:23:45.479248+0000","last_became_active":"2023-09-29T23:23:45.473789+0000","last_became_peered":"2023-09-29T23:23:45.473789+0000","last_unstale":"2023-09-29T23:23:45.479248+0000","last_undegraded":"2023-09-29T23:23:45.479248+0000","last_fullsized":"2023-09-29T23:23:45.479248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:46.564456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472272+0000","last_change":"2023-09-29T23:23:45.465993+0000","last_active":"2023-09-29T23:23:45.472272+0000","last_peered":"2023-09-29T23:23:45.472272+0000","last_clean":"2023-09-29T23:23:45.472272+0000","last_became_active":"2023-09-29T23:23:45.465443+0000","last_became_peered":"2023-09-29T23:23:45.465443+0000","last_unstale":"2023-09-29T23:23:45.472272+0000","last_undegraded":"2023-09-29T23:23:45.472272+0000","last_fullsized":"2023-09-29T23:23:45.472272+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:12:18.769461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.460342+0000","last_change":"2023-09-29T23:23:45.458032+0000","last_active":"2023-09-29T23:23:45.460342+0000","last_peered":"2023-09-29T23:23:45.460342+0000","last_clean":"2023-09-29T23:23:45.460342+0000","last_became_active":"2023-09-29T23:23:45.457799+0000","last_became_peered":"2023-09-29T23:23:45.457799+0000","last_unstale":"2023-09-29T23:23:45.460342+0000","last_undegraded":"2023-09-29T23:23:45.460342+0000","last_fullsized":"2023-09-29T23:23:45.460342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:21:07.207937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470656+0000","last_change":"2023-09-29T23:23:45.467967+0000","last_active":"2023-09-29T23:23:45.470656+0000","last_peered":"2023-09-29T23:23:45.470656+0000","last_clean":"2023-09-29T23:23:45.470656+0000","last_became_active":"2023-09-29T23:23:45.467730+0000","last_became_peered":"2023-09-29T23:23:45.467730+0000","last_unstale":"2023-09-29T23:23:45.470656+0000","last_undegraded":"2023-09-29T23:23:45.470656+0000","last_fullsized":"2023-09-29T23:23:45.470656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:23:19.840400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475084+0000","last_change":"2023-09-29T23:23:45.076072+0000","last_active":"2023-09-29T23:23:45.475084+0000","last_peered":"2023-09-29T23:23:45.475084+0000","last_clean":"2023-09-29T23:23:45.475084+0000","last_became_active":"2023-09-29T23:23:45.075848+0000","last_became_peered":"2023-09-29T23:23:45.075848+0000","last_unstale":"2023-09-29T23:23:45.475084+0000","last_undegraded":"2023-09-29T23:23:45.475084+0000","last_fullsized":"2023-09-29T23:23:45.475084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:29:13.914085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.464208+0000","last_change":"2023-09-29T23:23:45.462781+0000","last_active":"2023-09-29T23:23:45.464208+0000","last_peered":"2023-09-29T23:23:45.464208+0000","last_clean":"2023-09-29T23:23:45.464208+0000","last_became_active":"2023-09-29T23:23:45.462155+0000","last_became_peered":"2023-09-29T23:23:45.462155+0000","last_unstale":"2023-09-29T23:23:45.464208+0000","last_undegraded":"2023-09-29T23:23:45.464208+0000","last_fullsized":"2023-09-29T23:23:45.464208+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:13.284557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467209+0000","last_change":"2023-09-29T23:23:45.092553+0000","last_active":"2023-09-29T23:23:45.467209+0000","last_peered":"2023-09-29T23:23:45.467209+0000","last_clean":"2023-09-29T23:23:45.467209+0000","last_became_active":"2023-09-29T23:23:45.092273+0000","last_became_peered":"2023-09-29T23:23:45.092273+0000","last_unstale":"2023-09-29T23:23:45.467209+0000","last_undegraded":"2023-09-29T23:23:45.467209+0000","last_fullsized":"2023-09-29T23:23:45.467209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472939+0000","last_change":"2023-09-29T23:23:45.464637+0000","last_active":"2023-09-29T23:23:45.472939+0000","last_peered":"2023-09-29T23:23:45.472939+0000","last_clean":"2023-09-29T23:23:45.472939+0000","last_became_active":"2023-09-29T23:23:45.464027+0000","last_became_peered":"2023-09-29T23:23:45.464027+0000","last_unstale":"2023-09-29T23:23:45.472939+0000","last_undegraded":"2023-09-29T23:23:45.472939+0000","last_fullsized":"2023-09-29T23:23:45.472939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.449247+0000","last_change":"2023-09-29T23:23:45.088658+0000","last_active":"2023-09-29T23:23:45.449247+0000","last_peered":"2023-09-29T23:23:45.449247+0000","last_clean":"2023-09-29T23:23:45.449247+0000","last_became_active":"2023-09-29T23:23:45.088405+0000","last_became_peered":"2023-09-29T23:23:45.088405+0000","last_unstale":"2023-09-29T23:23:45.449247+0000","last_undegraded":"2023-09-29T23:23:45.449247+0000","last_fullsized":"2023-09-29T23:23:45.449247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473976+0000","last_change":"2023-09-29T23:23:45.471459+0000","last_active":"2023-09-29T23:23:45.473976+0000","last_peered":"2023-09-29T23:23:45.473976+0000","last_clean":"2023-09-29T23:23:45.473976+0000","last_became_active":"2023-09-29T23:23:45.470917+0000","last_became_peered":"2023-09-29T23:23:45.470917+0000","last_unstale":"2023-09-29T23:23:45.473976+0000","last_undegraded":"2023-09-29T23:23:45.473976+0000","last_fullsized":"2023-09-29T23:23:45.473976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:29:34.889615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.444294+0000","last_change":"2023-09-29T23:23:45.070764+0000","last_active":"2023-09-29T23:23:45.444294+0000","last_peered":"2023-09-29T23:23:45.444294+0000","last_clean":"2023-09-29T23:23:45.444294+0000","last_became_active":"2023-09-29T23:23:45.070610+0000","last_became_peered":"2023-09-29T23:23:45.070610+0000","last_unstale":"2023-09-29T23:23:45.444294+0000","last_undegraded":"2023-09-29T23:23:45.444294+0000","last_fullsized":"2023-09-29T23:23:45.444294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:26:19.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.477784+0000","last_change":"2023-09-29T23:23:45.475877+0000","last_active":"2023-09-29T23:23:45.477784+0000","last_peered":"2023-09-29T23:23:45.477784+0000","last_clean":"2023-09-29T23:23:45.477784+0000","last_became_active":"2023-09-29T23:23:45.475634+0000","last_became_peered":"2023-09-29T23:23:45.475634+0000","last_unstale":"2023-09-29T23:23:45.477784+0000","last_undegraded":"2023-09-29T23:23:45.477784+0000","last_fullsized":"2023-09-29T23:23:45.477784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:59:25.888959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.458483+0000","last_change":"2023-09-29T23:23:45.091556+0000","last_active":"2023-09-29T23:23:45.458483+0000","last_peered":"2023-09-29T23:23:45.458483+0000","last_clean":"2023-09-29T23:23:45.458483+0000","last_became_active":"2023-09-29T23:23:45.091317+0000","last_became_peered":"2023-09-29T23:23:45.091317+0000","last_unstale":"2023-09-29T23:23:45.458483+0000","last_undegraded":"2023-09-29T23:23:45.458483+0000","last_fullsized":"2023-09-29T23:23:45.458483+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:53.097532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467362+0000","last_change":"2023-09-29T23:23:45.458805+0000","last_active":"2023-09-29T23:23:45.467362+0000","last_peered":"2023-09-29T23:23:45.467362+0000","last_clean":"2023-09-29T23:23:45.467362+0000","last_became_active":"2023-09-29T23:23:45.458585+0000","last_became_peered":"2023-09-29T23:23:45.458585+0000","last_unstale":"2023-09-29T23:23:45.467362+0000","last_undegraded":"2023-09-29T23:23:45.467362+0000","last_fullsized":"2023-09-29T23:23:45.467362+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:05:18.350431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.446151+0000","last_change":"2023-09-29T23:23:45.071269+0000","last_active":"2023-09-29T23:23:45.446151+0000","last_peered":"2023-09-29T23:23:45.446151+0000","last_clean":"2023-09-29T23:23:45.446151+0000","last_became_active":"2023-09-29T23:23:45.070986+0000","last_became_peered":"2023-09-29T23:23:45.070986+0000","last_unstale":"2023-09-29T23:23:45.446151+0000","last_undegraded":"2023-09-29T23:23:45.446151+0000","last_fullsized":"2023-09-29T23:23:45.446151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:29.355473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472807+0000","last_change":"2023-09-29T23:23:45.464917+0000","last_active":"2023-09-29T23:23:45.472807+0000","last_peered":"2023-09-29T23:23:45.472807+0000","last_clean":"2023-09-29T23:23:45.472807+0000","last_became_active":"2023-09-29T23:23:45.464510+0000","last_became_peered":"2023-09-29T23:23:45.464510+0000","last_unstale":"2023-09-29T23:23:45.472807+0000","last_undegraded":"2023-09-29T23:23:45.472807+0000","last_fullsized":"2023-09-29T23:23:45.472807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:58:16.565151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475769+0000","last_change":"2023-09-29T23:23:45.077097+0000","last_active":"2023-09-29T23:23:45.475769+0000","last_peered":"2023-09-29T23:23:45.475769+0000","last_clean":"2023-09-29T23:23:45.475769+0000","last_became_active":"2023-09-29T23:23:45.076856+0000","last_became_peered":"2023-09-29T23:23:45.076856+0000","last_unstale":"2023-09-29T23:23:45.475769+0000","last_undegraded":"2023-09-29T23:23:45.475769+0000","last_fullsized":"2023-09-29T23:23:45.475769+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:00:28.816753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.464231+0000","last_change":"2023-09-29T23:23:45.462198+0000","last_active":"2023-09-29T23:23:45.464231+0000","last_peered":"2023-09-29T23:23:45.464231+0000","last_clean":"2023-09-29T23:23:45.464231+0000","last_became_active":"2023-09-29T23:23:45.461199+0000","last_became_peered":"2023-09-29T23:23:45.461199+0000","last_unstale":"2023-09-29T23:23:45.464231+0000","last_undegraded":"2023-09-29T23:23:45.464231+0000","last_fullsized":"2023-09-29T23:23:45.464231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:33.901646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.484403+0000","last_change":"2023-09-29T23:23:45.093720+0000","last_active":"2023-09-29T23:23:45.484403+0000","last_peered":"2023-09-29T23:23:45.484403+0000","last_clean":"2023-09-29T23:23:45.484403+0000","last_became_active":"2023-09-29T23:23:45.093487+0000","last_became_peered":"2023-09-29T23:23:45.093487+0000","last_unstale":"2023-09-29T23:23:45.484403+0000","last_undegraded":"2023-09-29T23:23:45.484403+0000","last_fullsized":"2023-09-29T23:23:45.484403+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473468+0000","last_change":"2023-09-29T23:23:45.466875+0000","last_active":"2023-09-29T23:23:45.473468+0000","last_peered":"2023-09-29T23:23:45.473468+0000","last_clean":"2023-09-29T23:23:45.473468+0000","last_became_active":"2023-09-29T23:23:45.466667+0000","last_became_peered":"2023-09-29T23:23:45.466667+0000","last_unstale":"2023-09-29T23:23:45.473468+0000","last_undegraded":"2023-09-29T23:23:45.473468+0000","last_fullsized":"2023-09-29T23:23:45.473468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:19.696930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.480207+0000","last_change":"2023-09-29T23:23:45.089727+0000","last_active":"2023-09-29T23:23:45.480207+0000","last_peered":"2023-09-29T23:23:45.480207+0000","last_clean":"2023-09-29T23:23:45.480207+0000","last_became_active":"2023-09-29T23:23:45.089450+0000","last_became_peered":"2023-09-29T23:23:45.089450+0000","last_unstale":"2023-09-29T23:23:45.480207+0000","last_undegraded":"2023-09-29T23:23:45.480207+0000","last_fullsized":"2023-09-29T23:23:45.480207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473639+0000","last_change":"2023-09-29T23:23:45.468316+0000","last_active":"2023-09-29T23:23:45.473639+0000","last_peered":"2023-09-29T23:23:45.473639+0000","last_clean":"2023-09-29T23:23:45.473639+0000","last_became_active":"2023-09-29T23:23:45.464801+0000","last_became_peered":"2023-09-29T23:23:45.464801+0000","last_unstale":"2023-09-29T23:23:45.473639+0000","last_undegraded":"2023-09-29T23:23:45.473639+0000","last_fullsized":"2023-09-29T23:23:45.473639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.451089+0000","last_change":"2023-09-29T23:23:45.093148+0000","last_active":"2023-09-29T23:23:45.451089+0000","last_peered":"2023-09-29T23:23:45.451089+0000","last_clean":"2023-09-29T23:23:45.451089+0000","last_became_active":"2023-09-29T23:23:45.092902+0000","last_became_peered":"2023-09-29T23:23:45.092902+0000","last_unstale":"2023-09-29T23:23:45.451089+0000","last_undegraded":"2023-09-29T23:23:45.451089+0000","last_fullsized":"2023-09-29T23:23:45.451089+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470060+0000","last_change":"2023-09-29T23:23:45.466007+0000","last_active":"2023-09-29T23:23:45.470060+0000","last_peered":"2023-09-29T23:23:45.470060+0000","last_clean":"2023-09-29T23:23:45.470060+0000","last_became_active":"2023-09-29T23:23:45.465743+0000","last_became_peered":"2023-09-29T23:23:45.465743+0000","last_unstale":"2023-09-29T23:23:45.470060+0000","last_undegraded":"2023-09-29T23:23:45.470060+0000","last_fullsized":"2023-09-29T23:23:45.470060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.448899+0000","last_change":"2023-09-29T23:23:45.072234+0000","last_active":"2023-09-29T23:23:45.448899+0000","last_peered":"2023-09-29T23:23:45.448899+0000","last_clean":"2023-09-29T23:23:45.448899+0000","last_became_active":"2023-09-29T23:23:45.072009+0000","last_became_peered":"2023-09-29T23:23:45.072009+0000","last_unstale":"2023-09-29T23:23:45.448899+0000","last_undegraded":"2023-09-29T23:23:45.448899+0000","last_fullsized":"2023-09-29T23:23:45.448899+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.471991+0000","last_change":"2023-09-29T23:23:45.466374+0000","last_active":"2023-09-29T23:23:45.471991+0000","last_peered":"2023-09-29T23:23:45.471991+0000","last_clean":"2023-09-29T23:23:45.471991+0000","last_became_active":"2023-09-29T23:23:45.466169+0000","last_became_peered":"2023-09-29T23:23:45.466169+0000","last_unstale":"2023-09-29T23:23:45.471991+0000","last_undegraded":"2023-09-29T23:23:45.471991+0000","last_fullsized":"2023-09-29T23:23:45.471991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475698+0000","last_change":"2023-09-29T23:23:45.091762+0000","last_active":"2023-09-29T23:23:45.475698+0000","last_peered":"2023-09-29T23:23:45.475698+0000","last_clean":"2023-09-29T23:23:45.475698+0000","last_became_active":"2023-09-29T23:23:45.091386+0000","last_became_peered":"2023-09-29T23:23:45.091386+0000","last_unstale":"2023-09-29T23:23:45.475698+0000","last_undegraded":"2023-09-29T23:23:45.475698+0000","last_fullsized":"2023-09-29T23:23:45.475698+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467101+0000","last_change":"2023-09-29T23:23:45.461421+0000","last_active":"2023-09-29T23:23:45.467101+0000","last_peered":"2023-09-29T23:23:45.467101+0000","last_clean":"2023-09-29T23:23:45.467101+0000","last_became_active":"2023-09-29T23:23:45.460643+0000","last_became_peered":"2023-09-29T23:23:45.460643+0000","last_unstale":"2023-09-29T23:23:45.467101+0000","last_undegraded":"2023-09-29T23:23:45.467101+0000","last_fullsized":"2023-09-29T23:23:45.467101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:12:32.105911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.480077+0000","last_change":"2023-09-29T23:23:45.078091+0000","last_active":"2023-09-29T23:23:45.480077+0000","last_peered":"2023-09-29T23:23:45.480077+0000","last_clean":"2023-09-29T23:23:45.480077+0000","last_became_active":"2023-09-29T23:23:45.077734+0000","last_became_peered":"2023-09-29T23:23:45.077734+0000","last_unstale":"2023-09-29T23:23:45.480077+0000","last_undegraded":"2023-09-29T23:23:45.480077+0000","last_fullsized":"2023-09-29T23:23:45.480077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:53.097532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470638+0000","last_change":"2023-09-29T23:23:45.467950+0000","last_active":"2023-09-29T23:23:45.470638+0000","last_peered":"2023-09-29T23:23:45.470638+0000","last_clean":"2023-09-29T23:23:45.470638+0000","last_became_active":"2023-09-29T23:23:45.467555+0000","last_became_peered":"2023-09-29T23:23:45.467555+0000","last_unstale":"2023-09-29T23:23:45.470638+0000","last_undegraded":"2023-09-29T23:23:45.470638+0000","last_fullsized":"2023-09-29T23:23:45.470638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474184+0000","last_change":"2023-09-29T23:23:45.092471+0000","last_active":"2023-09-29T23:23:45.474184+0000","last_peered":"2023-09-29T23:23:45.474184+0000","last_clean":"2023-09-29T23:23:45.474184+0000","last_became_active":"2023-09-29T23:23:45.092185+0000","last_became_peered":"2023-09-29T23:23:45.092185+0000","last_unstale":"2023-09-29T23:23:45.474184+0000","last_undegraded":"2023-09-29T23:23:45.474184+0000","last_fullsized":"2023-09-29T23:23:45.474184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472722+0000","last_change":"2023-09-29T23:23:45.464504+0000","last_active":"2023-09-29T23:23:45.472722+0000","last_peered":"2023-09-29T23:23:45.472722+0000","last_clean":"2023-09-29T23:23:45.472722+0000","last_became_active":"2023-09-29T23:23:45.463806+0000","last_became_peered":"2023-09-29T23:23:45.463806+0000","last_unstale":"2023-09-29T23:23:45.472722+0000","last_undegraded":"2023-09-29T23:23:45.472722+0000","last_fullsized":"2023-09-29T23:23:45.472722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:25:25.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.475877+0000","last_change":"2023-09-29T23:23:45.088776+0000","last_active":"2023-09-29T23:23:45.475877+0000","last_peered":"2023-09-29T23:23:45.475877+0000","last_clean":"2023-09-29T23:23:45.475877+0000","last_became_active":"2023-09-29T23:23:45.088535+0000","last_became_peered":"2023-09-29T23:23:45.088535+0000","last_unstale":"2023-09-29T23:23:45.475877+0000","last_undegraded":"2023-09-29T23:23:45.475877+0000","last_fullsized":"2023-09-29T23:23:45.475877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:35:07.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473390+0000","last_change":"2023-09-29T23:23:45.466379+0000","last_active":"2023-09-29T23:23:45.473390+0000","last_peered":"2023-09-29T23:23:45.473390+0000","last_clean":"2023-09-29T23:23:45.473390+0000","last_became_active":"2023-09-29T23:23:45.465855+0000","last_became_peered":"2023-09-29T23:23:45.465855+0000","last_unstale":"2023-09-29T23:23:45.473390+0000","last_undegraded":"2023-09-29T23:23:45.473390+0000","last_fullsized":"2023-09-29T23:23:45.473390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:06.275738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.447311+0000","last_change":"2023-09-29T23:23:45.092714+0000","last_active":"2023-09-29T23:23:45.447311+0000","last_peered":"2023-09-29T23:23:45.447311+0000","last_clean":"2023-09-29T23:23:45.447311+0000","last_became_active":"2023-09-29T23:23:45.092476+0000","last_became_peered":"2023-09-29T23:23:45.092476+0000","last_unstale":"2023-09-29T23:23:45.447311+0000","last_undegraded":"2023-09-29T23:23:45.447311+0000","last_fullsized":"2023-09-29T23:23:45.447311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:20:23.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.469720+0000","last_change":"2023-09-29T23:23:45.467010+0000","last_active":"2023-09-29T23:23:45.469720+0000","last_peered":"2023-09-29T23:23:45.469720+0000","last_clean":"2023-09-29T23:23:45.469720+0000","last_became_active":"2023-09-29T23:23:45.466694+0000","last_became_peered":"2023-09-29T23:23:45.466694+0000","last_unstale":"2023-09-29T23:23:45.469720+0000","last_undegraded":"2023-09-29T23:23:45.469720+0000","last_fullsized":"2023-09-29T23:23:45.469720+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.484451+0000","last_change":"2023-09-29T23:23:45.089622+0000","last_active":"2023-09-29T23:23:45.484451+0000","last_peered":"2023-09-29T23:23:45.484451+0000","last_clean":"2023-09-29T23:23:45.484451+0000","last_became_active":"2023-09-29T23:23:45.089176+0000","last_became_peered":"2023-09-29T23:23:45.089176+0000","last_unstale":"2023-09-29T23:23:45.484451+0000","last_undegraded":"2023-09-29T23:23:45.484451+0000","last_fullsized":"2023-09-29T23:23:45.484451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472323+0000","last_change":"2023-09-29T23:23:45.465798+0000","last_active":"2023-09-29T23:23:45.472323+0000","last_peered":"2023-09-29T23:23:45.472323+0000","last_clean":"2023-09-29T23:23:45.472323+0000","last_became_active":"2023-09-29T23:23:45.465127+0000","last_became_peered":"2023-09-29T23:23:45.465127+0000","last_unstale":"2023-09-29T23:23:45.472323+0000","last_undegraded":"2023-09-29T23:23:45.472323+0000","last_fullsized":"2023-09-29T23:23:45.472323+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:33.901646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450509+0000","last_change":"2023-09-29T23:23:45.075630+0000","last_active":"2023-09-29T23:23:45.450509+0000","last_peered":"2023-09-29T23:23:45.450509+0000","last_clean":"2023-09-29T23:23:45.450509+0000","last_became_active":"2023-09-29T23:23:45.075313+0000","last_became_peered":"2023-09-29T23:23:45.075313+0000","last_unstale":"2023-09-29T23:23:45.450509+0000","last_undegraded":"2023-09-29T23:23:45.450509+0000","last_fullsized":"2023-09-29T23:23:45.450509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:59:03.439349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.470041+0000","last_change":"2023-09-29T23:23:45.465956+0000","last_active":"2023-09-29T23:23:45.470041+0000","last_peered":"2023-09-29T23:23:45.470041+0000","last_clean":"2023-09-29T23:23:45.470041+0000","last_became_active":"2023-09-29T23:23:45.465599+0000","last_became_peered":"2023-09-29T23:23:45.465599+0000","last_unstale":"2023-09-29T23:23:45.470041+0000","last_undegraded":"2023-09-29T23:23:45.470041+0000","last_fullsized":"2023-09-29T23:23:45.470041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:29:34.889615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450944+0000","last_change":"2023-09-29T23:23:45.075998+0000","last_active":"2023-09-29T23:23:45.450944+0000","last_peered":"2023-09-29T23:23:45.450944+0000","last_clean":"2023-09-29T23:23:45.450944+0000","last_became_active":"2023-09-29T23:23:45.075772+0000","last_became_peered":"2023-09-29T23:23:45.075772+0000","last_unstale":"2023-09-29T23:23:45.450944+0000","last_undegraded":"2023-09-29T23:23:45.450944+0000","last_fullsized":"2023-09-29T23:23:45.450944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:12:24.809572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.468582+0000","last_change":"2023-09-29T23:23:45.463124+0000","last_active":"2023-09-29T23:23:45.468582+0000","last_peered":"2023-09-29T23:23:45.468582+0000","last_clean":"2023-09-29T23:23:45.468582+0000","last_became_active":"2023-09-29T23:23:45.462583+0000","last_became_peered":"2023-09-29T23:23:45.462583+0000","last_unstale":"2023-09-29T23:23:45.468582+0000","last_undegraded":"2023-09-29T23:23:45.468582+0000","last_fullsized":"2023-09-29T23:23:45.468582+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:01:57.571277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.444191+0000","last_change":"2023-09-29T23:23:45.088750+0000","last_active":"2023-09-29T23:23:45.444191+0000","last_peered":"2023-09-29T23:23:45.444191+0000","last_clean":"2023-09-29T23:23:45.444191+0000","last_became_active":"2023-09-29T23:23:45.088506+0000","last_became_peered":"2023-09-29T23:23:45.088506+0000","last_unstale":"2023-09-29T23:23:45.444191+0000","last_undegraded":"2023-09-29T23:23:45.444191+0000","last_fullsized":"2023-09-29T23:23:45.444191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479465+0000","last_change":"2023-09-29T23:23:45.477617+0000","last_active":"2023-09-29T23:23:45.479465+0000","last_peered":"2023-09-29T23:23:45.479465+0000","last_clean":"2023-09-29T23:23:45.479465+0000","last_became_active":"2023-09-29T23:23:45.477335+0000","last_became_peered":"2023-09-29T23:23:45.477335+0000","last_unstale":"2023-09-29T23:23:45.479465+0000","last_undegraded":"2023-09-29T23:23:45.479465+0000","last_fullsized":"2023-09-29T23:23:45.479465+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:44:09.599636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.447044+0000","last_change":"2023-09-29T23:23:41.047954+0000","last_active":"2023-09-29T23:23:45.447044+0000","last_peered":"2023-09-29T23:23:45.447044+0000","last_clean":"2023-09-29T23:23:45.447044+0000","last_became_active":"2023-09-29T23:23:41.047701+0000","last_became_peered":"2023-09-29T23:23:41.047701+0000","last_unstale":"2023-09-29T23:23:45.447044+0000","last_undegraded":"2023-09-29T23:23:45.447044+0000","last_fullsized":"2023-09-29T23:23:45.447044+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:08:35.252580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-29T23:23:46.447573+0000","last_change":"2023-09-29T23:23:45.075607+0000","last_active":"2023-09-29T23:23:46.447573+0000","last_peered":"2023-09-29T23:23:46.447573+0000","last_clean":"2023-09-29T23:23:46.447573+0000","last_became_active":"2023-09-29T23:23:45.075249+0000","last_became_peered":"2023-09-29T23:23:45.075249+0000","last_unstale":"2023-09-29T23:23:46.447573+0000","last_undegraded":"2023-09-29T23:23:46.447573+0000","last_fullsized":"2023-09-29T23:23:46.447573+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:55:12.692421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.465404+0000","last_change":"2023-09-29T23:23:45.460164+0000","last_active":"2023-09-29T23:23:45.465404+0000","last_peered":"2023-09-29T23:23:45.465404+0000","last_clean":"2023-09-29T23:23:45.465404+0000","last_became_active":"2023-09-29T23:23:45.459933+0000","last_became_peered":"2023-09-29T23:23:45.459933+0000","last_unstale":"2023-09-29T23:23:45.465404+0000","last_undegraded":"2023-09-29T23:23:45.465404+0000","last_fullsized":"2023-09-29T23:23:45.465404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:25:22.017530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.453586+0000","last_change":"2023-09-29T23:23:41.051640+0000","last_active":"2023-09-29T23:23:45.453586+0000","last_peered":"2023-09-29T23:23:45.453586+0000","last_clean":"2023-09-29T23:23:45.453586+0000","last_became_active":"2023-09-29T23:23:41.051398+0000","last_became_peered":"2023-09-29T23:23:41.051398+0000","last_unstale":"2023-09-29T23:23:45.453586+0000","last_undegraded":"2023-09-29T23:23:45.453586+0000","last_fullsized":"2023-09-29T23:23:45.453586+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:49:47.548120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.476402+0000","last_change":"2023-09-29T23:23:45.076540+0000","last_active":"2023-09-29T23:23:45.476402+0000","last_peered":"2023-09-29T23:23:45.476402+0000","last_clean":"2023-09-29T23:23:45.476402+0000","last_became_active":"2023-09-29T23:23:45.076293+0000","last_became_peered":"2023-09-29T23:23:45.076293+0000","last_unstale":"2023-09-29T23:23:45.476402+0000","last_undegraded":"2023-09-29T23:23:45.476402+0000","last_fullsized":"2023-09-29T23:23:45.476402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:09.131795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474065+0000","last_change":"2023-09-29T23:23:45.466336+0000","last_active":"2023-09-29T23:23:45.474065+0000","last_peered":"2023-09-29T23:23:45.474065+0000","last_clean":"2023-09-29T23:23:45.474065+0000","last_became_active":"2023-09-29T23:23:45.466115+0000","last_became_peered":"2023-09-29T23:23:45.466115+0000","last_unstale":"2023-09-29T23:23:45.474065+0000","last_undegraded":"2023-09-29T23:23:45.474065+0000","last_fullsized":"2023-09-29T23:23:45.474065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:11.211646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450776+0000","last_change":"2023-09-29T23:23:41.050066+0000","last_active":"2023-09-29T23:23:45.450776+0000","last_peered":"2023-09-29T23:23:45.450776+0000","last_clean":"2023-09-29T23:23:45.450776+0000","last_became_active":"2023-09-29T23:23:41.049786+0000","last_became_peered":"2023-09-29T23:23:41.049786+0000","last_unstale":"2023-09-29T23:23:45.450776+0000","last_undegraded":"2023-09-29T23:23:45.450776+0000","last_fullsized":"2023-09-29T23:23:45.450776+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:22:54.699446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450066+0000","last_change":"2023-09-29T23:23:45.091590+0000","last_active":"2023-09-29T23:23:45.450066+0000","last_peered":"2023-09-29T23:23:45.450066+0000","last_clean":"2023-09-29T23:23:45.450066+0000","last_became_active":"2023-09-29T23:23:45.091162+0000","last_became_peered":"2023-09-29T23:23:45.091162+0000","last_unstale":"2023-09-29T23:23:45.450066+0000","last_undegraded":"2023-09-29T23:23:45.450066+0000","last_fullsized":"2023-09-29T23:23:45.450066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:29:38.240697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479301+0000","last_change":"2023-09-29T23:23:45.474238+0000","last_active":"2023-09-29T23:23:45.479301+0000","last_peered":"2023-09-29T23:23:45.479301+0000","last_clean":"2023-09-29T23:23:45.479301+0000","last_became_active":"2023-09-29T23:23:45.473861+0000","last_became_peered":"2023-09-29T23:23:45.473861+0000","last_unstale":"2023-09-29T23:23:45.479301+0000","last_undegraded":"2023-09-29T23:23:45.479301+0000","last_fullsized":"2023-09-29T23:23:45.479301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:39:43.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.451691+0000","last_change":"2023-09-29T23:23:41.049685+0000","last_active":"2023-09-29T23:23:45.451691+0000","last_peered":"2023-09-29T23:23:45.451691+0000","last_clean":"2023-09-29T23:23:45.451691+0000","last_became_active":"2023-09-29T23:23:41.049442+0000","last_became_peered":"2023-09-29T23:23:41.049442+0000","last_unstale":"2023-09-29T23:23:45.451691+0000","last_undegraded":"2023-09-29T23:23:45.451691+0000","last_fullsized":"2023-09-29T23:23:45.451691+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:52:33.065724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.446401+0000","last_change":"2023-09-29T23:23:45.092293+0000","last_active":"2023-09-29T23:23:45.446401+0000","last_peered":"2023-09-29T23:23:45.446401+0000","last_clean":"2023-09-29T23:23:45.446401+0000","last_became_active":"2023-09-29T23:23:45.092042+0000","last_became_peered":"2023-09-29T23:23:45.092042+0000","last_unstale":"2023-09-29T23:23:45.446401+0000","last_undegraded":"2023-09-29T23:23:45.446401+0000","last_fullsized":"2023-09-29T23:23:45.446401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:07:16.838088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.466547+0000","last_change":"2023-09-29T23:23:45.461917+0000","last_active":"2023-09-29T23:23:45.466547+0000","last_peered":"2023-09-29T23:23:45.466547+0000","last_clean":"2023-09-29T23:23:45.466547+0000","last_became_active":"2023-09-29T23:23:45.461228+0000","last_became_peered":"2023-09-29T23:23:45.461228+0000","last_unstale":"2023-09-29T23:23:45.466547+0000","last_undegraded":"2023-09-29T23:23:45.466547+0000","last_fullsized":"2023-09-29T23:23:45.466547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:54:19.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450606+0000","last_change":"2023-09-29T23:23:41.051041+0000","last_active":"2023-09-29T23:23:45.450606+0000","last_peered":"2023-09-29T23:23:45.450606+0000","last_clean":"2023-09-29T23:23:45.450606+0000","last_became_active":"2023-09-29T23:23:41.050731+0000","last_became_peered":"2023-09-29T23:23:41.050731+0000","last_unstale":"2023-09-29T23:23:45.450606+0000","last_undegraded":"2023-09-29T23:23:45.450606+0000","last_fullsized":"2023-09-29T23:23:45.450606+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:20.303147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.450701+0000","last_change":"2023-09-29T23:23:45.088759+0000","last_active":"2023-09-29T23:23:45.450701+0000","last_peered":"2023-09-29T23:23:45.450701+0000","last_clean":"2023-09-29T23:23:45.450701+0000","last_became_active":"2023-09-29T23:23:45.088510+0000","last_became_peered":"2023-09-29T23:23:45.088510+0000","last_unstale":"2023-09-29T23:23:45.450701+0000","last_undegraded":"2023-09-29T23:23:45.450701+0000","last_fullsized":"2023-09-29T23:23:45.450701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:27:56.918672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.477404+0000","last_change":"2023-09-29T23:23:45.472092+0000","last_active":"2023-09-29T23:23:45.477404+0000","last_peered":"2023-09-29T23:23:45.477404+0000","last_clean":"2023-09-29T23:23:45.477404+0000","last_became_active":"2023-09-29T23:23:45.461672+0000","last_became_peered":"2023-09-29T23:23:45.461672+0000","last_unstale":"2023-09-29T23:23:45.477404+0000","last_undegraded":"2023-09-29T23:23:45.477404+0000","last_fullsized":"2023-09-29T23:23:45.477404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:58:16.565151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.446553+0000","last_change":"2023-09-29T23:23:41.047062+0000","last_active":"2023-09-29T23:23:45.446553+0000","last_peered":"2023-09-29T23:23:45.446553+0000","last_clean":"2023-09-29T23:23:45.446553+0000","last_became_active":"2023-09-29T23:23:41.046803+0000","last_became_peered":"2023-09-29T23:23:41.046803+0000","last_unstale":"2023-09-29T23:23:45.446553+0000","last_undegraded":"2023-09-29T23:23:45.446553+0000","last_fullsized":"2023-09-29T23:23:45.446553+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:22:14.657466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.451787+0000","last_change":"2023-09-29T23:23:45.073226+0000","last_active":"2023-09-29T23:23:45.451787+0000","last_peered":"2023-09-29T23:23:45.451787+0000","last_clean":"2023-09-29T23:23:45.451787+0000","last_became_active":"2023-09-29T23:23:45.072973+0000","last_became_peered":"2023-09-29T23:23:45.072973+0000","last_unstale":"2023-09-29T23:23:45.451787+0000","last_undegraded":"2023-09-29T23:23:45.451787+0000","last_fullsized":"2023-09-29T23:23:45.451787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:27:56.918672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479531+0000","last_change":"2023-09-29T23:23:45.477628+0000","last_active":"2023-09-29T23:23:45.479531+0000","last_peered":"2023-09-29T23:23:45.479531+0000","last_clean":"2023-09-29T23:23:45.479531+0000","last_became_active":"2023-09-29T23:23:45.474318+0000","last_became_peered":"2023-09-29T23:23:45.474318+0000","last_unstale":"2023-09-29T23:23:45.479531+0000","last_undegraded":"2023-09-29T23:23:45.479531+0000","last_fullsized":"2023-09-29T23:23:45.479531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:46:02.634499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.457485+0000","last_change":"2023-09-29T23:23:41.050883+0000","last_active":"2023-09-29T23:23:45.457485+0000","last_peered":"2023-09-29T23:23:45.457485+0000","last_clean":"2023-09-29T23:23:45.457485+0000","last_became_active":"2023-09-29T23:23:41.050639+0000","last_became_peered":"2023-09-29T23:23:41.050639+0000","last_unstale":"2023-09-29T23:23:45.457485+0000","last_undegraded":"2023-09-29T23:23:45.457485+0000","last_fullsized":"2023-09-29T23:23:45.457485+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:35:26.897753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.457867+0000","last_change":"2023-09-29T23:23:45.077040+0000","last_active":"2023-09-29T23:23:45.457867+0000","last_peered":"2023-09-29T23:23:45.457867+0000","last_clean":"2023-09-29T23:23:45.457867+0000","last_became_active":"2023-09-29T23:23:45.076806+0000","last_became_peered":"2023-09-29T23:23:45.076806+0000","last_unstale":"2023-09-29T23:23:45.457867+0000","last_undegraded":"2023-09-29T23:23:45.457867+0000","last_fullsized":"2023-09-29T23:23:45.457867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:26:19.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.463631+0000","last_change":"2023-09-29T23:23:45.462067+0000","last_active":"2023-09-29T23:23:45.463631+0000","last_peered":"2023-09-29T23:23:45.463631+0000","last_clean":"2023-09-29T23:23:45.463631+0000","last_became_active":"2023-09-29T23:23:45.460913+0000","last_became_peered":"2023-09-29T23:23:45.460913+0000","last_unstale":"2023-09-29T23:23:45.463631+0000","last_undegraded":"2023-09-29T23:23:45.463631+0000","last_fullsized":"2023-09-29T23:23:45.463631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:06.275738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.458336+0000","last_change":"2023-09-29T23:23:41.050074+0000","last_active":"2023-09-29T23:23:45.458336+0000","last_peered":"2023-09-29T23:23:45.458336+0000","last_clean":"2023-09-29T23:23:45.458336+0000","last_became_active":"2023-09-29T23:23:41.049783+0000","last_became_peered":"2023-09-29T23:23:41.049783+0000","last_unstale":"2023-09-29T23:23:45.458336+0000","last_undegraded":"2023-09-29T23:23:45.458336+0000","last_fullsized":"2023-09-29T23:23:45.458336+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:37:01.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.453746+0000","last_change":"2023-09-29T23:23:45.076087+0000","last_active":"2023-09-29T23:23:45.453746+0000","last_peered":"2023-09-29T23:23:45.453746+0000","last_clean":"2023-09-29T23:23:45.453746+0000","last_became_active":"2023-09-29T23:23:45.075273+0000","last_became_peered":"2023-09-29T23:23:45.075273+0000","last_unstale":"2023-09-29T23:23:45.453746+0000","last_undegraded":"2023-09-29T23:23:45.453746+0000","last_fullsized":"2023-09-29T23:23:45.453746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:27.356997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.466914+0000","last_change":"2023-09-29T23:23:45.459071+0000","last_active":"2023-09-29T23:23:45.466914+0000","last_peered":"2023-09-29T23:23:45.466914+0000","last_clean":"2023-09-29T23:23:45.466914+0000","last_became_active":"2023-09-29T23:23:45.458250+0000","last_became_peered":"2023-09-29T23:23:45.458250+0000","last_unstale":"2023-09-29T23:23:45.466914+0000","last_undegraded":"2023-09-29T23:23:45.466914+0000","last_fullsized":"2023-09-29T23:23:45.466914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.478408+0000","last_change":"2023-09-29T23:23:45.076932+0000","last_active":"2023-09-29T23:23:45.478408+0000","last_peered":"2023-09-29T23:23:45.478408+0000","last_clean":"2023-09-29T23:23:45.478408+0000","last_became_active":"2023-09-29T23:23:45.076638+0000","last_became_peered":"2023-09-29T23:23:45.076638+0000","last_unstale":"2023-09-29T23:23:45.478408+0000","last_undegraded":"2023-09-29T23:23:45.478408+0000","last_fullsized":"2023-09-29T23:23:45.478408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:35:07.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472138+0000","last_change":"2023-09-29T23:23:45.471332+0000","last_active":"2023-09-29T23:23:45.472138+0000","last_peered":"2023-09-29T23:23:45.472138+0000","last_clean":"2023-09-29T23:23:45.472138+0000","last_became_active":"2023-09-29T23:23:45.471013+0000","last_became_peered":"2023-09-29T23:23:45.471013+0000","last_unstale":"2023-09-29T23:23:45.472138+0000","last_undegraded":"2023-09-29T23:23:45.472138+0000","last_fullsized":"2023-09-29T23:23:45.472138+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479907+0000","last_change":"2023-09-29T23:23:45.076405+0000","last_active":"2023-09-29T23:23:45.479907+0000","last_peered":"2023-09-29T23:23:45.479907+0000","last_clean":"2023-09-29T23:23:45.479907+0000","last_became_active":"2023-09-29T23:23:45.076191+0000","last_became_peered":"2023-09-29T23:23:45.076191+0000","last_unstale":"2023-09-29T23:23:45.479907+0000","last_undegraded":"2023-09-29T23:23:45.479907+0000","last_fullsized":"2023-09-29T23:23:45.479907+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:20:23.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.477541+0000","last_change":"2023-09-29T23:23:45.471929+0000","last_active":"2023-09-29T23:23:45.477541+0000","last_peered":"2023-09-29T23:23:45.477541+0000","last_clean":"2023-09-29T23:23:45.477541+0000","last_became_active":"2023-09-29T23:23:45.471673+0000","last_became_peered":"2023-09-29T23:23:45.471673+0000","last_unstale":"2023-09-29T23:23:45.477541+0000","last_undegraded":"2023-09-29T23:23:45.477541+0000","last_fullsized":"2023-09-29T23:23:45.477541+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.474262+0000","last_change":"2023-09-29T23:23:45.092434+0000","last_active":"2023-09-29T23:23:45.474262+0000","last_peered":"2023-09-29T23:23:45.474262+0000","last_clean":"2023-09-29T23:23:45.474262+0000","last_became_active":"2023-09-29T23:23:45.092203+0000","last_became_peered":"2023-09-29T23:23:45.092203+0000","last_unstale":"2023-09-29T23:23:45.474262+0000","last_undegraded":"2023-09-29T23:23:45.474262+0000","last_fullsized":"2023-09-29T23:23:45.474262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.472769+0000","last_change":"2023-09-29T23:23:45.464734+0000","last_active":"2023-09-29T23:23:45.472769+0000","last_peered":"2023-09-29T23:23:45.472769+0000","last_clean":"2023-09-29T23:23:45.472769+0000","last_became_active":"2023-09-29T23:23:45.464202+0000","last_became_peered":"2023-09-29T23:23:45.464202+0000","last_unstale":"2023-09-29T23:23:45.472769+0000","last_undegraded":"2023-09-29T23:23:45.472769+0000","last_fullsized":"2023-09-29T23:23:45.472769+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:59:25.888959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.480111+0000","last_change":"2023-09-29T23:23:45.074017+0000","last_active":"2023-09-29T23:23:45.480111+0000","last_peered":"2023-09-29T23:23:45.480111+0000","last_clean":"2023-09-29T23:23:45.480111+0000","last_became_active":"2023-09-29T23:23:45.073772+0000","last_became_peered":"2023-09-29T23:23:45.073772+0000","last_unstale":"2023-09-29T23:23:45.480111+0000","last_undegraded":"2023-09-29T23:23:45.480111+0000","last_fullsized":"2023-09-29T23:23:45.480111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467384+0000","last_change":"2023-09-29T23:23:45.460786+0000","last_active":"2023-09-29T23:23:45.467384+0000","last_peered":"2023-09-29T23:23:45.467384+0000","last_clean":"2023-09-29T23:23:45.467384+0000","last_became_active":"2023-09-29T23:23:45.460548+0000","last_became_peered":"2023-09-29T23:23:45.460548+0000","last_unstale":"2023-09-29T23:23:45.467384+0000","last_undegraded":"2023-09-29T23:23:45.467384+0000","last_fullsized":"2023-09-29T23:23:45.467384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:09:25.160546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.473995+0000","last_change":"2023-09-29T23:23:45.471512+0000","last_active":"2023-09-29T23:23:45.473995+0000","last_peered":"2023-09-29T23:23:45.473995+0000","last_clean":"2023-09-29T23:23:45.473995+0000","last_became_active":"2023-09-29T23:23:45.471294+0000","last_became_peered":"2023-09-29T23:23:45.471294+0000","last_unstale":"2023-09-29T23:23:45.473995+0000","last_undegraded":"2023-09-29T23:23:45.473995+0000","last_fullsized":"2023-09-29T23:23:45.473995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:29:14.066786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.467135+0000","last_change":"2023-09-29T23:23:45.462314+0000","last_active":"2023-09-29T23:23:45.467135+0000","last_peered":"2023-09-29T23:23:45.467135+0000","last_clean":"2023-09-29T23:23:45.467135+0000","last_became_active":"2023-09-29T23:23:45.461188+0000","last_became_peered":"2023-09-29T23:23:45.461188+0000","last_unstale":"2023-09-29T23:23:45.467135+0000","last_undegraded":"2023-09-29T23:23:45.467135+0000","last_fullsized":"2023-09-29T23:23:45.467135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:01:06.913634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479183+0000","last_change":"2023-09-29T23:23:45.473685+0000","last_active":"2023-09-29T23:23:45.479183+0000","last_peered":"2023-09-29T23:23:45.479183+0000","last_clean":"2023-09-29T23:23:45.479183+0000","last_became_active":"2023-09-29T23:23:45.473438+0000","last_became_peered":"2023-09-29T23:23:45.473438+0000","last_unstale":"2023-09-29T23:23:45.479183+0000","last_undegraded":"2023-09-29T23:23:45.479183+0000","last_fullsized":"2023-09-29T23:23:45.479183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:39:59.923188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479548+0000","last_change":"2023-09-29T23:23:45.477880+0000","last_active":"2023-09-29T23:23:45.479548+0000","last_peered":"2023-09-29T23:23:45.479548+0000","last_clean":"2023-09-29T23:23:45.479548+0000","last_became_active":"2023-09-29T23:23:45.474163+0000","last_became_peered":"2023-09-29T23:23:45.474163+0000","last_unstale":"2023-09-29T23:23:45.479548+0000","last_undegraded":"2023-09-29T23:23:45.479548+0000","last_fullsized":"2023-09-29T23:23:45.479548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:40:09.175714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.479092+0000","last_change":"2023-09-29T23:23:45.473292+0000","last_active":"2023-09-29T23:23:45.479092+0000","last_peered":"2023-09-29T23:23:45.479092+0000","last_clean":"2023-09-29T23:23:45.479092+0000","last_became_active":"2023-09-29T23:23:45.473063+0000","last_became_peered":"2023-09-29T23:23:45.473063+0000","last_unstale":"2023-09-29T23:23:45.479092+0000","last_undegraded":"2023-09-29T23:23:45.479092+0000","last_fullsized":"2023-09-29T23:23:45.479092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:06:47.738713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-29T23:23:45.464396+0000","last_change":"2023-09-29T23:23:45.463712+0000","last_active":"2023-09-29T23:23:45.464396+0000","last_peered":"2023-09-29T23:23:45.464396+0000","last_clean":"2023-09-29T23:23:45.464396+0000","last_became_active":"2023-09-29T23:23:45.463269+0000","last_became_peered":"2023-09-29T23:23:45.463269+0000","last_unstale":"2023-09-29T23:23:45.464396+0000","last_undegraded":"2023-09-29T23:23:45.464396+0000","last_fullsized":"2023-09-29T23:23:45.464396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:32.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5556,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852044,"statfs":{"total":107374182400,"available":107368493056,"internally_reserved":0,"allocated":176128,"data_stored":46822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]}]},{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5484,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":104852116,"statfs":{"total":107374182400,"available":107368566784,"internally_reserved":0,"allocated":167936,"data_stored":46190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5544,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852056,"statfs":{"total":107374182400,"available":107368505344,"internally_reserved":0,"allocated":163840,"data_stored":45250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-29T23:23:58.027 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-29T23:23:58.027 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-29T23:23:58.027 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-29T23:23:58.027 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:23:58.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.172+0000 7f4d27833700 1 Processor -- start 2023-09-29T23:23:58.173 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.173+0000 7f4d27833700 1 -- start start 2023-09-29T23:23:58.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.173+0000 7f4d27833700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4d2012fcb0 0x7f4d20134620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:58.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.173+0000 7f4d27833700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d200997f0 con 0x7f4d200a3030 2023-09-29T23:23:58.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.173+0000 7f4d27833700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d200a3400 con 0x7f4d2012fcb0 2023-09-29T23:23:58.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.173+0000 7f4d24dce700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4d2012fcb0 0x7f4d20134620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:58.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.173+0000 7f4d255cf700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f4d200a3030 0x7f4d2012f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54730/0 (socket says 172.21.15.92:54730) 2023-09-29T23:23:58.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.173+0000 7f4d255cf700 1 -- 172.21.15.92:0/1734814958 learned_addr learned my addr 172.21.15.92:0/1734814958 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:23:58.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.174+0000 7f4d24dce700 1 -- 172.21.15.92:0/1734814958 >> v1:172.21.15.92:6789/0 conn(0x7f4d200a3030 legacy=0x7f4d2012f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:58.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.174+0000 7f4d24dce700 1 -- 172.21.15.92:0/1734814958 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d200977a0 con 0x7f4d2012fcb0 2023-09-29T23:23:58.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.174+0000 7f4d24dce700 1 --2- 172.21.15.92:0/1734814958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d2012fcb0 0x7f4d20134620 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009860 tx=0x7f4d100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3747aa4fa965a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:58.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.174+0000 7f4d17fff700 1 -- 172.21.15.92:0/1734814958 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d1000b710 con 0x7f4d2012fcb0 2023-09-29T23:23:58.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.174+0000 7f4d17fff700 1 -- 172.21.15.92:0/1734814958 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1000b870 con 0x7f4d2012fcb0 2023-09-29T23:23:58.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.174+0000 7f4d17fff700 1 -- 172.21.15.92:0/1734814958 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d1000ba20 con 0x7f4d2012fcb0 2023-09-29T23:23:58.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.174+0000 7f4d27833700 1 -- 172.21.15.92:0/1734814958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d2012fcb0 msgr2=0x7f4d20134620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:58.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.174+0000 7f4d27833700 1 --2- 172.21.15.92:0/1734814958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d2012fcb0 0x7f4d20134620 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009860 tx=0x7f4d100091a0 comp rx=0 tx=0).stop 2023-09-29T23:23:58.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.174+0000 7f4d27833700 1 -- 172.21.15.92:0/1734814958 shutdown_connections 2023-09-29T23:23:58.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.174+0000 7f4d27833700 1 --2- 172.21.15.92:0/1734814958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d2012fcb0 0x7f4d20134620 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:58.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.174+0000 7f4d27833700 1 -- 172.21.15.92:0/1734814958 >> 172.21.15.92:0/1734814958 conn(0x7f4d20067fc0 msgr2=0x7f4d200a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:58.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.174+0000 7f4d27833700 1 -- 172.21.15.92:0/1734814958 shutdown_connections 2023-09-29T23:23:58.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.174+0000 7f4d27833700 1 -- 172.21.15.92:0/1734814958 wait complete. 2023-09-29T23:23:58.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.175+0000 7f4d27833700 1 Processor -- start 2023-09-29T23:23:58.177 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.175+0000 7f4d27833700 1 -- start start 2023-09-29T23:23:58.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.176+0000 7f4d27833700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d200a3030 0x7f4d2011a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:58.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.176+0000 7f4d27833700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2011a700 con 0x7f4d200a3030 2023-09-29T23:23:58.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.176+0000 7f4d255cf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d200a3030 0x7f4d2011a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:58.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.176+0000 7f4d255cf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d200a3030 0x7f4d2011a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49312/0 (socket says 172.21.15.92:49312) 2023-09-29T23:23:58.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.176+0000 7f4d255cf700 1 -- 172.21.15.92:0/1524452539 learned_addr learned my addr 172.21.15.92:0/1524452539 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:23:58.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.176+0000 7f4d255cf700 1 -- 172.21.15.92:0/1524452539 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d10009420 con 0x7f4d200a3030 2023-09-29T23:23:58.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.176+0000 7f4d255cf700 1 --2- 172.21.15.92:0/1524452539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d200a3030 0x7f4d2011a960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00c6c0 tx=0x7f4d1c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:58.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.176+0000 7f4d157fa700 1 -- 172.21.15.92:0/1524452539 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d1c005b30 con 0x7f4d200a3030 2023-09-29T23:23:58.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.176+0000 7f4d157fa700 1 -- 172.21.15.92:0/1524452539 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c005c90 con 0x7f4d200a3030 2023-09-29T23:23:58.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.177+0000 7f4d27833700 1 -- 172.21.15.92:0/1524452539 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2012ceb0 con 0x7f4d200a3030 2023-09-29T23:23:58.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.177+0000 7f4d157fa700 1 -- 172.21.15.92:0/1524452539 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d1c004830 con 0x7f4d200a3030 2023-09-29T23:23:58.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.177+0000 7f4d27833700 1 -- 172.21.15.92:0/1524452539 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2011cb60 con 0x7f4d200a3030 2023-09-29T23:23:58.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.177+0000 7f4d157fa700 1 -- 172.21.15.92:0/1524452539 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f4d1c004a60 con 0x7f4d200a3030 2023-09-29T23:23:58.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.177+0000 7f4d27833700 1 -- 172.21.15.92:0/1524452539 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d201300f0 con 0x7f4d200a3030 2023-09-29T23:23:58.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.177+0000 7f4d157fa700 1 --2- 172.21.15.92:0/1524452539 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4d04035640 0x7f4d04037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:23:58.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.177+0000 7f4d157fa700 1 -- 172.21.15.92:0/1524452539 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f4d1c0468b0 con 0x7f4d200a3030 2023-09-29T23:23:58.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.178+0000 7f4d24dce700 1 --2- 172.21.15.92:0/1524452539 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4d04035640 0x7f4d04037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:23:58.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.178+0000 7f4d24dce700 1 --2- 172.21.15.92:0/1524452539 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4d04035640 0x7f4d04037af0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d100091e0 tx=0x7f4d10016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:23:58.182 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.182+0000 7f4d157fa700 1 -- 172.21.15.92:0/1524452539 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d1c0075f0 con 0x7f4d200a3030 2023-09-29T23:23:58.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.403+0000 7f4d27833700 1 -- 172.21.15.92:0/1524452539 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4d20096640 con 0x7f4d200a3030 2023-09-29T23:23:58.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.403+0000 7f4d157fa700 1 -- 172.21.15.92:0/1524452539 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f4d1c01b360 con 0x7f4d200a3030 2023-09-29T23:23:58.404 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:23:58.404 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:23:58.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.405+0000 7f4d27833700 1 -- 172.21.15.92:0/1524452539 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4d04035640 msgr2=0x7f4d04037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:58.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.405+0000 7f4d27833700 1 --2- 172.21.15.92:0/1524452539 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4d04035640 0x7f4d04037af0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d100091e0 tx=0x7f4d10016000 comp rx=0 tx=0).stop 2023-09-29T23:23:58.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.405+0000 7f4d27833700 1 -- 172.21.15.92:0/1524452539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d200a3030 msgr2=0x7f4d2011a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:23:58.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.405+0000 7f4d27833700 1 --2- 172.21.15.92:0/1524452539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d200a3030 0x7f4d2011a960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00c6c0 tx=0x7f4d1c007f70 comp rx=0 tx=0).stop 2023-09-29T23:23:58.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.405+0000 7f4d27833700 1 -- 172.21.15.92:0/1524452539 shutdown_connections 2023-09-29T23:23:58.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.405+0000 7f4d27833700 1 --2- 172.21.15.92:0/1524452539 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4d04035640 0x7f4d04037af0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:58.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.405+0000 7f4d27833700 1 --2- 172.21.15.92:0/1524452539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d200a3030 0x7f4d2011a960 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:23:58.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.405+0000 7f4d27833700 1 -- 172.21.15.92:0/1524452539 >> 172.21.15.92:0/1524452539 conn(0x7f4d20067fc0 msgr2=0x7f4d2012d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:23:58.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.405+0000 7f4d27833700 1 -- 172.21.15.92:0/1524452539 shutdown_connections 2023-09-29T23:23:58.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:23:58.405+0000 7f4d27833700 1 -- 172.21.15.92:0/1524452539 wait complete. 2023-09-29T23:24:01.418 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:24:01.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.543+0000 7f22b497f700 1 Processor -- start 2023-09-29T23:24:01.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.543+0000 7f22b497f700 1 -- start start 2023-09-29T23:24:01.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.543+0000 7f22b497f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f22b00967f0 0x7f22b0131430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:01.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.543+0000 7f22b497f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b00979d0 con 0x7f22b006ed70 2023-09-29T23:24:01.544 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.543+0000 7f22b497f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b006f140 con 0x7f22b00967f0 2023-09-29T23:24:01.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.543+0000 7f22ae59c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f22b00967f0 0x7f22b0131430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:01.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.543+0000 7f22aed9d700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f22b006ed70 0x7f22b00960e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43104/0 (socket says 172.21.15.92:43104) 2023-09-29T23:24:01.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.543+0000 7f22aed9d700 1 -- 172.21.15.92:0/2103967357 learned_addr learned my addr 172.21.15.92:0/2103967357 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:24:01.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.543+0000 7f22ae59c700 1 -- 172.21.15.92:0/2103967357 >> v1:172.21.15.92:6789/0 conn(0x7f22b006ed70 legacy=0x7f22b00960e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:01.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.544+0000 7f22ae59c700 1 -- 172.21.15.92:0/2103967357 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b0098020 con 0x7f22b00967f0 2023-09-29T23:24:01.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.543+0000 7f22add9b700 1 -- 172.21.15.92:0/2103967357 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325256366 0 0) 0x7f22b00979d0 con 0x7f22b006ed70 2023-09-29T23:24:01.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.544+0000 7f22ae59c700 1 --2- 172.21.15.92:0/2103967357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22b00967f0 0x7f22b0131430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009860 tx=0x7f22a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68754aedb740e48b server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:01.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.544+0000 7f22add9b700 1 -- 172.21.15.92:0/2103967357 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22a400b680 con 0x7f22b00967f0 2023-09-29T23:24:01.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.544+0000 7f22add9b700 1 -- 172.21.15.92:0/2103967357 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a400b7e0 con 0x7f22b00967f0 2023-09-29T23:24:01.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.544+0000 7f22add9b700 1 -- 172.21.15.92:0/2103967357 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22a400bad0 con 0x7f22b00967f0 2023-09-29T23:24:01.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.544+0000 7f22b497f700 1 -- 172.21.15.92:0/2103967357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22b00967f0 msgr2=0x7f22b0131430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:01.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.544+0000 7f22b497f700 1 --2- 172.21.15.92:0/2103967357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22b00967f0 0x7f22b0131430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009860 tx=0x7f22a40091a0 comp rx=0 tx=0).stop 2023-09-29T23:24:01.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.544+0000 7f22b497f700 1 -- 172.21.15.92:0/2103967357 shutdown_connections 2023-09-29T23:24:01.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.544+0000 7f22b497f700 1 --2- 172.21.15.92:0/2103967357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22b00967f0 0x7f22b0131430 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:01.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.544+0000 7f22b497f700 1 -- 172.21.15.92:0/2103967357 >> 172.21.15.92:0/2103967357 conn(0x7f22b006b270 msgr2=0x7f22b006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:01.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.544+0000 7f22b497f700 1 -- 172.21.15.92:0/2103967357 shutdown_connections 2023-09-29T23:24:01.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.544+0000 7f22b497f700 1 -- 172.21.15.92:0/2103967357 wait complete. 2023-09-29T23:24:01.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.545+0000 7f22b497f700 1 Processor -- start 2023-09-29T23:24:01.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.545+0000 7f22b497f700 1 -- start start 2023-09-29T23:24:01.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.546+0000 7f22b497f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22b006ed70 0x7f22b008d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:01.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.546+0000 7f22b497f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00907f0 con 0x7f22b006ed70 2023-09-29T23:24:01.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.546+0000 7f22aed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22b006ed70 0x7f22b008d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:01.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.546+0000 7f22aed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22b006ed70 0x7f22b008d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47248/0 (socket says 172.21.15.92:47248) 2023-09-29T23:24:01.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.546+0000 7f22aed9d700 1 -- 172.21.15.92:0/2877064737 learned_addr learned my addr 172.21.15.92:0/2877064737 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:24:01.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.546+0000 7f22aed9d700 1 -- 172.21.15.92:0/2877064737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a4009420 con 0x7f22b006ed70 2023-09-29T23:24:01.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.546+0000 7f22aed9d700 1 --2- 172.21.15.92:0/2877064737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22b006ed70 0x7f22b008d590 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f22a000c710 tx=0x7f22a0007c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:01.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.546+0000 7f2296ffd700 1 -- 172.21.15.92:0/2877064737 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22a0007610 con 0x7f22b006ed70 2023-09-29T23:24:01.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.546+0000 7f2296ffd700 1 -- 172.21.15.92:0/2877064737 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a00057f0 con 0x7f22b006ed70 2023-09-29T23:24:01.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.546+0000 7f22b497f700 1 -- 172.21.15.92:0/2877064737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b008eac0 con 0x7f22b006ed70 2023-09-29T23:24:01.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.546+0000 7f2296ffd700 1 -- 172.21.15.92:0/2877064737 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22a0005ae0 con 0x7f22b006ed70 2023-09-29T23:24:01.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.546+0000 7f22b497f700 1 -- 172.21.15.92:0/2877064737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b0090c20 con 0x7f22b006ed70 2023-09-29T23:24:01.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.547+0000 7f2296ffd700 1 -- 172.21.15.92:0/2877064737 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f22a0005c40 con 0x7f22b006ed70 2023-09-29T23:24:01.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.547+0000 7f22b497f700 1 -- 172.21.15.92:0/2877064737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b0090940 con 0x7f22b006ed70 2023-09-29T23:24:01.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.547+0000 7f2296ffd700 1 --2- 172.21.15.92:0/2877064737 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f229c035690 0x7f229c037b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:01.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.547+0000 7f2296ffd700 1 -- 172.21.15.92:0/2877064737 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f22a0046cb0 con 0x7f22b006ed70 2023-09-29T23:24:01.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.547+0000 7f22ae59c700 1 --2- 172.21.15.92:0/2877064737 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f229c035690 0x7f229c037b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:01.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.548+0000 7f22ae59c700 1 --2- 172.21.15.92:0/2877064737 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f229c035690 0x7f229c037b40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f22a4003080 tx=0x7f22a4016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:01.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.552+0000 7f2296ffd700 1 -- 172.21.15.92:0/2877064737 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22a0018a50 con 0x7f22b006ed70 2023-09-29T23:24:01.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.776+0000 7f22b497f700 1 -- 172.21.15.92:0/2877064737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f22b005f230 con 0x7f22b006ed70 2023-09-29T23:24:01.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.777+0000 7f2296ffd700 1 -- 172.21.15.92:0/2877064737 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f22a0017020 con 0x7f22b006ed70 2023-09-29T23:24:01.777 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:24:01.777 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:24:01.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.779+0000 7f22b497f700 1 -- 172.21.15.92:0/2877064737 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f229c035690 msgr2=0x7f229c037b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:01.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.779+0000 7f22b497f700 1 --2- 172.21.15.92:0/2877064737 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f229c035690 0x7f229c037b40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f22a4003080 tx=0x7f22a4016000 comp rx=0 tx=0).stop 2023-09-29T23:24:01.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.779+0000 7f22b497f700 1 -- 172.21.15.92:0/2877064737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22b006ed70 msgr2=0x7f22b008d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:01.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.779+0000 7f22b497f700 1 --2- 172.21.15.92:0/2877064737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22b006ed70 0x7f22b008d590 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f22a000c710 tx=0x7f22a0007c00 comp rx=0 tx=0).stop 2023-09-29T23:24:01.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.779+0000 7f22b497f700 1 -- 172.21.15.92:0/2877064737 shutdown_connections 2023-09-29T23:24:01.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.779+0000 7f22b497f700 1 --2- 172.21.15.92:0/2877064737 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f229c035690 0x7f229c037b40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:01.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.779+0000 7f22b497f700 1 --2- 172.21.15.92:0/2877064737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22b006ed70 0x7f22b008d590 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:01.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.779+0000 7f22b497f700 1 -- 172.21.15.92:0/2877064737 >> 172.21.15.92:0/2877064737 conn(0x7f22b006b270 msgr2=0x7f22b009cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:01.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.779+0000 7f22b497f700 1 -- 172.21.15.92:0/2877064737 shutdown_connections 2023-09-29T23:24:01.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:01.779+0000 7f22b497f700 1 -- 172.21.15.92:0/2877064737 wait complete. 2023-09-29T23:24:04.791 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:24:04.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.912+0000 7f23c293d700 1 Processor -- start 2023-09-29T23:24:04.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.912+0000 7f23c293d700 1 -- start start 2023-09-29T23:24:04.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.913+0000 7f23c293d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f23bc06b0c0 0x7f23bc12f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:04.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.913+0000 7f23c293d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23bc09ca80 con 0x7f23bc12fb70 2023-09-29T23:24:04.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.913+0000 7f23c293d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23bc06b490 con 0x7f23bc06b0c0 2023-09-29T23:24:04.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.913+0000 7f23c193b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f23bc06b0c0 0x7f23bc12f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:04.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.913+0000 7f23c113a700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f23bc12fb70 0x7f23bc099530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43110/0 (socket says 172.21.15.92:43110) 2023-09-29T23:24:04.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.913+0000 7f23c113a700 1 -- 172.21.15.92:0/2486493120 learned_addr learned my addr 172.21.15.92:0/2486493120 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:24:04.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.913+0000 7f23c193b700 1 -- 172.21.15.92:0/2486493120 >> v1:172.21.15.92:6789/0 conn(0x7f23bc12fb70 legacy=0x7f23bc099530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:04.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.913+0000 7f23c193b700 1 -- 172.21.15.92:0/2486493120 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc09be20 con 0x7f23bc06b0c0 2023-09-29T23:24:04.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.913+0000 7f23c193b700 1 --2- 172.21.15.92:0/2486493120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23bc06b0c0 0x7f23bc12f630 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009860 tx=0x7f23b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7edd21dbd479510 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:04.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.913+0000 7f23c0939700 1 -- 172.21.15.92:0/2486493120 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23b800b680 con 0x7f23bc06b0c0 2023-09-29T23:24:04.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.913+0000 7f23c0939700 1 -- 172.21.15.92:0/2486493120 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b800b7e0 con 0x7f23bc06b0c0 2023-09-29T23:24:04.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.913+0000 7f23c0939700 1 -- 172.21.15.92:0/2486493120 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23b800bad0 con 0x7f23bc06b0c0 2023-09-29T23:24:04.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.914+0000 7f23c293d700 1 -- 172.21.15.92:0/2486493120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23bc06b0c0 msgr2=0x7f23bc12f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:04.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.914+0000 7f23c293d700 1 --2- 172.21.15.92:0/2486493120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23bc06b0c0 0x7f23bc12f630 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009860 tx=0x7f23b80091a0 comp rx=0 tx=0).stop 2023-09-29T23:24:04.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.914+0000 7f23c293d700 1 -- 172.21.15.92:0/2486493120 shutdown_connections 2023-09-29T23:24:04.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.914+0000 7f23c293d700 1 --2- 172.21.15.92:0/2486493120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23bc06b0c0 0x7f23bc12f630 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:04.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.914+0000 7f23c293d700 1 -- 172.21.15.92:0/2486493120 >> 172.21.15.92:0/2486493120 conn(0x7f23bc06a5b0 msgr2=0x7f23bc06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:04.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.914+0000 7f23c293d700 1 -- 172.21.15.92:0/2486493120 shutdown_connections 2023-09-29T23:24:04.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.914+0000 7f23c293d700 1 -- 172.21.15.92:0/2486493120 wait complete. 2023-09-29T23:24:04.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.915+0000 7f23c293d700 1 Processor -- start 2023-09-29T23:24:04.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.915+0000 7f23c293d700 1 -- start start 2023-09-29T23:24:04.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.915+0000 7f23c293d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23bc06b0c0 0x7f23bc11a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:04.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.915+0000 7f23c293d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc11c060 con 0x7f23bc06b0c0 2023-09-29T23:24:04.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.915+0000 7f23c193b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23bc06b0c0 0x7f23bc11a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:04.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.915+0000 7f23c193b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23bc06b0c0 0x7f23bc11a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47260/0 (socket says 172.21.15.92:47260) 2023-09-29T23:24:04.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.915+0000 7f23c193b700 1 -- 172.21.15.92:0/1683833693 learned_addr learned my addr 172.21.15.92:0/1683833693 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:24:04.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.916+0000 7f23c193b700 1 -- 172.21.15.92:0/1683833693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b8009420 con 0x7f23bc06b0c0 2023-09-29T23:24:04.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.916+0000 7f23c193b700 1 --2- 172.21.15.92:0/1683833693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23bc06b0c0 0x7f23bc11a9b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f23b8000c00 tx=0x7f23b8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:04.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.916+0000 7f23b1ffb700 1 -- 172.21.15.92:0/1683833693 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23b8011dd0 con 0x7f23bc06b0c0 2023-09-29T23:24:04.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.916+0000 7f23b1ffb700 1 -- 172.21.15.92:0/1683833693 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b8020070 con 0x7f23bc06b0c0 2023-09-29T23:24:04.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.916+0000 7f23c293d700 1 -- 172.21.15.92:0/1683833693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23bc11e720 con 0x7f23bc06b0c0 2023-09-29T23:24:04.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.916+0000 7f23b1ffb700 1 -- 172.21.15.92:0/1683833693 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23b801c5d0 con 0x7f23bc06b0c0 2023-09-29T23:24:04.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.916+0000 7f23c293d700 1 -- 172.21.15.92:0/1683833693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23bc11e2b0 con 0x7f23bc06b0c0 2023-09-29T23:24:04.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.917+0000 7f23b1ffb700 1 -- 172.21.15.92:0/1683833693 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f23b8022030 con 0x7f23bc06b0c0 2023-09-29T23:24:04.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.917+0000 7f23c293d700 1 -- 172.21.15.92:0/1683833693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23bc05f230 con 0x7f23bc06b0c0 2023-09-29T23:24:04.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.917+0000 7f23b1ffb700 1 --2- 172.21.15.92:0/1683833693 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f23a0035640 0x7f23a0037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:04.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.917+0000 7f23b1ffb700 1 -- 172.21.15.92:0/1683833693 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f23b80492a0 con 0x7f23bc06b0c0 2023-09-29T23:24:04.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.917+0000 7f23c113a700 1 --2- 172.21.15.92:0/1683833693 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f23a0035640 0x7f23a0037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:04.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.917+0000 7f23c113a700 1 --2- 172.21.15.92:0/1683833693 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f23a0035640 0x7f23a0037af0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0a3600 tx=0x7f23ac007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:04.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:04.922+0000 7f23b1ffb700 1 -- 172.21.15.92:0/1683833693 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23b802e440 con 0x7f23bc06b0c0 2023-09-29T23:24:05.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:05.145+0000 7f23c293d700 1 -- 172.21.15.92:0/1683833693 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f23bc12f320 con 0x7f23bc06b0c0 2023-09-29T23:24:05.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:05.145+0000 7f23b1ffb700 1 -- 172.21.15.92:0/1683833693 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f23b80243d0 con 0x7f23bc06b0c0 2023-09-29T23:24:05.146 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:24:05.146 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:24:05.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:05.147+0000 7f23c293d700 1 -- 172.21.15.92:0/1683833693 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f23a0035640 msgr2=0x7f23a0037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:05.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:05.147+0000 7f23c293d700 1 --2- 172.21.15.92:0/1683833693 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f23a0035640 0x7f23a0037af0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0a3600 tx=0x7f23ac007b30 comp rx=0 tx=0).stop 2023-09-29T23:24:05.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:05.147+0000 7f23c293d700 1 -- 172.21.15.92:0/1683833693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23bc06b0c0 msgr2=0x7f23bc11a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:05.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:05.147+0000 7f23c293d700 1 --2- 172.21.15.92:0/1683833693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23bc06b0c0 0x7f23bc11a9b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f23b8000c00 tx=0x7f23b8016000 comp rx=0 tx=0).stop 2023-09-29T23:24:05.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:05.147+0000 7f23c293d700 1 -- 172.21.15.92:0/1683833693 shutdown_connections 2023-09-29T23:24:05.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:05.147+0000 7f23c293d700 1 --2- 172.21.15.92:0/1683833693 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f23a0035640 0x7f23a0037af0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:05.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:05.147+0000 7f23c293d700 1 --2- 172.21.15.92:0/1683833693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23bc06b0c0 0x7f23bc11a9b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:05.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:05.148+0000 7f23c293d700 1 -- 172.21.15.92:0/1683833693 >> 172.21.15.92:0/1683833693 conn(0x7f23bc06a5b0 msgr2=0x7f23bc12dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:05.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:05.148+0000 7f23c293d700 1 -- 172.21.15.92:0/1683833693 shutdown_connections 2023-09-29T23:24:05.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:05.148+0000 7f23c293d700 1 -- 172.21.15.92:0/1683833693 wait complete. 2023-09-29T23:24:08.160 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:24:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.282+0000 7f549c73b700 1 Processor -- start 2023-09-29T23:24:08.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.282+0000 7f549c73b700 1 -- start start 2023-09-29T23:24:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.282+0000 7f549c73b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5494096ca0 0x7f5494097070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.282+0000 7f549c73b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5494098700 con 0x7f54940975b0 2023-09-29T23:24:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.282+0000 7f549c73b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549409f430 con 0x7f5494096ca0 2023-09-29T23:24:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.282+0000 7f549a4d7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5494096ca0 0x7f5494097070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.282+0000 7f5499cd6700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f54940975b0 0x7f5494130630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:43120/0 (socket says 172.21.15.92:43120) 2023-09-29T23:24:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.282+0000 7f549a4d7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5494096ca0 0x7f5494097070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47276/0 (socket says 172.21.15.92:47276) 2023-09-29T23:24:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.282+0000 7f5499cd6700 1 -- 172.21.15.92:0/951778430 learned_addr learned my addr 172.21.15.92:0/951778430 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:24:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.283+0000 7f549a4d7700 1 -- 172.21.15.92:0/951778430 >> v1:172.21.15.92:6789/0 conn(0x7f54940975b0 legacy=0x7f5494130630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:08.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.283+0000 7f54994d5700 1 -- 172.21.15.92:0/951778430 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371440340 0 0) 0x7f5494098700 con 0x7f54940975b0 2023-09-29T23:24:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.283+0000 7f549a4d7700 1 -- 172.21.15.92:0/951778430 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549406fab0 con 0x7f5494096ca0 2023-09-29T23:24:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.283+0000 7f549a4d7700 1 --2- 172.21.15.92:0/951778430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5494096ca0 0x7f5494097070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5490009850 tx=0x7f5490009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b56eaca0146f2bd server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.283+0000 7f54994d5700 1 -- 172.21.15.92:0/951778430 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5490005d50 con 0x7f5494096ca0 2023-09-29T23:24:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.283+0000 7f54994d5700 1 -- 172.21.15.92:0/951778430 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5490006030 con 0x7f5494096ca0 2023-09-29T23:24:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.283+0000 7f54994d5700 1 -- 172.21.15.92:0/951778430 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5490006300 con 0x7f5494096ca0 2023-09-29T23:24:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.283+0000 7f549c73b700 1 -- 172.21.15.92:0/951778430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5494096ca0 msgr2=0x7f5494097070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.283+0000 7f549c73b700 1 --2- 172.21.15.92:0/951778430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5494096ca0 0x7f5494097070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5490009850 tx=0x7f5490009120 comp rx=0 tx=0).stop 2023-09-29T23:24:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.284+0000 7f549c73b700 1 -- 172.21.15.92:0/951778430 shutdown_connections 2023-09-29T23:24:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.284+0000 7f549c73b700 1 --2- 172.21.15.92:0/951778430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5494096ca0 0x7f5494097070 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.284+0000 7f549c73b700 1 -- 172.21.15.92:0/951778430 >> 172.21.15.92:0/951778430 conn(0x7f549406bd70 msgr2=0x7f549406e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.284+0000 7f549c73b700 1 -- 172.21.15.92:0/951778430 shutdown_connections 2023-09-29T23:24:08.285 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.284+0000 7f549c73b700 1 -- 172.21.15.92:0/951778430 wait complete. 2023-09-29T23:24:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.284+0000 7f549c73b700 1 Processor -- start 2023-09-29T23:24:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.284+0000 7f549c73b700 1 -- start start 2023-09-29T23:24:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.285+0000 7f549c73b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5494096ca0 0x7f54940929b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.285+0000 7f549c73b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549408b080 con 0x7f5494096ca0 2023-09-29T23:24:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.285+0000 7f549a4d7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5494096ca0 0x7f54940929b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.285+0000 7f549a4d7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5494096ca0 0x7f54940929b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47278/0 (socket says 172.21.15.92:47278) 2023-09-29T23:24:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.285+0000 7f549a4d7700 1 -- 172.21.15.92:0/2033182412 learned_addr learned my addr 172.21.15.92:0/2033182412 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:24:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.285+0000 7f549a4d7700 1 -- 172.21.15.92:0/2033182412 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54900093c0 con 0x7f5494096ca0 2023-09-29T23:24:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.285+0000 7f549a4d7700 1 --2- 172.21.15.92:0/2033182412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5494096ca0 0x7f54940929b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5490009fd0 tx=0x7f5490015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.285+0000 7f548a7fc700 1 -- 172.21.15.92:0/2033182412 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f549000bb00 con 0x7f5494096ca0 2023-09-29T23:24:08.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.285+0000 7f548a7fc700 1 -- 172.21.15.92:0/2033182412 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549000bc60 con 0x7f5494096ca0 2023-09-29T23:24:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.285+0000 7f549c73b700 1 -- 172.21.15.92:0/2033182412 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54940926a0 con 0x7f5494096ca0 2023-09-29T23:24:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.285+0000 7f548a7fc700 1 -- 172.21.15.92:0/2033182412 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f549001c450 con 0x7f5494096ca0 2023-09-29T23:24:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.285+0000 7f549c73b700 1 -- 172.21.15.92:0/2033182412 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54940916d0 con 0x7f5494096ca0 2023-09-29T23:24:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.286+0000 7f548a7fc700 1 -- 172.21.15.92:0/2033182412 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f5490023030 con 0x7f5494096ca0 2023-09-29T23:24:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.286+0000 7f549c73b700 1 -- 172.21.15.92:0/2033182412 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54940994e0 con 0x7f5494096ca0 2023-09-29T23:24:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.287+0000 7f548a7fc700 1 --2- 172.21.15.92:0/2033182412 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5478035640 0x7f5478037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.287+0000 7f548a7fc700 1 -- 172.21.15.92:0/2033182412 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f5490049570 con 0x7f5494096ca0 2023-09-29T23:24:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.287+0000 7f5499cd6700 1 --2- 172.21.15.92:0/2033182412 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5478035640 0x7f5478037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:08.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.287+0000 7f5499cd6700 1 --2- 172.21.15.92:0/2033182412 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5478035640 0x7f5478037af0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f54840011e0 tx=0x7f54840079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:08.291 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.291+0000 7f548a7fc700 1 -- 172.21.15.92:0/2033182412 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5490024970 con 0x7f5494096ca0 2023-09-29T23:24:08.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.513+0000 7f549c73b700 1 -- 172.21.15.92:0/2033182412 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f549405f230 con 0x7f5494096ca0 2023-09-29T23:24:08.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.513+0000 7f548a7fc700 1 -- 172.21.15.92:0/2033182412 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f5490011420 con 0x7f5494096ca0 2023-09-29T23:24:08.514 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:24:08.514 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:24:08.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.515+0000 7f549c73b700 1 -- 172.21.15.92:0/2033182412 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5478035640 msgr2=0x7f5478037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:08.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.515+0000 7f549c73b700 1 --2- 172.21.15.92:0/2033182412 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5478035640 0x7f5478037af0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f54840011e0 tx=0x7f54840079d0 comp rx=0 tx=0).stop 2023-09-29T23:24:08.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.515+0000 7f549c73b700 1 -- 172.21.15.92:0/2033182412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5494096ca0 msgr2=0x7f54940929b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:08.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.515+0000 7f549c73b700 1 --2- 172.21.15.92:0/2033182412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5494096ca0 0x7f54940929b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5490009fd0 tx=0x7f5490015000 comp rx=0 tx=0).stop 2023-09-29T23:24:08.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.515+0000 7f549c73b700 1 -- 172.21.15.92:0/2033182412 shutdown_connections 2023-09-29T23:24:08.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.515+0000 7f549c73b700 1 --2- 172.21.15.92:0/2033182412 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5478035640 0x7f5478037af0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:08.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.515+0000 7f549c73b700 1 --2- 172.21.15.92:0/2033182412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5494096ca0 0x7f54940929b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:08.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.515+0000 7f549c73b700 1 -- 172.21.15.92:0/2033182412 >> 172.21.15.92:0/2033182412 conn(0x7f549406bd70 msgr2=0x7f549406d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:08.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.515+0000 7f549c73b700 1 -- 172.21.15.92:0/2033182412 shutdown_connections 2023-09-29T23:24:08.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:08.515+0000 7f549c73b700 1 -- 172.21.15.92:0/2033182412 wait complete. 2023-09-29T23:24:11.528 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:24:11.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.646+0000 7f191f7e3700 1 Processor -- start 2023-09-29T23:24:11.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.647+0000 7f191f7e3700 1 -- start start 2023-09-29T23:24:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.647+0000 7f191f7e3700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f191806f210 0x7f1918069930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.647+0000 7f191f7e3700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19180a1580 con 0x7f1918069e70 2023-09-29T23:24:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.647+0000 7f191f7e3700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f191806f5e0 con 0x7f191806f210 2023-09-29T23:24:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.647+0000 7f191d57f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f191806f210 0x7f1918069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.647+0000 7f191cd7e700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f1918069e70 0x7f191812f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:55356/0 (socket says 172.21.15.92:55356) 2023-09-29T23:24:11.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.647+0000 7f191cd7e700 1 -- 172.21.15.92:0/4131011534 learned_addr learned my addr 172.21.15.92:0/4131011534 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:24:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.647+0000 7f191d57f700 1 -- 172.21.15.92:0/4131011534 >> v1:172.21.15.92:6789/0 conn(0x7f1918069e70 legacy=0x7f191812f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.647+0000 7f190ffff700 1 -- 172.21.15.92:0/4131011534 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754318191 0 0) 0x7f19180a1580 con 0x7f1918069e70 2023-09-29T23:24:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.647+0000 7f191d57f700 1 -- 172.21.15.92:0/4131011534 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191809cc70 con 0x7f191806f210 2023-09-29T23:24:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.648+0000 7f191d57f700 1 --2- 172.21.15.92:0/4131011534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f191806f210 0x7f1918069930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1914009e30 tx=0x7f1914009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42938c943f97a9ab server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.648+0000 7f190ffff700 1 -- 172.21.15.92:0/4131011534 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f191400e070 con 0x7f191806f210 2023-09-29T23:24:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.648+0000 7f190ffff700 1 -- 172.21.15.92:0/4131011534 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191400bd70 con 0x7f191806f210 2023-09-29T23:24:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.648+0000 7f190ffff700 1 -- 172.21.15.92:0/4131011534 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19140125b0 con 0x7f191806f210 2023-09-29T23:24:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.648+0000 7f191f7e3700 1 -- 172.21.15.92:0/4131011534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f191806f210 msgr2=0x7f1918069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.648+0000 7f191f7e3700 1 --2- 172.21.15.92:0/4131011534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f191806f210 0x7f1918069930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1914009e30 tx=0x7f1914009780 comp rx=0 tx=0).stop 2023-09-29T23:24:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.648+0000 7f191f7e3700 1 -- 172.21.15.92:0/4131011534 shutdown_connections 2023-09-29T23:24:11.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.648+0000 7f191f7e3700 1 --2- 172.21.15.92:0/4131011534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f191806f210 0x7f1918069930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:11.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.648+0000 7f191f7e3700 1 -- 172.21.15.92:0/4131011534 >> 172.21.15.92:0/4131011534 conn(0x7f1918094a70 msgr2=0x7f191806eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:11.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.648+0000 7f191f7e3700 1 -- 172.21.15.92:0/4131011534 shutdown_connections 2023-09-29T23:24:11.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.648+0000 7f191f7e3700 1 -- 172.21.15.92:0/4131011534 wait complete. 2023-09-29T23:24:11.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.649+0000 7f191f7e3700 1 Processor -- start 2023-09-29T23:24:11.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.649+0000 7f191f7e3700 1 -- start start 2023-09-29T23:24:11.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.650+0000 7f191f7e3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1918069e70 0x7f191811ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:11.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.650+0000 7f191f7e3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1918119830 con 0x7f1918069e70 2023-09-29T23:24:11.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.650+0000 7f191d57f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1918069e70 0x7f191811ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:11.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.650+0000 7f191d57f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1918069e70 0x7f191811ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42960/0 (socket says 172.21.15.92:42960) 2023-09-29T23:24:11.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.650+0000 7f191d57f700 1 -- 172.21.15.92:0/3922481440 learned_addr learned my addr 172.21.15.92:0/3922481440 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:24:11.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.650+0000 7f191d57f700 1 -- 172.21.15.92:0/3922481440 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1914009a20 con 0x7f1918069e70 2023-09-29T23:24:11.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.650+0000 7f191d57f700 1 --2- 172.21.15.92:0/3922481440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1918069e70 0x7f191811ae80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f191400b6c0 tx=0x7f1914018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:11.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.650+0000 7f190d7fa700 1 -- 172.21.15.92:0/3922481440 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1914027470 con 0x7f1918069e70 2023-09-29T23:24:11.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.650+0000 7f190d7fa700 1 -- 172.21.15.92:0/3922481440 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19140275d0 con 0x7f1918069e70 2023-09-29T23:24:11.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.650+0000 7f190d7fa700 1 -- 172.21.15.92:0/3922481440 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19140278c0 con 0x7f1918069e70 2023-09-29T23:24:11.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.650+0000 7f191f7e3700 1 -- 172.21.15.92:0/3922481440 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191811a730 con 0x7f1918069e70 2023-09-29T23:24:11.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.650+0000 7f191f7e3700 1 -- 172.21.15.92:0/3922481440 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191811a8e0 con 0x7f1918069e70 2023-09-29T23:24:11.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.651+0000 7f190d7fa700 1 -- 172.21.15.92:0/3922481440 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f1914024070 con 0x7f1918069e70 2023-09-29T23:24:11.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.651+0000 7f190d7fa700 1 --2- 172.21.15.92:0/3922481440 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f18fc035640 0x7f18fc037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:11.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.651+0000 7f191f7e3700 1 -- 172.21.15.92:0/3922481440 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f191806e820 con 0x7f1918069e70 2023-09-29T23:24:11.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.651+0000 7f190d7fa700 1 -- 172.21.15.92:0/3922481440 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f1914049d10 con 0x7f1918069e70 2023-09-29T23:24:11.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.651+0000 7f191cd7e700 1 --2- 172.21.15.92:0/3922481440 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f18fc035640 0x7f18fc037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:11.654 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.652+0000 7f191cd7e700 1 --2- 172.21.15.92:0/3922481440 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f18fc035640 0x7f18fc037af0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1908007fd0 tx=0x7f1908007bb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:11.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.656+0000 7f190d7fa700 1 -- 172.21.15.92:0/3922481440 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1914011390 con 0x7f1918069e70 2023-09-29T23:24:11.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.879+0000 7f191f7e3700 1 -- 172.21.15.92:0/3922481440 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f191805f230 con 0x7f1918069e70 2023-09-29T23:24:11.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.880+0000 7f190d7fa700 1 -- 172.21.15.92:0/3922481440 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f1914035070 con 0x7f1918069e70 2023-09-29T23:24:11.880 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:24:11.880 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:24:11.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.882+0000 7f191f7e3700 1 -- 172.21.15.92:0/3922481440 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f18fc035640 msgr2=0x7f18fc037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:11.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.882+0000 7f191f7e3700 1 --2- 172.21.15.92:0/3922481440 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f18fc035640 0x7f18fc037af0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1908007fd0 tx=0x7f1908007bb0 comp rx=0 tx=0).stop 2023-09-29T23:24:11.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.882+0000 7f191f7e3700 1 -- 172.21.15.92:0/3922481440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1918069e70 msgr2=0x7f191811ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:11.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.882+0000 7f191f7e3700 1 --2- 172.21.15.92:0/3922481440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1918069e70 0x7f191811ae80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f191400b6c0 tx=0x7f1914018000 comp rx=0 tx=0).stop 2023-09-29T23:24:11.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.882+0000 7f191f7e3700 1 -- 172.21.15.92:0/3922481440 shutdown_connections 2023-09-29T23:24:11.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.882+0000 7f191f7e3700 1 --2- 172.21.15.92:0/3922481440 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f18fc035640 0x7f18fc037af0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:11.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.882+0000 7f191f7e3700 1 --2- 172.21.15.92:0/3922481440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1918069e70 0x7f191811ae80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:11.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.882+0000 7f191f7e3700 1 -- 172.21.15.92:0/3922481440 >> 172.21.15.92:0/3922481440 conn(0x7f1918094a70 msgr2=0x7f1918132640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:11.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.882+0000 7f191f7e3700 1 -- 172.21.15.92:0/3922481440 shutdown_connections 2023-09-29T23:24:11.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:11.882+0000 7f191f7e3700 1 -- 172.21.15.92:0/3922481440 wait complete. 2023-09-29T23:24:14.894 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:24:15.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.020+0000 7ff4e17b4700 1 Processor -- start 2023-09-29T23:24:15.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.020+0000 7ff4e17b4700 1 -- start start 2023-09-29T23:24:15.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.021+0000 7ff4e17b4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff4dc12ffc0 0x7ff4dc0a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:15.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.021+0000 7ff4e17b4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4dc098710 con 0x7ff4dc09fd80 2023-09-29T23:24:15.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.021+0000 7ff4e17b4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4dc12f340 con 0x7ff4dc12ffc0 2023-09-29T23:24:15.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.021+0000 7ff4d27fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff4dc12ffc0 0x7ff4dc0a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:15.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.021+0000 7ff4daffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ff4dc09fd80 0x7ff4dc12f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:55372/0 (socket says 172.21.15.92:55372) 2023-09-29T23:24:15.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.021+0000 7ff4daffd700 1 -- 172.21.15.92:0/41401745 learned_addr learned my addr 172.21.15.92:0/41401745 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:24:15.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.021+0000 7ff4d27fc700 1 -- 172.21.15.92:0/41401745 >> v1:172.21.15.92:6789/0 conn(0x7ff4dc09fd80 legacy=0x7ff4dc12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:15.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.021+0000 7ff4d27fc700 1 -- 172.21.15.92:0/41401745 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc0997e0 con 0x7ff4dc12ffc0 2023-09-29T23:24:15.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.021+0000 7ff4d27fc700 1 --2- 172.21.15.92:0/41401745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4dc12ffc0 0x7ff4dc0a3090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4009860 tx=0x7ff4c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f102351fcd12b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:15.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.021+0000 7ff4da7fc700 1 -- 172.21.15.92:0/41401745 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4c400b680 con 0x7ff4dc12ffc0 2023-09-29T23:24:15.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.021+0000 7ff4da7fc700 1 -- 172.21.15.92:0/41401745 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c400b7e0 con 0x7ff4dc12ffc0 2023-09-29T23:24:15.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.021+0000 7ff4da7fc700 1 -- 172.21.15.92:0/41401745 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4c400b990 con 0x7ff4dc12ffc0 2023-09-29T23:24:15.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.022+0000 7ff4e17b4700 1 -- 172.21.15.92:0/41401745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4dc12ffc0 msgr2=0x7ff4dc0a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:15.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.022+0000 7ff4e17b4700 1 --2- 172.21.15.92:0/41401745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4dc12ffc0 0x7ff4dc0a3090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4009860 tx=0x7ff4c40091a0 comp rx=0 tx=0).stop 2023-09-29T23:24:15.023 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.022+0000 7ff4e17b4700 1 -- 172.21.15.92:0/41401745 shutdown_connections 2023-09-29T23:24:15.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.022+0000 7ff4e17b4700 1 --2- 172.21.15.92:0/41401745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4dc12ffc0 0x7ff4dc0a3090 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:15.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.022+0000 7ff4e17b4700 1 -- 172.21.15.92:0/41401745 >> 172.21.15.92:0/41401745 conn(0x7ff4dc068000 msgr2=0x7ff4dc0a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:15.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.022+0000 7ff4e17b4700 1 -- 172.21.15.92:0/41401745 shutdown_connections 2023-09-29T23:24:15.024 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.022+0000 7ff4e17b4700 1 -- 172.21.15.92:0/41401745 wait complete. 2023-09-29T23:24:15.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.023+0000 7ff4e17b4700 1 Processor -- start 2023-09-29T23:24:15.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.023+0000 7ff4e17b4700 1 -- start start 2023-09-29T23:24:15.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.023+0000 7ff4e17b4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4dc09fd80 0x7ff4dc11def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:15.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.023+0000 7ff4e17b4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc11cb30 con 0x7ff4dc09fd80 2023-09-29T23:24:15.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.023+0000 7ff4daffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4dc09fd80 0x7ff4dc11def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:15.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.023+0000 7ff4daffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4dc09fd80 0x7ff4dc11def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42980/0 (socket says 172.21.15.92:42980) 2023-09-29T23:24:15.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.023+0000 7ff4daffd700 1 -- 172.21.15.92:0/149709059 learned_addr learned my addr 172.21.15.92:0/149709059 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:24:15.026 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.024+0000 7ff4daffd700 1 -- 172.21.15.92:0/149709059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c4009420 con 0x7ff4dc09fd80 2023-09-29T23:24:15.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.024+0000 7ff4daffd700 1 --2- 172.21.15.92:0/149709059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4dc09fd80 0x7ff4dc11def0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00c460 tx=0x7ff4cc001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:15.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.024+0000 7ff4d37fe700 1 -- 172.21.15.92:0/149709059 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4cc005b30 con 0x7ff4dc09fd80 2023-09-29T23:24:15.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.024+0000 7ff4d37fe700 1 -- 172.21.15.92:0/149709059 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc005c90 con 0x7ff4dc09fd80 2023-09-29T23:24:15.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.024+0000 7ff4e17b4700 1 -- 172.21.15.92:0/149709059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4dc11da60 con 0x7ff4dc09fd80 2023-09-29T23:24:15.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.024+0000 7ff4d37fe700 1 -- 172.21.15.92:0/149709059 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4cc0070d0 con 0x7ff4dc09fd80 2023-09-29T23:24:15.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.024+0000 7ff4e17b4700 1 -- 172.21.15.92:0/149709059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4dc11a750 con 0x7ff4dc09fd80 2023-09-29T23:24:15.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.025+0000 7ff4d37fe700 1 -- 172.21.15.92:0/149709059 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7ff4cc007230 con 0x7ff4dc09fd80 2023-09-29T23:24:15.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.025+0000 7ff4e17b4700 1 -- 172.21.15.92:0/149709059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4dc0a30e0 con 0x7ff4dc09fd80 2023-09-29T23:24:15.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.025+0000 7ff4d37fe700 1 --2- 172.21.15.92:0/149709059 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff4bc035630 0x7ff4bc037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:15.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.025+0000 7ff4d37fe700 1 -- 172.21.15.92:0/149709059 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7ff4cc046810 con 0x7ff4dc09fd80 2023-09-29T23:24:15.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.025+0000 7ff4d27fc700 1 --2- 172.21.15.92:0/149709059 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff4bc035630 0x7ff4bc037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:15.027 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.025+0000 7ff4d27fc700 1 --2- 172.21.15.92:0/149709059 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff4bc035630 0x7ff4bc037ae0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4009860 tx=0x7ff4c4016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:15.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.029+0000 7ff4d37fe700 1 -- 172.21.15.92:0/149709059 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4cc0108f0 con 0x7ff4dc09fd80 2023-09-29T23:24:15.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.256+0000 7ff4e17b4700 1 -- 172.21.15.92:0/149709059 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff4dc0a1ba0 con 0x7ff4dc09fd80 2023-09-29T23:24:15.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.256+0000 7ff4d37fe700 1 -- 172.21.15.92:0/149709059 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7ff4cc010300 con 0x7ff4dc09fd80 2023-09-29T23:24:15.257 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:24:15.257 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:24:15.258 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.258+0000 7ff4e17b4700 1 -- 172.21.15.92:0/149709059 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff4bc035630 msgr2=0x7ff4bc037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:15.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.258+0000 7ff4e17b4700 1 --2- 172.21.15.92:0/149709059 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff4bc035630 0x7ff4bc037ae0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4009860 tx=0x7ff4c4016000 comp rx=0 tx=0).stop 2023-09-29T23:24:15.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.258+0000 7ff4e17b4700 1 -- 172.21.15.92:0/149709059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4dc09fd80 msgr2=0x7ff4dc11def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:15.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.258+0000 7ff4e17b4700 1 --2- 172.21.15.92:0/149709059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4dc09fd80 0x7ff4dc11def0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00c460 tx=0x7ff4cc001020 comp rx=0 tx=0).stop 2023-09-29T23:24:15.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.258+0000 7ff4e17b4700 1 -- 172.21.15.92:0/149709059 shutdown_connections 2023-09-29T23:24:15.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.258+0000 7ff4e17b4700 1 --2- 172.21.15.92:0/149709059 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff4bc035630 0x7ff4bc037ae0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:15.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.258+0000 7ff4e17b4700 1 --2- 172.21.15.92:0/149709059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4dc09fd80 0x7ff4dc11def0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:15.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.258+0000 7ff4e17b4700 1 -- 172.21.15.92:0/149709059 >> 172.21.15.92:0/149709059 conn(0x7ff4dc068000 msgr2=0x7ff4dc12def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:15.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.258+0000 7ff4e17b4700 1 -- 172.21.15.92:0/149709059 shutdown_connections 2023-09-29T23:24:15.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:15.258+0000 7ff4e17b4700 1 -- 172.21.15.92:0/149709059 wait complete. 2023-09-29T23:24:18.271 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:24:18.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.391+0000 7fad63771700 1 Processor -- start 2023-09-29T23:24:18.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.391+0000 7fad63771700 1 -- start start 2023-09-29T23:24:18.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.392+0000 7fad63771700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fad5c06df20 0x7fad5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:18.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.392+0000 7fad63771700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c06c840 con 0x7fad5c06e830 2023-09-29T23:24:18.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.392+0000 7fad63771700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5c06cae0 con 0x7fad5c06df20 2023-09-29T23:24:18.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.392+0000 7fad6150d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fad5c06df20 0x7fad5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:18.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.392+0000 7fad60d0c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fad5c06e830 0x7fad5c0994c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:55374/0 (socket says 172.21.15.92:55374) 2023-09-29T23:24:18.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.392+0000 7fad60d0c700 1 -- 172.21.15.92:0/353974691 learned_addr learned my addr 172.21.15.92:0/353974691 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:24:18.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.392+0000 7fad6150d700 1 -- 172.21.15.92:0/353974691 >> v1:172.21.15.92:6789/0 conn(0x7fad5c06e830 legacy=0x7fad5c0994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:18.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.392+0000 7fad6150d700 1 -- 172.21.15.92:0/353974691 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c09b080 con 0x7fad5c06df20 2023-09-29T23:24:18.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.392+0000 7fad6150d700 1 --2- 172.21.15.92:0/353974691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c06df20 0x7fad5c06e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fad58009de0 tx=0x7fad58009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3082cda4f5f889 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:18.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.392+0000 7fad53fff700 1 -- 172.21.15.92:0/353974691 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad5800e070 con 0x7fad5c06df20 2023-09-29T23:24:18.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.392+0000 7fad53fff700 1 -- 172.21.15.92:0/353974691 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5800bc80 con 0x7fad5c06df20 2023-09-29T23:24:18.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.392+0000 7fad53fff700 1 -- 172.21.15.92:0/353974691 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad58012430 con 0x7fad5c06df20 2023-09-29T23:24:18.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.393+0000 7fad63771700 1 -- 172.21.15.92:0/353974691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c06df20 msgr2=0x7fad5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:18.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.393+0000 7fad63771700 1 --2- 172.21.15.92:0/353974691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c06df20 0x7fad5c06e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fad58009de0 tx=0x7fad58009780 comp rx=0 tx=0).stop 2023-09-29T23:24:18.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.393+0000 7fad63771700 1 -- 172.21.15.92:0/353974691 shutdown_connections 2023-09-29T23:24:18.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.393+0000 7fad63771700 1 --2- 172.21.15.92:0/353974691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c06df20 0x7fad5c06e2f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:18.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.393+0000 7fad63771700 1 -- 172.21.15.92:0/353974691 >> 172.21.15.92:0/353974691 conn(0x7fad5c068930 msgr2=0x7fad5c09ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:18.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.393+0000 7fad63771700 1 -- 172.21.15.92:0/353974691 shutdown_connections 2023-09-29T23:24:18.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.393+0000 7fad63771700 1 -- 172.21.15.92:0/353974691 wait complete. 2023-09-29T23:24:18.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.394+0000 7fad63771700 1 Processor -- start 2023-09-29T23:24:18.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.394+0000 7fad63771700 1 -- start start 2023-09-29T23:24:18.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.394+0000 7fad63771700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c06df20 0x7fad5c12f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:18.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.394+0000 7fad63771700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c122120 con 0x7fad5c06df20 2023-09-29T23:24:18.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.394+0000 7fad6150d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c06df20 0x7fad5c12f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:18.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.394+0000 7fad6150d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c06df20 0x7fad5c12f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43006/0 (socket says 172.21.15.92:43006) 2023-09-29T23:24:18.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.394+0000 7fad6150d700 1 -- 172.21.15.92:0/3573231796 learned_addr learned my addr 172.21.15.92:0/3573231796 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:24:18.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.395+0000 7fad6150d700 1 -- 172.21.15.92:0/3573231796 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad58009a20 con 0x7fad5c06df20 2023-09-29T23:24:18.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.395+0000 7fad6150d700 1 --2- 172.21.15.92:0/3573231796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c06df20 0x7fad5c12f620 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fad580099f0 tx=0x7fad58018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:18.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.395+0000 7fad517fa700 1 -- 172.21.15.92:0/3573231796 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad58027470 con 0x7fad5c06df20 2023-09-29T23:24:18.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.395+0000 7fad517fa700 1 -- 172.21.15.92:0/3573231796 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad580275d0 con 0x7fad5c06df20 2023-09-29T23:24:18.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.395+0000 7fad63771700 1 -- 172.21.15.92:0/3573231796 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5c121e10 con 0x7fad5c06df20 2023-09-29T23:24:18.398 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.395+0000 7fad517fa700 1 -- 172.21.15.92:0/3573231796 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad580278c0 con 0x7fad5c06df20 2023-09-29T23:24:18.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.395+0000 7fad63771700 1 -- 172.21.15.92:0/3573231796 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5c11f140 con 0x7fad5c06df20 2023-09-29T23:24:18.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.396+0000 7fad517fa700 1 -- 172.21.15.92:0/3573231796 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fad58024070 con 0x7fad5c06df20 2023-09-29T23:24:18.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.396+0000 7fad517fa700 1 --2- 172.21.15.92:0/3573231796 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fad40035640 0x7fad40037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:18.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.396+0000 7fad63771700 1 -- 172.21.15.92:0/3573231796 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5c11eaa0 con 0x7fad5c06df20 2023-09-29T23:24:18.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.396+0000 7fad517fa700 1 -- 172.21.15.92:0/3573231796 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7fad58049d00 con 0x7fad5c06df20 2023-09-29T23:24:18.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.396+0000 7fad60d0c700 1 --2- 172.21.15.92:0/3573231796 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fad40035640 0x7fad40037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:18.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.396+0000 7fad60d0c700 1 --2- 172.21.15.92:0/3573231796 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fad40035640 0x7fad40037af0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0016a0 tx=0x7fad4c007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:18.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.401+0000 7fad517fa700 1 -- 172.21.15.92:0/3573231796 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad58027a20 con 0x7fad5c06df20 2023-09-29T23:24:18.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.623+0000 7fad63771700 1 -- 172.21.15.92:0/3573231796 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fad5c05f230 con 0x7fad5c06df20 2023-09-29T23:24:18.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.623+0000 7fad517fa700 1 -- 172.21.15.92:0/3573231796 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fad58046030 con 0x7fad5c06df20 2023-09-29T23:24:18.624 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:24:18.624 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:24:18.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.625+0000 7fad63771700 1 -- 172.21.15.92:0/3573231796 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fad40035640 msgr2=0x7fad40037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:18.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.625+0000 7fad63771700 1 --2- 172.21.15.92:0/3573231796 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fad40035640 0x7fad40037af0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0016a0 tx=0x7fad4c007b30 comp rx=0 tx=0).stop 2023-09-29T23:24:18.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.625+0000 7fad63771700 1 -- 172.21.15.92:0/3573231796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c06df20 msgr2=0x7fad5c12f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:18.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.625+0000 7fad63771700 1 --2- 172.21.15.92:0/3573231796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c06df20 0x7fad5c12f620 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fad580099f0 tx=0x7fad58018000 comp rx=0 tx=0).stop 2023-09-29T23:24:18.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.625+0000 7fad63771700 1 -- 172.21.15.92:0/3573231796 shutdown_connections 2023-09-29T23:24:18.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.625+0000 7fad63771700 1 --2- 172.21.15.92:0/3573231796 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fad40035640 0x7fad40037af0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:18.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.625+0000 7fad63771700 1 --2- 172.21.15.92:0/3573231796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad5c06df20 0x7fad5c12f620 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:18.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.625+0000 7fad63771700 1 -- 172.21.15.92:0/3573231796 >> 172.21.15.92:0/3573231796 conn(0x7fad5c068930 msgr2=0x7fad5c117140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:18.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.625+0000 7fad63771700 1 -- 172.21.15.92:0/3573231796 shutdown_connections 2023-09-29T23:24:18.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:18.625+0000 7fad63771700 1 -- 172.21.15.92:0/3573231796 wait complete. 2023-09-29T23:24:21.638 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:24:21.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.758+0000 7fa7f8bcf700 1 Processor -- start 2023-09-29T23:24:21.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.758+0000 7fa7f8bcf700 1 -- start start 2023-09-29T23:24:21.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.759+0000 7fa7f8bcf700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa7f40a3030 0x7fa7f412f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:21.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.759+0000 7fa7f8bcf700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f40997f0 con 0x7fa7f412fae0 2023-09-29T23:24:21.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.759+0000 7fa7f8bcf700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f40a3400 con 0x7fa7f40a3030 2023-09-29T23:24:21.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.759+0000 7fa7f259c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa7f40a3030 0x7fa7f412f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:21.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.759+0000 7fa7f1d9b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fa7f412fae0 0x7fa7f4095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:37392/0 (socket says 172.21.15.92:37392) 2023-09-29T23:24:21.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.759+0000 7fa7f1d9b700 1 -- 172.21.15.92:0/871768982 learned_addr learned my addr 172.21.15.92:0/871768982 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:24:21.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.759+0000 7fa7f259c700 1 -- 172.21.15.92:0/871768982 >> v1:172.21.15.92:6789/0 conn(0x7fa7f412fae0 legacy=0x7fa7f4095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:21.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.760+0000 7fa7f259c700 1 -- 172.21.15.92:0/871768982 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f40977a0 con 0x7fa7f40a3030 2023-09-29T23:24:21.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.760+0000 7fa7f159a700 1 -- 172.21.15.92:0/871768982 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759183630 0 0) 0x7fa7f40997f0 con 0x7fa7f412fae0 2023-09-29T23:24:21.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.760+0000 7fa7f259c700 1 --2- 172.21.15.92:0/871768982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f40a3030 0x7fa7f412f5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009de0 tx=0x7fa7e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e50851e77663c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:21.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.760+0000 7fa7f159a700 1 -- 172.21.15.92:0/871768982 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7e400e070 con 0x7fa7f40a3030 2023-09-29T23:24:21.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.760+0000 7fa7f159a700 1 -- 172.21.15.92:0/871768982 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e400bd10 con 0x7fa7f40a3030 2023-09-29T23:24:21.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.760+0000 7fa7f159a700 1 -- 172.21.15.92:0/871768982 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7e4012430 con 0x7fa7f40a3030 2023-09-29T23:24:21.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.760+0000 7fa7f8bcf700 1 -- 172.21.15.92:0/871768982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f40a3030 msgr2=0x7fa7f412f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:21.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.760+0000 7fa7f8bcf700 1 --2- 172.21.15.92:0/871768982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f40a3030 0x7fa7f412f5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009de0 tx=0x7fa7e4009780 comp rx=0 tx=0).stop 2023-09-29T23:24:21.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.760+0000 7fa7f8bcf700 1 -- 172.21.15.92:0/871768982 shutdown_connections 2023-09-29T23:24:21.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.760+0000 7fa7f8bcf700 1 --2- 172.21.15.92:0/871768982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f40a3030 0x7fa7f412f5a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:21.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.760+0000 7fa7f8bcf700 1 -- 172.21.15.92:0/871768982 >> 172.21.15.92:0/871768982 conn(0x7fa7f4067fc0 msgr2=0x7fa7f40a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:21.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.760+0000 7fa7f8bcf700 1 -- 172.21.15.92:0/871768982 shutdown_connections 2023-09-29T23:24:21.762 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.760+0000 7fa7f8bcf700 1 -- 172.21.15.92:0/871768982 wait complete. 2023-09-29T23:24:21.764 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.761+0000 7fa7f8bcf700 1 Processor -- start 2023-09-29T23:24:21.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.761+0000 7fa7f8bcf700 1 -- start start 2023-09-29T23:24:21.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.762+0000 7fa7f8bcf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f40a3030 0x7fa7f413e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:21.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.762+0000 7fa7f8bcf700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f411d1f0 con 0x7fa7f40a3030 2023-09-29T23:24:21.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.762+0000 7fa7f259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f40a3030 0x7fa7f413e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:21.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.762+0000 7fa7f259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f40a3030 0x7fa7f413e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59562/0 (socket says 172.21.15.92:59562) 2023-09-29T23:24:21.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.762+0000 7fa7f259c700 1 -- 172.21.15.92:0/1553271107 learned_addr learned my addr 172.21.15.92:0/1553271107 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:24:21.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.762+0000 7fa7f259c700 1 -- 172.21.15.92:0/1553271107 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e4009a20 con 0x7fa7f40a3030 2023-09-29T23:24:21.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.762+0000 7fa7f259c700 1 --2- 172.21.15.92:0/1553271107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f40a3030 0x7fa7f413e4d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40097c0 tx=0x7fa7e4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:21.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.762+0000 7fa7e27fc700 1 -- 172.21.15.92:0/1553271107 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7e401d640 con 0x7fa7f40a3030 2023-09-29T23:24:21.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.762+0000 7fa7e27fc700 1 -- 172.21.15.92:0/1553271107 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e401d7a0 con 0x7fa7f40a3030 2023-09-29T23:24:21.765 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.762+0000 7fa7e27fc700 1 -- 172.21.15.92:0/1553271107 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7e401da90 con 0x7fa7f40a3030 2023-09-29T23:24:21.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.762+0000 7fa7f8bcf700 1 -- 172.21.15.92:0/1553271107 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f412ce00 con 0x7fa7f40a3030 2023-09-29T23:24:21.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.762+0000 7fa7f8bcf700 1 -- 172.21.15.92:0/1553271107 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f411e630 con 0x7fa7f40a3030 2023-09-29T23:24:21.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.763+0000 7fa7e27fc700 1 -- 172.21.15.92:0/1553271107 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fa7e4024070 con 0x7fa7f40a3030 2023-09-29T23:24:21.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.763+0000 7fa7f8bcf700 1 -- 172.21.15.92:0/1553271107 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f411d060 con 0x7fa7f40a3030 2023-09-29T23:24:21.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.763+0000 7fa7e27fc700 1 --2- 172.21.15.92:0/1553271107 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa7d4035640 0x7fa7d4037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:21.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.763+0000 7fa7e27fc700 1 -- 172.21.15.92:0/1553271107 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7fa7e404a2d0 con 0x7fa7f40a3030 2023-09-29T23:24:21.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.763+0000 7fa7f1d9b700 1 --2- 172.21.15.92:0/1553271107 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa7d4035640 0x7fa7d4037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:21.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.764+0000 7fa7f1d9b700 1 --2- 172.21.15.92:0/1553271107 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa7d4035640 0x7fa7d4037af0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80011e0 tx=0x7fa7e80079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:21.768 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.768+0000 7fa7e27fc700 1 -- 172.21.15.92:0/1553271107 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7e401dbf0 con 0x7fa7f40a3030 2023-09-29T23:24:21.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.990+0000 7fa7f8bcf700 1 -- 172.21.15.92:0/1553271107 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa7f4097d10 con 0x7fa7f40a3030 2023-09-29T23:24:21.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.990+0000 7fa7e27fc700 1 -- 172.21.15.92:0/1553271107 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fa7e401cb60 con 0x7fa7f40a3030 2023-09-29T23:24:21.991 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:24:21.991 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:24:21.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.992+0000 7fa7f8bcf700 1 -- 172.21.15.92:0/1553271107 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa7d4035640 msgr2=0x7fa7d4037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:21.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.992+0000 7fa7f8bcf700 1 --2- 172.21.15.92:0/1553271107 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa7d4035640 0x7fa7d4037af0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80011e0 tx=0x7fa7e80079d0 comp rx=0 tx=0).stop 2023-09-29T23:24:21.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.992+0000 7fa7f8bcf700 1 -- 172.21.15.92:0/1553271107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f40a3030 msgr2=0x7fa7f413e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:21.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.992+0000 7fa7f8bcf700 1 --2- 172.21.15.92:0/1553271107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f40a3030 0x7fa7f413e4d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40097c0 tx=0x7fa7e4018000 comp rx=0 tx=0).stop 2023-09-29T23:24:21.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.992+0000 7fa7f8bcf700 1 -- 172.21.15.92:0/1553271107 shutdown_connections 2023-09-29T23:24:21.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.992+0000 7fa7f8bcf700 1 --2- 172.21.15.92:0/1553271107 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa7d4035640 0x7fa7d4037af0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:21.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.992+0000 7fa7f8bcf700 1 --2- 172.21.15.92:0/1553271107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f40a3030 0x7fa7f413e4d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:21.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.993+0000 7fa7f8bcf700 1 -- 172.21.15.92:0/1553271107 >> 172.21.15.92:0/1553271107 conn(0x7fa7f4067fc0 msgr2=0x7fa7f412d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:21.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.993+0000 7fa7f8bcf700 1 -- 172.21.15.92:0/1553271107 shutdown_connections 2023-09-29T23:24:21.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:21.993+0000 7fa7f8bcf700 1 -- 172.21.15.92:0/1553271107 wait complete. 2023-09-29T23:24:25.005 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:24:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.134+0000 7f9a54be0700 1 Processor -- start 2023-09-29T23:24:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.134+0000 7f9a54be0700 1 -- start start 2023-09-29T23:24:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.134+0000 7f9a54be0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9a5009fd80 0x7f9a500a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.134+0000 7f9a54be0700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a50098710 con 0x7f9a5012f8b0 2023-09-29T23:24:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.134+0000 7f9a54be0700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5012f340 con 0x7f9a5009fd80 2023-09-29T23:24:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.134+0000 7f9a4e59c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9a5009fd80 0x7f9a500a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.134+0000 7f9a45d9b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f9a5012f8b0 0x7f9a50095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:37402/0 (socket says 172.21.15.92:37402) 2023-09-29T23:24:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.134+0000 7f9a45d9b700 1 -- 172.21.15.92:0/2174088388 learned_addr learned my addr 172.21.15.92:0/2174088388 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:24:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.134+0000 7f9a4e59c700 1 -- 172.21.15.92:0/2174088388 >> v1:172.21.15.92:6789/0 conn(0x7f9a5012f8b0 legacy=0x7f9a50095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.134+0000 7f9a4e59c700 1 -- 172.21.15.92:0/2174088388 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a500997e0 con 0x7f9a5009fd80 2023-09-29T23:24:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.134+0000 7f9a4dd9b700 1 -- 172.21.15.92:0/2174088388 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045239910 0 0) 0x7f9a50098710 con 0x7f9a5012f8b0 2023-09-29T23:24:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.135+0000 7f9a4e59c700 1 --2- 172.21.15.92:0/2174088388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a5009fd80 0x7f9a500a3090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009860 tx=0x7f9a400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cec301038deb597 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.135+0000 7f9a4dd9b700 1 -- 172.21.15.92:0/2174088388 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a4000b680 con 0x7f9a5009fd80 2023-09-29T23:24:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.135+0000 7f9a4dd9b700 1 -- 172.21.15.92:0/2174088388 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4000b7e0 con 0x7f9a5009fd80 2023-09-29T23:24:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.135+0000 7f9a4dd9b700 1 -- 172.21.15.92:0/2174088388 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a4000b990 con 0x7f9a5009fd80 2023-09-29T23:24:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.135+0000 7f9a54be0700 1 -- 172.21.15.92:0/2174088388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a5009fd80 msgr2=0x7f9a500a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.135+0000 7f9a54be0700 1 --2- 172.21.15.92:0/2174088388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a5009fd80 0x7f9a500a3090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009860 tx=0x7f9a400091a0 comp rx=0 tx=0).stop 2023-09-29T23:24:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.135+0000 7f9a54be0700 1 -- 172.21.15.92:0/2174088388 shutdown_connections 2023-09-29T23:24:25.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.135+0000 7f9a54be0700 1 --2- 172.21.15.92:0/2174088388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a5009fd80 0x7f9a500a3090 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:25.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.135+0000 7f9a54be0700 1 -- 172.21.15.92:0/2174088388 >> 172.21.15.92:0/2174088388 conn(0x7f9a50068000 msgr2=0x7f9a500a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:25.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.135+0000 7f9a54be0700 1 -- 172.21.15.92:0/2174088388 shutdown_connections 2023-09-29T23:24:25.138 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.135+0000 7f9a54be0700 1 -- 172.21.15.92:0/2174088388 wait complete. 2023-09-29T23:24:25.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.136+0000 7f9a54be0700 1 Processor -- start 2023-09-29T23:24:25.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.136+0000 7f9a54be0700 1 -- start start 2023-09-29T23:24:25.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.137+0000 7f9a54be0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a5009fd80 0x7f9a5013e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:25.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.137+0000 7f9a54be0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5011e2c0 con 0x7f9a5009fd80 2023-09-29T23:24:25.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.137+0000 7f9a4e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a5009fd80 0x7f9a5013e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:25.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.137+0000 7f9a4e59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a5009fd80 0x7f9a5013e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59584/0 (socket says 172.21.15.92:59584) 2023-09-29T23:24:25.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.137+0000 7f9a4e59c700 1 -- 172.21.15.92:0/3400673215 learned_addr learned my addr 172.21.15.92:0/3400673215 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:24:25.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.137+0000 7f9a4e59c700 1 -- 172.21.15.92:0/3400673215 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a40009420 con 0x7f9a5009fd80 2023-09-29T23:24:25.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.137+0000 7f9a4e59c700 1 --2- 172.21.15.92:0/3400673215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a5009fd80 0x7f9a5013e520 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9a40000c00 tx=0x7f9a40016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:25.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.137+0000 7f9a46ffd700 1 -- 172.21.15.92:0/3400673215 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a40011e70 con 0x7f9a5009fd80 2023-09-29T23:24:25.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.137+0000 7f9a46ffd700 1 -- 172.21.15.92:0/3400673215 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a40020070 con 0x7f9a5009fd80 2023-09-29T23:24:25.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.137+0000 7f9a54be0700 1 -- 172.21.15.92:0/3400673215 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5011c590 con 0x7f9a5009fd80 2023-09-29T23:24:25.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.137+0000 7f9a46ffd700 1 -- 172.21.15.92:0/3400673215 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a4001b590 con 0x7f9a5009fd80 2023-09-29T23:24:25.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.137+0000 7f9a54be0700 1 -- 172.21.15.92:0/3400673215 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5011d1c0 con 0x7f9a5009fd80 2023-09-29T23:24:25.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.138+0000 7f9a46ffd700 1 -- 172.21.15.92:0/3400673215 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f9a40022030 con 0x7f9a5009fd80 2023-09-29T23:24:25.141 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.138+0000 7f9a54be0700 1 -- 172.21.15.92:0/3400673215 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5011e410 con 0x7f9a5009fd80 2023-09-29T23:24:25.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.138+0000 7f9a46ffd700 1 --2- 172.21.15.92:0/3400673215 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9a30035640 0x7f9a30037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:25.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.138+0000 7f9a46ffd700 1 -- 172.21.15.92:0/3400673215 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f9a400492e0 con 0x7f9a5009fd80 2023-09-29T23:24:25.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.138+0000 7f9a45d9b700 1 --2- 172.21.15.92:0/3400673215 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9a30035640 0x7f9a30037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:25.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.139+0000 7f9a45d9b700 1 --2- 172.21.15.92:0/3400673215 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9a30035640 0x7f9a30037af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9a380011e0 tx=0x7f9a380079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:25.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.143+0000 7f9a46ffd700 1 -- 172.21.15.92:0/3400673215 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a400249c0 con 0x7f9a5009fd80 2023-09-29T23:24:25.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.364+0000 7f9a54be0700 1 -- 172.21.15.92:0/3400673215 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9a5011e7b0 con 0x7f9a5009fd80 2023-09-29T23:24:25.365 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.365+0000 7f9a46ffd700 1 -- 172.21.15.92:0/3400673215 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f9a400193f0 con 0x7f9a5009fd80 2023-09-29T23:24:25.365 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:24:25.365 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:24:25.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.366+0000 7f9a54be0700 1 -- 172.21.15.92:0/3400673215 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9a30035640 msgr2=0x7f9a30037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:25.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.366+0000 7f9a54be0700 1 --2- 172.21.15.92:0/3400673215 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9a30035640 0x7f9a30037af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9a380011e0 tx=0x7f9a380079d0 comp rx=0 tx=0).stop 2023-09-29T23:24:25.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.366+0000 7f9a54be0700 1 -- 172.21.15.92:0/3400673215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a5009fd80 msgr2=0x7f9a5013e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:25.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.366+0000 7f9a54be0700 1 --2- 172.21.15.92:0/3400673215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a5009fd80 0x7f9a5013e520 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9a40000c00 tx=0x7f9a40016000 comp rx=0 tx=0).stop 2023-09-29T23:24:25.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.366+0000 7f9a54be0700 1 -- 172.21.15.92:0/3400673215 shutdown_connections 2023-09-29T23:24:25.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.366+0000 7f9a54be0700 1 --2- 172.21.15.92:0/3400673215 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9a30035640 0x7f9a30037af0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:25.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.366+0000 7f9a54be0700 1 --2- 172.21.15.92:0/3400673215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a5009fd80 0x7f9a5013e520 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:25.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.366+0000 7f9a54be0700 1 -- 172.21.15.92:0/3400673215 >> 172.21.15.92:0/3400673215 conn(0x7f9a50068000 msgr2=0x7f9a50094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:25.367 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.366+0000 7f9a54be0700 1 -- 172.21.15.92:0/3400673215 shutdown_connections 2023-09-29T23:24:25.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:25.367+0000 7f9a54be0700 1 -- 172.21.15.92:0/3400673215 wait complete. 2023-09-29T23:24:28.379 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:24:28.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.501+0000 7f3441554700 1 Processor -- start 2023-09-29T23:24:28.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.501+0000 7f3441554700 1 -- start start 2023-09-29T23:24:28.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.501+0000 7f3441554700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f343c0963e0 0x7f343c0967b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:28.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.501+0000 7f3441554700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343c096220 con 0x7f343c096cf0 2023-09-29T23:24:28.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.501+0000 7f3441554700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343c098ad0 con 0x7f343c0963e0 2023-09-29T23:24:28.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.502+0000 7f343affd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f343c0963e0 0x7f343c0967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:28.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.502+0000 7f34327fc700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f343c096cf0 0x7f343c12b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:37418/0 (socket says 172.21.15.92:37418) 2023-09-29T23:24:28.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.502+0000 7f34327fc700 1 -- 172.21.15.92:0/635216412 learned_addr learned my addr 172.21.15.92:0/635216412 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:24:28.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.502+0000 7f343affd700 1 -- 172.21.15.92:0/635216412 >> v1:172.21.15.92:6789/0 conn(0x7f343c096cf0 legacy=0x7f343c12b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:28.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.502+0000 7f343affd700 1 -- 172.21.15.92:0/635216412 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c0972d0 con 0x7f343c0963e0 2023-09-29T23:24:28.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.502+0000 7f343affd700 1 --2- 172.21.15.92:0/635216412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f343c0963e0 0x7f343c0967b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f342c009850 tx=0x7f342c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4fe063b2ea1bb14 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:28.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.502+0000 7f343a7fc700 1 -- 172.21.15.92:0/635216412 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f342c005c10 con 0x7f343c0963e0 2023-09-29T23:24:28.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.502+0000 7f343a7fc700 1 -- 172.21.15.92:0/635216412 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c005d70 con 0x7f343c0963e0 2023-09-29T23:24:28.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.502+0000 7f343a7fc700 1 -- 172.21.15.92:0/635216412 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f342c006030 con 0x7f343c0963e0 2023-09-29T23:24:28.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.502+0000 7f3441554700 1 -- 172.21.15.92:0/635216412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f343c0963e0 msgr2=0x7f343c0967b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:28.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.502+0000 7f3441554700 1 --2- 172.21.15.92:0/635216412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f343c0963e0 0x7f343c0967b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f342c009850 tx=0x7f342c009120 comp rx=0 tx=0).stop 2023-09-29T23:24:28.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.503+0000 7f3441554700 1 -- 172.21.15.92:0/635216412 shutdown_connections 2023-09-29T23:24:28.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.503+0000 7f3441554700 1 --2- 172.21.15.92:0/635216412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f343c0963e0 0x7f343c0967b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:28.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.503+0000 7f3441554700 1 -- 172.21.15.92:0/635216412 >> 172.21.15.92:0/635216412 conn(0x7f343c06bd70 msgr2=0x7f343c06e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:28.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.503+0000 7f3441554700 1 -- 172.21.15.92:0/635216412 shutdown_connections 2023-09-29T23:24:28.505 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.503+0000 7f3441554700 1 -- 172.21.15.92:0/635216412 wait complete. 2023-09-29T23:24:28.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.503+0000 7f3441554700 1 Processor -- start 2023-09-29T23:24:28.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.504+0000 7f3441554700 1 -- start start 2023-09-29T23:24:28.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.504+0000 7f3441554700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f343c0963e0 0x7f343c124550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:28.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.504+0000 7f3441554700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c1260a0 con 0x7f343c0963e0 2023-09-29T23:24:28.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.504+0000 7f343affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f343c0963e0 0x7f343c124550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:28.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.504+0000 7f343affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f343c0963e0 0x7f343c124550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59588/0 (socket says 172.21.15.92:59588) 2023-09-29T23:24:28.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.504+0000 7f343affd700 1 -- 172.21.15.92:0/1411021905 learned_addr learned my addr 172.21.15.92:0/1411021905 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:24:28.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.504+0000 7f343affd700 1 -- 172.21.15.92:0/1411021905 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c0093c0 con 0x7f343c0963e0 2023-09-29T23:24:28.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.504+0000 7f343affd700 1 --2- 172.21.15.92:0/1411021905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f343c0963e0 0x7f343c124550 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f342c009fd0 tx=0x7f342c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:28.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.504+0000 7f34337fe700 1 -- 172.21.15.92:0/1411021905 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f342c01f070 con 0x7f343c0963e0 2023-09-29T23:24:28.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.504+0000 7f34337fe700 1 -- 172.21.15.92:0/1411021905 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c01a8b0 con 0x7f343c0963e0 2023-09-29T23:24:28.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.504+0000 7f3441554700 1 -- 172.21.15.92:0/1411021905 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343c1275f0 con 0x7f343c0963e0 2023-09-29T23:24:28.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.504+0000 7f34337fe700 1 -- 172.21.15.92:0/1411021905 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f342c01ab80 con 0x7f343c0963e0 2023-09-29T23:24:28.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.505+0000 7f3441554700 1 -- 172.21.15.92:0/1411021905 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343c128750 con 0x7f343c0963e0 2023-09-29T23:24:28.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.505+0000 7f34337fe700 1 -- 172.21.15.92:0/1411021905 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f342c01ad30 con 0x7f343c0963e0 2023-09-29T23:24:28.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.505+0000 7f34337fe700 1 --2- 172.21.15.92:0/1411021905 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f341c035640 0x7f341c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:28.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.505+0000 7f3441554700 1 -- 172.21.15.92:0/1411021905 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343c125ea0 con 0x7f343c0963e0 2023-09-29T23:24:28.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.505+0000 7f34337fe700 1 -- 172.21.15.92:0/1411021905 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7f342c048010 con 0x7f343c0963e0 2023-09-29T23:24:28.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.506+0000 7f34327fc700 1 --2- 172.21.15.92:0/1411021905 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f341c035640 0x7f341c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:28.509 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.506+0000 7f34327fc700 1 --2- 172.21.15.92:0/1411021905 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f341c035640 0x7f341c037af0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f34240016a0 tx=0x7f3424007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:28.510 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.510+0000 7f34337fe700 1 -- 172.21.15.92:0/1411021905 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f342c0164e0 con 0x7f343c0963e0 2023-09-29T23:24:28.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.735+0000 7f3441554700 1 -- 172.21.15.92:0/1411021905 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f343c05f230 con 0x7f343c0963e0 2023-09-29T23:24:28.736 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.735+0000 7f34337fe700 1 -- 172.21.15.92:0/1411021905 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f342c0223b0 con 0x7f343c0963e0 2023-09-29T23:24:28.736 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:24:28.736 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:24:28.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.737+0000 7f3441554700 1 -- 172.21.15.92:0/1411021905 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f341c035640 msgr2=0x7f341c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:28.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.737+0000 7f3441554700 1 --2- 172.21.15.92:0/1411021905 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f341c035640 0x7f341c037af0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f34240016a0 tx=0x7f3424007b30 comp rx=0 tx=0).stop 2023-09-29T23:24:28.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.737+0000 7f3441554700 1 -- 172.21.15.92:0/1411021905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f343c0963e0 msgr2=0x7f343c124550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:28.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.737+0000 7f3441554700 1 --2- 172.21.15.92:0/1411021905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f343c0963e0 0x7f343c124550 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f342c009fd0 tx=0x7f342c016000 comp rx=0 tx=0).stop 2023-09-29T23:24:28.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.738+0000 7f3441554700 1 -- 172.21.15.92:0/1411021905 shutdown_connections 2023-09-29T23:24:28.738 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.738+0000 7f3441554700 1 --2- 172.21.15.92:0/1411021905 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f341c035640 0x7f341c037af0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:28.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.738+0000 7f3441554700 1 --2- 172.21.15.92:0/1411021905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f343c0963e0 0x7f343c124550 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:28.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.738+0000 7f3441554700 1 -- 172.21.15.92:0/1411021905 >> 172.21.15.92:0/1411021905 conn(0x7f343c06bd70 msgr2=0x7f343c12af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:28.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.738+0000 7f3441554700 1 -- 172.21.15.92:0/1411021905 shutdown_connections 2023-09-29T23:24:28.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:28.738+0000 7f3441554700 1 -- 172.21.15.92:0/1411021905 wait complete. 2023-09-29T23:24:31.751 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:24:31.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.870+0000 7fa33bf0b700 1 Processor -- start 2023-09-29T23:24:31.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.870+0000 7fa33bf0b700 1 -- start start 2023-09-29T23:24:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.871+0000 7fa33bf0b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa3340a3030 0x7fa33412f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.871+0000 7fa33bf0b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3340997f0 con 0x7fa33412fae0 2023-09-29T23:24:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.871+0000 7fa33bf0b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3340a3400 con 0x7fa3340a3030 2023-09-29T23:24:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.871+0000 7fa339ca7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa3340a3030 0x7fa33412f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.871+0000 7fa3394a6700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fa33412fae0 0x7fa334095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:52724/0 (socket says 172.21.15.92:52724) 2023-09-29T23:24:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.871+0000 7fa3394a6700 1 -- 172.21.15.92:0/2785431166 learned_addr learned my addr 172.21.15.92:0/2785431166 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:24:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.871+0000 7fa339ca7700 1 -- 172.21.15.92:0/2785431166 >> v1:172.21.15.92:6789/0 conn(0x7fa33412fae0 legacy=0x7fa334095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.871+0000 7fa338ca5700 1 -- 172.21.15.92:0/2785431166 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092241299 0 0) 0x7fa3340997f0 con 0x7fa33412fae0 2023-09-29T23:24:31.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.871+0000 7fa339ca7700 1 -- 172.21.15.92:0/2785431166 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3340977a0 con 0x7fa3340a3030 2023-09-29T23:24:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.871+0000 7fa339ca7700 1 --2- 172.21.15.92:0/2785431166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3340a3030 0x7fa33412f5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa330009de0 tx=0x7fa330009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3381b69343ecf945 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.871+0000 7fa338ca5700 1 -- 172.21.15.92:0/2785431166 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa33000e070 con 0x7fa3340a3030 2023-09-29T23:24:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.871+0000 7fa338ca5700 1 -- 172.21.15.92:0/2785431166 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33000bd10 con 0x7fa3340a3030 2023-09-29T23:24:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.871+0000 7fa338ca5700 1 -- 172.21.15.92:0/2785431166 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa330012430 con 0x7fa3340a3030 2023-09-29T23:24:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.872+0000 7fa33bf0b700 1 -- 172.21.15.92:0/2785431166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3340a3030 msgr2=0x7fa33412f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.872+0000 7fa33bf0b700 1 --2- 172.21.15.92:0/2785431166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3340a3030 0x7fa33412f5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa330009de0 tx=0x7fa330009780 comp rx=0 tx=0).stop 2023-09-29T23:24:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.872+0000 7fa33bf0b700 1 -- 172.21.15.92:0/2785431166 shutdown_connections 2023-09-29T23:24:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.872+0000 7fa33bf0b700 1 --2- 172.21.15.92:0/2785431166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3340a3030 0x7fa33412f5a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.872+0000 7fa33bf0b700 1 -- 172.21.15.92:0/2785431166 >> 172.21.15.92:0/2785431166 conn(0x7fa334067fc0 msgr2=0x7fa3340a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:31.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.872+0000 7fa33bf0b700 1 -- 172.21.15.92:0/2785431166 shutdown_connections 2023-09-29T23:24:31.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.872+0000 7fa33bf0b700 1 -- 172.21.15.92:0/2785431166 wait complete. 2023-09-29T23:24:31.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.873+0000 7fa33bf0b700 1 Processor -- start 2023-09-29T23:24:31.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.873+0000 7fa33bf0b700 1 -- start start 2023-09-29T23:24:31.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.873+0000 7fa33bf0b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3340a3030 0x7fa33413e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:31.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.873+0000 7fa33bf0b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33411e850 con 0x7fa3340a3030 2023-09-29T23:24:31.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.873+0000 7fa339ca7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3340a3030 0x7fa33413e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:31.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.873+0000 7fa339ca7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3340a3030 0x7fa33413e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42140/0 (socket says 172.21.15.92:42140) 2023-09-29T23:24:31.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.873+0000 7fa339ca7700 1 -- 172.21.15.92:0/1531747737 learned_addr learned my addr 172.21.15.92:0/1531747737 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:24:31.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.873+0000 7fa339ca7700 1 -- 172.21.15.92:0/1531747737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa330009a20 con 0x7fa3340a3030 2023-09-29T23:24:31.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.874+0000 7fa339ca7700 1 --2- 172.21.15.92:0/1531747737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3340a3030 0x7fa33413e4d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa3300097c0 tx=0x7fa330018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:31.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.874+0000 7fa329ffb700 1 -- 172.21.15.92:0/1531747737 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa33000be80 con 0x7fa3340a3030 2023-09-29T23:24:31.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.874+0000 7fa329ffb700 1 -- 172.21.15.92:0/1531747737 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33001d640 con 0x7fa3340a3030 2023-09-29T23:24:31.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.874+0000 7fa33bf0b700 1 -- 172.21.15.92:0/1531747737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33411e540 con 0x7fa3340a3030 2023-09-29T23:24:31.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.874+0000 7fa329ffb700 1 -- 172.21.15.92:0/1531747737 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa33001d930 con 0x7fa3340a3030 2023-09-29T23:24:31.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.874+0000 7fa33bf0b700 1 -- 172.21.15.92:0/1531747737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33411dcb0 con 0x7fa3340a3030 2023-09-29T23:24:31.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.875+0000 7fa329ffb700 1 -- 172.21.15.92:0/1531747737 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fa330024070 con 0x7fa3340a3030 2023-09-29T23:24:31.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.875+0000 7fa33bf0b700 1 -- 172.21.15.92:0/1531747737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33411e2e0 con 0x7fa3340a3030 2023-09-29T23:24:31.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.875+0000 7fa329ffb700 1 --2- 172.21.15.92:0/1531747737 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa318035640 0x7fa318037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:31.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.875+0000 7fa329ffb700 1 -- 172.21.15.92:0/1531747737 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7fa33004a2f0 con 0x7fa3340a3030 2023-09-29T23:24:31.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.875+0000 7fa3394a6700 1 --2- 172.21.15.92:0/1531747737 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa318035640 0x7fa318037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:31.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.875+0000 7fa3394a6700 1 --2- 172.21.15.92:0/1531747737 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa318035640 0x7fa318037af0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa3240011e0 tx=0x7fa3240079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:31.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:31.880+0000 7fa329ffb700 1 -- 172.21.15.92:0/1531747737 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa33001da90 con 0x7fa3340a3030 2023-09-29T23:24:32.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:32.103+0000 7fa33bf0b700 1 -- 172.21.15.92:0/1531747737 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa33405f230 con 0x7fa3340a3030 2023-09-29T23:24:32.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:32.104+0000 7fa329ffb700 1 -- 172.21.15.92:0/1531747737 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fa33001cb10 con 0x7fa3340a3030 2023-09-29T23:24:32.104 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:24:32.104 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:24:32.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:32.106+0000 7fa33bf0b700 1 -- 172.21.15.92:0/1531747737 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa318035640 msgr2=0x7fa318037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:32.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:32.106+0000 7fa33bf0b700 1 --2- 172.21.15.92:0/1531747737 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa318035640 0x7fa318037af0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa3240011e0 tx=0x7fa3240079d0 comp rx=0 tx=0).stop 2023-09-29T23:24:32.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:32.106+0000 7fa33bf0b700 1 -- 172.21.15.92:0/1531747737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3340a3030 msgr2=0x7fa33413e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:32.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:32.106+0000 7fa33bf0b700 1 --2- 172.21.15.92:0/1531747737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3340a3030 0x7fa33413e4d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa3300097c0 tx=0x7fa330018000 comp rx=0 tx=0).stop 2023-09-29T23:24:32.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:32.106+0000 7fa33bf0b700 1 -- 172.21.15.92:0/1531747737 shutdown_connections 2023-09-29T23:24:32.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:32.106+0000 7fa33bf0b700 1 --2- 172.21.15.92:0/1531747737 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa318035640 0x7fa318037af0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:32.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:32.106+0000 7fa33bf0b700 1 --2- 172.21.15.92:0/1531747737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3340a3030 0x7fa33413e4d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:32.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:32.106+0000 7fa33bf0b700 1 -- 172.21.15.92:0/1531747737 >> 172.21.15.92:0/1531747737 conn(0x7fa334067fc0 msgr2=0x7fa33412d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:32.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:32.106+0000 7fa33bf0b700 1 -- 172.21.15.92:0/1531747737 shutdown_connections 2023-09-29T23:24:32.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:32.106+0000 7fa33bf0b700 1 -- 172.21.15.92:0/1531747737 wait complete. 2023-09-29T23:24:35.119 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:24:35.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.239+0000 7fa8c0a38700 1 Processor -- start 2023-09-29T23:24:35.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.239+0000 7fa8c0a38700 1 -- start start 2023-09-29T23:24:35.240 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.239+0000 7fa8c0a38700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa8bc09c600 0x7fa8bc0a3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:35.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.239+0000 7fa8c0a38700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8bc098320 con 0x7fa8bc12bc80 2023-09-29T23:24:35.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.239+0000 7fa8c0a38700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8bc09c9d0 con 0x7fa8bc09c600 2023-09-29T23:24:35.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.240+0000 7fa8bb7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa8bc09c600 0x7fa8bc0a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:35.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.240+0000 7fa8baffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fa8bc12bc80 0x7fa8bc12f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:52730/0 (socket says 172.21.15.92:52730) 2023-09-29T23:24:35.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.240+0000 7fa8baffd700 1 -- 172.21.15.92:0/2680747956 learned_addr learned my addr 172.21.15.92:0/2680747956 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:24:35.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.240+0000 7fa8bb7fe700 1 -- 172.21.15.92:0/2680747956 >> v1:172.21.15.92:6789/0 conn(0x7fa8bc12bc80 legacy=0x7fa8bc12f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:35.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.240+0000 7fa8ba7fc700 1 -- 172.21.15.92:0/2680747956 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963771813 0 0) 0x7fa8bc098320 con 0x7fa8bc12bc80 2023-09-29T23:24:35.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.240+0000 7fa8bb7fe700 1 -- 172.21.15.92:0/2680747956 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc12c620 con 0x7fa8bc09c600 2023-09-29T23:24:35.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.240+0000 7fa8bb7fe700 1 --2- 172.21.15.92:0/2680747956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8bc09c600 0x7fa8bc0a3030 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009de0 tx=0x7fa8ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6800354fab58ca67 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:35.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.240+0000 7fa8ba7fc700 1 -- 172.21.15.92:0/2680747956 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac00e070 con 0x7fa8bc09c600 2023-09-29T23:24:35.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.240+0000 7fa8ba7fc700 1 -- 172.21.15.92:0/2680747956 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac00bdc0 con 0x7fa8bc09c600 2023-09-29T23:24:35.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.240+0000 7fa8ba7fc700 1 -- 172.21.15.92:0/2680747956 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac0125b0 con 0x7fa8bc09c600 2023-09-29T23:24:35.244 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.241+0000 7fa8c0a38700 1 -- 172.21.15.92:0/2680747956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8bc09c600 msgr2=0x7fa8bc0a3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:35.244 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.241+0000 7fa8c0a38700 1 --2- 172.21.15.92:0/2680747956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8bc09c600 0x7fa8bc0a3030 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009de0 tx=0x7fa8ac009780 comp rx=0 tx=0).stop 2023-09-29T23:24:35.244 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.241+0000 7fa8c0a38700 1 -- 172.21.15.92:0/2680747956 shutdown_connections 2023-09-29T23:24:35.244 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.241+0000 7fa8c0a38700 1 --2- 172.21.15.92:0/2680747956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8bc09c600 0x7fa8bc0a3030 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:35.244 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.241+0000 7fa8c0a38700 1 -- 172.21.15.92:0/2680747956 >> 172.21.15.92:0/2680747956 conn(0x7fa8bc068080 msgr2=0x7fa8bc096a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:35.244 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.241+0000 7fa8c0a38700 1 -- 172.21.15.92:0/2680747956 shutdown_connections 2023-09-29T23:24:35.244 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.241+0000 7fa8c0a38700 1 -- 172.21.15.92:0/2680747956 wait complete. 2023-09-29T23:24:35.244 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.242+0000 7fa8c0a38700 1 Processor -- start 2023-09-29T23:24:35.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.242+0000 7fa8c0a38700 1 -- start start 2023-09-29T23:24:35.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.242+0000 7fa8c0a38700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8bc09c600 0x7fa8bc11ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:35.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.242+0000 7fa8c0a38700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc11b680 con 0x7fa8bc09c600 2023-09-29T23:24:35.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.242+0000 7fa8bb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8bc09c600 0x7fa8bc11ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:35.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.242+0000 7fa8bb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8bc09c600 0x7fa8bc11ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42156/0 (socket says 172.21.15.92:42156) 2023-09-29T23:24:35.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.242+0000 7fa8bb7fe700 1 -- 172.21.15.92:0/3758613479 learned_addr learned my addr 172.21.15.92:0/3758613479 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:24:35.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.242+0000 7fa8bb7fe700 1 -- 172.21.15.92:0/3758613479 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac009a20 con 0x7fa8bc09c600 2023-09-29T23:24:35.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.243+0000 7fa8bb7fe700 1 --2- 172.21.15.92:0/3758613479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8bc09c600 0x7fa8bc11ccb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0097c0 tx=0x7fa8ac018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:35.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.243+0000 7fa8a37fe700 1 -- 172.21.15.92:0/3758613479 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac0275b0 con 0x7fa8bc09c600 2023-09-29T23:24:35.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.243+0000 7fa8a37fe700 1 -- 172.21.15.92:0/3758613479 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac027710 con 0x7fa8bc09c600 2023-09-29T23:24:35.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.243+0000 7fa8c0a38700 1 -- 172.21.15.92:0/3758613479 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8bc1195c0 con 0x7fa8bc09c600 2023-09-29T23:24:35.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.243+0000 7fa8a37fe700 1 -- 172.21.15.92:0/3758613479 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac027a00 con 0x7fa8bc09c600 2023-09-29T23:24:35.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.243+0000 7fa8c0a38700 1 -- 172.21.15.92:0/3758613479 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8bc11c560 con 0x7fa8bc09c600 2023-09-29T23:24:35.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.243+0000 7fa8a37fe700 1 -- 172.21.15.92:0/3758613479 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fa8ac024070 con 0x7fa8bc09c600 2023-09-29T23:24:35.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.244+0000 7fa8a37fe700 1 --2- 172.21.15.92:0/3758613479 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa8a8035640 0x7fa8a8037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:35.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.244+0000 7fa8a37fe700 1 -- 172.21.15.92:0/3758613479 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3402+0+0 (secure 0 0 0) 0x7fa8ac049d70 con 0x7fa8bc09c600 2023-09-29T23:24:35.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.244+0000 7fa8c0a38700 1 -- 172.21.15.92:0/3758613479 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8bc068b80 con 0x7fa8bc09c600 2023-09-29T23:24:35.246 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.244+0000 7fa8baffd700 1 --2- 172.21.15.92:0/3758613479 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa8a8035640 0x7fa8a8037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:35.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.244+0000 7fa8baffd700 1 --2- 172.21.15.92:0/3758613479 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa8a8035640 0x7fa8a8037af0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0007fd0 tx=0x7fa8b0007bb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:35.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.248+0000 7fa8a37fe700 1 -- 172.21.15.92:0/3758613479 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8ac027b60 con 0x7fa8bc09c600 2023-09-29T23:24:35.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.470+0000 7fa8c0a38700 1 -- 172.21.15.92:0/3758613479 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa8bc05f230 con 0x7fa8bc09c600 2023-09-29T23:24:35.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.471+0000 7fa8a37fe700 1 -- 172.21.15.92:0/3758613479 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fa8ac01cba0 con 0x7fa8bc09c600 2023-09-29T23:24:35.471 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:24:35.471 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:24:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.473+0000 7fa8c0a38700 1 -- 172.21.15.92:0/3758613479 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa8a8035640 msgr2=0x7fa8a8037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.473+0000 7fa8c0a38700 1 --2- 172.21.15.92:0/3758613479 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa8a8035640 0x7fa8a8037af0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0007fd0 tx=0x7fa8b0007bb0 comp rx=0 tx=0).stop 2023-09-29T23:24:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.473+0000 7fa8c0a38700 1 -- 172.21.15.92:0/3758613479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8bc09c600 msgr2=0x7fa8bc11ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.473+0000 7fa8c0a38700 1 --2- 172.21.15.92:0/3758613479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8bc09c600 0x7fa8bc11ccb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0097c0 tx=0x7fa8ac018000 comp rx=0 tx=0).stop 2023-09-29T23:24:35.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.473+0000 7fa8c0a38700 1 -- 172.21.15.92:0/3758613479 shutdown_connections 2023-09-29T23:24:35.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.473+0000 7fa8c0a38700 1 --2- 172.21.15.92:0/3758613479 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa8a8035640 0x7fa8a8037af0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:35.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.473+0000 7fa8c0a38700 1 --2- 172.21.15.92:0/3758613479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8bc09c600 0x7fa8bc11ccb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:35.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.473+0000 7fa8c0a38700 1 -- 172.21.15.92:0/3758613479 >> 172.21.15.92:0/3758613479 conn(0x7fa8bc068080 msgr2=0x7fa8bc12db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:35.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.473+0000 7fa8c0a38700 1 -- 172.21.15.92:0/3758613479 shutdown_connections 2023-09-29T23:24:35.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:35.473+0000 7fa8c0a38700 1 -- 172.21.15.92:0/3758613479 wait complete. 2023-09-29T23:24:38.486 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:24:38.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.608+0000 7fbcb5be4700 1 Processor -- start 2023-09-29T23:24:38.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.608+0000 7fbcb5be4700 1 -- start start 2023-09-29T23:24:38.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.608+0000 7fbcb5be4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbcb00a3030 0x7fbcb012f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:38.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.608+0000 7fbcb5be4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb00997f0 con 0x7fbcb012fae0 2023-09-29T23:24:38.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.608+0000 7fbcb5be4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb00a3400 con 0x7fbcb00a3030 2023-09-29T23:24:38.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.608+0000 7fbcaf7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbcb00a3030 0x7fbcb012f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:38.609 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.608+0000 7fbcaeffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fbcb012fae0 0x7fbcb0095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:52736/0 (socket says 172.21.15.92:52736) 2023-09-29T23:24:38.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.608+0000 7fbcaeffd700 1 -- 172.21.15.92:0/1833208020 learned_addr learned my addr 172.21.15.92:0/1833208020 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:24:38.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.608+0000 7fbcaf7fe700 1 -- 172.21.15.92:0/1833208020 >> v1:172.21.15.92:6789/0 conn(0x7fbcb012fae0 legacy=0x7fbcb0095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:38.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.608+0000 7fbcaf7fe700 1 -- 172.21.15.92:0/1833208020 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb00977a0 con 0x7fbcb00a3030 2023-09-29T23:24:38.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.609+0000 7fbcaf7fe700 1 --2- 172.21.15.92:0/1833208020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbcb00a3030 0x7fbcb012f5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009de0 tx=0x7fbca0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749ef6ff0e5cf81 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:38.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.609+0000 7fbcae7fc700 1 -- 172.21.15.92:0/1833208020 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbca000e070 con 0x7fbcb00a3030 2023-09-29T23:24:38.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.609+0000 7fbcae7fc700 1 -- 172.21.15.92:0/1833208020 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca000bd10 con 0x7fbcb00a3030 2023-09-29T23:24:38.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.609+0000 7fbcae7fc700 1 -- 172.21.15.92:0/1833208020 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbca0012430 con 0x7fbcb00a3030 2023-09-29T23:24:38.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.609+0000 7fbcb5be4700 1 -- 172.21.15.92:0/1833208020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbcb00a3030 msgr2=0x7fbcb012f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:38.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.609+0000 7fbcb5be4700 1 --2- 172.21.15.92:0/1833208020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbcb00a3030 0x7fbcb012f5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009de0 tx=0x7fbca0009780 comp rx=0 tx=0).stop 2023-09-29T23:24:38.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.609+0000 7fbcb5be4700 1 -- 172.21.15.92:0/1833208020 shutdown_connections 2023-09-29T23:24:38.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.609+0000 7fbcb5be4700 1 --2- 172.21.15.92:0/1833208020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbcb00a3030 0x7fbcb012f5a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:38.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.609+0000 7fbcb5be4700 1 -- 172.21.15.92:0/1833208020 >> 172.21.15.92:0/1833208020 conn(0x7fbcb0067fc0 msgr2=0x7fbcb00a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:38.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.609+0000 7fbcb5be4700 1 -- 172.21.15.92:0/1833208020 shutdown_connections 2023-09-29T23:24:38.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.609+0000 7fbcb5be4700 1 -- 172.21.15.92:0/1833208020 wait complete. 2023-09-29T23:24:38.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.610+0000 7fbcb5be4700 1 Processor -- start 2023-09-29T23:24:38.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.610+0000 7fbcb5be4700 1 -- start start 2023-09-29T23:24:38.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.611+0000 7fbcb5be4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbcb00a3030 0x7fbcb013e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:38.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.611+0000 7fbcb5be4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb011c4d0 con 0x7fbcb00a3030 2023-09-29T23:24:38.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.611+0000 7fbcaf7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbcb00a3030 0x7fbcb013e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:38.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.611+0000 7fbcaf7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbcb00a3030 0x7fbcb013e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42174/0 (socket says 172.21.15.92:42174) 2023-09-29T23:24:38.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.611+0000 7fbcaf7fe700 1 -- 172.21.15.92:0/2343781431 learned_addr learned my addr 172.21.15.92:0/2343781431 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:24:38.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.611+0000 7fbcaf7fe700 1 -- 172.21.15.92:0/2343781431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca0009a20 con 0x7fbcb00a3030 2023-09-29T23:24:38.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.611+0000 7fbcaf7fe700 1 --2- 172.21.15.92:0/2343781431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbcb00a3030 0x7fbcb013e4d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbca00097c0 tx=0x7fbca0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:38.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.611+0000 7fbc977fe700 1 -- 172.21.15.92:0/2343781431 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbca0012e40 con 0x7fbcb00a3030 2023-09-29T23:24:38.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.611+0000 7fbc977fe700 1 -- 172.21.15.92:0/2343781431 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca001d640 con 0x7fbcb00a3030 2023-09-29T23:24:38.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.611+0000 7fbc977fe700 1 -- 172.21.15.92:0/2343781431 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbca001d930 con 0x7fbcb00a3030 2023-09-29T23:24:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.611+0000 7fbcb5be4700 1 -- 172.21.15.92:0/2343781431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb011d100 con 0x7fbcb00a3030 2023-09-29T23:24:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.611+0000 7fbcb5be4700 1 -- 172.21.15.92:0/2343781431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb011b2b0 con 0x7fbcb00a3030 2023-09-29T23:24:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.612+0000 7fbc977fe700 1 -- 172.21.15.92:0/2343781431 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fbca0024070 con 0x7fbcb00a3030 2023-09-29T23:24:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.612+0000 7fbc977fe700 1 --2- 172.21.15.92:0/2343781431 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fbc9c035640 0x7fbc9c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.612+0000 7fbc977fe700 1 -- 172.21.15.92:0/2343781431 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fbca004a090 con 0x7fbcb00a3030 2023-09-29T23:24:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.612+0000 7fbcb5be4700 1 -- 172.21.15.92:0/2343781431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb011b2b0 con 0x7fbcb00a3030 2023-09-29T23:24:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.612+0000 7fbcaeffd700 1 --2- 172.21.15.92:0/2343781431 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fbc9c035640 0x7fbc9c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.613+0000 7fbcaeffd700 1 --2- 172.21.15.92:0/2343781431 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fbc9c035640 0x7fbc9c037af0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbca40016a0 tx=0x7fbca4007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:38.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.617+0000 7fbc977fe700 1 -- 172.21.15.92:0/2343781431 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbca0027470 con 0x7fbcb00a3030 2023-09-29T23:24:38.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.838+0000 7fbcb5be4700 1 -- 172.21.15.92:0/2343781431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbcb011e310 con 0x7fbcb00a3030 2023-09-29T23:24:38.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.839+0000 7fbc977fe700 1 -- 172.21.15.92:0/2343781431 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fbca001cba0 con 0x7fbcb00a3030 2023-09-29T23:24:38.839 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:24:38.839 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:24:38.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.840+0000 7fbcb5be4700 1 -- 172.21.15.92:0/2343781431 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fbc9c035640 msgr2=0x7fbc9c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:38.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.840+0000 7fbcb5be4700 1 --2- 172.21.15.92:0/2343781431 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fbc9c035640 0x7fbc9c037af0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbca40016a0 tx=0x7fbca4007b30 comp rx=0 tx=0).stop 2023-09-29T23:24:38.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.840+0000 7fbcb5be4700 1 -- 172.21.15.92:0/2343781431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbcb00a3030 msgr2=0x7fbcb013e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:38.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.840+0000 7fbcb5be4700 1 --2- 172.21.15.92:0/2343781431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbcb00a3030 0x7fbcb013e4d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbca00097c0 tx=0x7fbca0018000 comp rx=0 tx=0).stop 2023-09-29T23:24:38.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.841+0000 7fbcb5be4700 1 -- 172.21.15.92:0/2343781431 shutdown_connections 2023-09-29T23:24:38.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.841+0000 7fbcb5be4700 1 --2- 172.21.15.92:0/2343781431 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fbc9c035640 0x7fbc9c037af0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:38.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.841+0000 7fbcb5be4700 1 --2- 172.21.15.92:0/2343781431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbcb00a3030 0x7fbcb013e4d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:38.842 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.841+0000 7fbcb5be4700 1 -- 172.21.15.92:0/2343781431 >> 172.21.15.92:0/2343781431 conn(0x7fbcb0067fc0 msgr2=0x7fbcb012d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:38.842 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.841+0000 7fbcb5be4700 1 -- 172.21.15.92:0/2343781431 shutdown_connections 2023-09-29T23:24:38.842 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:38.841+0000 7fbcb5be4700 1 -- 172.21.15.92:0/2343781431 wait complete. 2023-09-29T23:24:41.853 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:24:41.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.982+0000 7f0389605700 1 Processor -- start 2023-09-29T23:24:41.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.982+0000 7f0389605700 1 -- start start 2023-09-29T23:24:41.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.982+0000 7f0389605700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f038409fd80 0x7f03840a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:41.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.982+0000 7f0389605700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0384098710 con 0x7f038412f8b0 2023-09-29T23:24:41.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.982+0000 7f0389605700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038412f340 con 0x7f038409fd80 2023-09-29T23:24:41.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.982+0000 7f0382ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f038409fd80 0x7f03840a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:41.989 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.982+0000 7f03827fc700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f038412f8b0 0x7f0384095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:33046/0 (socket says 172.21.15.92:33046) 2023-09-29T23:24:41.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.982+0000 7f03827fc700 1 -- 172.21.15.92:0/880869954 learned_addr learned my addr 172.21.15.92:0/880869954 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:24:41.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.983+0000 7f0382ffd700 1 -- 172.21.15.92:0/880869954 >> v1:172.21.15.92:6789/0 conn(0x7f038412f8b0 legacy=0x7f0384095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:41.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.983+0000 7f0382ffd700 1 -- 172.21.15.92:0/880869954 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03840997e0 con 0x7f038409fd80 2023-09-29T23:24:41.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.983+0000 7f0382ffd700 1 --2- 172.21.15.92:0/880869954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f038409fd80 0x7f03840a3090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f037c009de0 tx=0x7f037c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343bfd804c10c186 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:41.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.983+0000 7f0381ffb700 1 -- 172.21.15.92:0/880869954 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f037c00e070 con 0x7f038409fd80 2023-09-29T23:24:41.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.983+0000 7f0381ffb700 1 -- 172.21.15.92:0/880869954 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c00bc80 con 0x7f038409fd80 2023-09-29T23:24:41.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.983+0000 7f0381ffb700 1 -- 172.21.15.92:0/880869954 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f037c012430 con 0x7f038409fd80 2023-09-29T23:24:41.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.983+0000 7f0389605700 1 -- 172.21.15.92:0/880869954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f038409fd80 msgr2=0x7f03840a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:41.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.983+0000 7f0389605700 1 --2- 172.21.15.92:0/880869954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f038409fd80 0x7f03840a3090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f037c009de0 tx=0x7f037c009780 comp rx=0 tx=0).stop 2023-09-29T23:24:41.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.983+0000 7f0389605700 1 -- 172.21.15.92:0/880869954 shutdown_connections 2023-09-29T23:24:41.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.983+0000 7f0389605700 1 --2- 172.21.15.92:0/880869954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f038409fd80 0x7f03840a3090 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:41.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.983+0000 7f0389605700 1 -- 172.21.15.92:0/880869954 >> 172.21.15.92:0/880869954 conn(0x7f0384068000 msgr2=0x7f03840a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:41.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.983+0000 7f0389605700 1 -- 172.21.15.92:0/880869954 shutdown_connections 2023-09-29T23:24:41.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.983+0000 7f0389605700 1 -- 172.21.15.92:0/880869954 wait complete. 2023-09-29T23:24:41.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.984+0000 7f0389605700 1 Processor -- start 2023-09-29T23:24:41.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.984+0000 7f0389605700 1 -- start start 2023-09-29T23:24:41.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.985+0000 7f0389605700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f038409fd80 0x7f0384119fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:41.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.985+0000 7f0389605700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038411e610 con 0x7f038409fd80 2023-09-29T23:24:41.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.985+0000 7f0382ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f038409fd80 0x7f0384119fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:41.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.985+0000 7f0382ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f038409fd80 0x7f0384119fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49886/0 (socket says 172.21.15.92:49886) 2023-09-29T23:24:41.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.985+0000 7f0382ffd700 1 -- 172.21.15.92:0/532851682 learned_addr learned my addr 172.21.15.92:0/532851682 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:24:41.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.985+0000 7f0382ffd700 1 -- 172.21.15.92:0/532851682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c009a20 con 0x7f038409fd80 2023-09-29T23:24:41.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.985+0000 7f0382ffd700 1 --2- 172.21.15.92:0/532851682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f038409fd80 0x7f0384119fa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f037c0099f0 tx=0x7f037c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:41.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.985+0000 7f037affd700 1 -- 172.21.15.92:0/532851682 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f037c027470 con 0x7f038409fd80 2023-09-29T23:24:41.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.986+0000 7f037affd700 1 -- 172.21.15.92:0/532851682 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c0275d0 con 0x7f038409fd80 2023-09-29T23:24:41.993 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.986+0000 7f0389605700 1 -- 172.21.15.92:0/532851682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038411ba50 con 0x7f038409fd80 2023-09-29T23:24:41.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.986+0000 7f037affd700 1 -- 172.21.15.92:0/532851682 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f037c0278c0 con 0x7f038409fd80 2023-09-29T23:24:41.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.986+0000 7f0389605700 1 -- 172.21.15.92:0/532851682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038411d460 con 0x7f038409fd80 2023-09-29T23:24:41.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.986+0000 7f037affd700 1 -- 172.21.15.92:0/532851682 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f037c024070 con 0x7f038409fd80 2023-09-29T23:24:41.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.986+0000 7f0389605700 1 -- 172.21.15.92:0/532851682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038405f230 con 0x7f038409fd80 2023-09-29T23:24:41.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.987+0000 7f037affd700 1 --2- 172.21.15.92:0/532851682 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0364035640 0x7f0364037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:41.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.987+0000 7f037affd700 1 -- 172.21.15.92:0/532851682 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f037c049cc0 con 0x7f038409fd80 2023-09-29T23:24:41.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.987+0000 7f03827fc700 1 --2- 172.21.15.92:0/532851682 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0364035640 0x7f0364037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:41.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.987+0000 7f03827fc700 1 --2- 172.21.15.92:0/532851682 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0364035640 0x7f0364037af0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f036c0016a0 tx=0x7f036c007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:41.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:41.991+0000 7f037affd700 1 -- 172.21.15.92:0/532851682 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f037c027a20 con 0x7f038409fd80 2023-09-29T23:24:42.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:42.213+0000 7f0389605700 1 -- 172.21.15.92:0/532851682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f038404bb40 con 0x7f038409fd80 2023-09-29T23:24:42.214 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:42.214+0000 7f037affd700 1 -- 172.21.15.92:0/532851682 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f037c01cba0 con 0x7f038409fd80 2023-09-29T23:24:42.214 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:24:42.214 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:24:42.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:42.215+0000 7f0389605700 1 -- 172.21.15.92:0/532851682 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0364035640 msgr2=0x7f0364037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:42.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:42.216+0000 7f0389605700 1 --2- 172.21.15.92:0/532851682 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0364035640 0x7f0364037af0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f036c0016a0 tx=0x7f036c007b30 comp rx=0 tx=0).stop 2023-09-29T23:24:42.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:42.216+0000 7f0389605700 1 -- 172.21.15.92:0/532851682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f038409fd80 msgr2=0x7f0384119fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:42.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:42.216+0000 7f0389605700 1 --2- 172.21.15.92:0/532851682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f038409fd80 0x7f0384119fa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f037c0099f0 tx=0x7f037c018000 comp rx=0 tx=0).stop 2023-09-29T23:24:42.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:42.216+0000 7f0389605700 1 -- 172.21.15.92:0/532851682 shutdown_connections 2023-09-29T23:24:42.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:42.216+0000 7f0389605700 1 --2- 172.21.15.92:0/532851682 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0364035640 0x7f0364037af0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:42.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:42.216+0000 7f0389605700 1 --2- 172.21.15.92:0/532851682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f038409fd80 0x7f0384119fa0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:42.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:42.216+0000 7f0389605700 1 -- 172.21.15.92:0/532851682 >> 172.21.15.92:0/532851682 conn(0x7f0384068000 msgr2=0x7f0384094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:42.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:42.216+0000 7f0389605700 1 -- 172.21.15.92:0/532851682 shutdown_connections 2023-09-29T23:24:42.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:42.216+0000 7f0389605700 1 -- 172.21.15.92:0/532851682 wait complete. 2023-09-29T23:24:45.228 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:24:45.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.347+0000 7f7000ba2700 1 Processor -- start 2023-09-29T23:24:45.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.347+0000 7f7000ba2700 1 -- start start 2023-09-29T23:24:45.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.347+0000 7f7000ba2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6ffc06b0c0 0x7f6ffc12f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:45.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.347+0000 7f7000ba2700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ffc09ca80 con 0x7f6ffc12fb70 2023-09-29T23:24:45.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.347+0000 7f7000ba2700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ffc06b490 con 0x7f6ffc06b0c0 2023-09-29T23:24:45.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.347+0000 7f6ffb7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6ffc06b0c0 0x7f6ffc12f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:45.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.347+0000 7f6ffaffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f6ffc12fb70 0x7f6ffc099530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:33062/0 (socket says 172.21.15.92:33062) 2023-09-29T23:24:45.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.347+0000 7f6ffaffd700 1 -- 172.21.15.92:0/146067738 learned_addr learned my addr 172.21.15.92:0/146067738 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:24:45.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.348+0000 7f6ffb7fe700 1 -- 172.21.15.92:0/146067738 >> v1:172.21.15.92:6789/0 conn(0x7f6ffc12fb70 legacy=0x7f6ffc099530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:45.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.348+0000 7f6ffb7fe700 1 -- 172.21.15.92:0/146067738 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ffc09be20 con 0x7f6ffc06b0c0 2023-09-29T23:24:45.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.348+0000 7f6ffb7fe700 1 --2- 172.21.15.92:0/146067738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ffc06b0c0 0x7f6ffc12f630 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009860 tx=0x7f6fec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472021a3008171ac server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:45.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.348+0000 7f6ffa7fc700 1 -- 172.21.15.92:0/146067738 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fec00b680 con 0x7f6ffc06b0c0 2023-09-29T23:24:45.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.348+0000 7f6ffa7fc700 1 -- 172.21.15.92:0/146067738 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec00b7e0 con 0x7f6ffc06b0c0 2023-09-29T23:24:45.349 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.348+0000 7f6ffa7fc700 1 -- 172.21.15.92:0/146067738 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fec00bad0 con 0x7f6ffc06b0c0 2023-09-29T23:24:45.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.348+0000 7f7000ba2700 1 -- 172.21.15.92:0/146067738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ffc06b0c0 msgr2=0x7f6ffc12f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:45.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.348+0000 7f7000ba2700 1 --2- 172.21.15.92:0/146067738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ffc06b0c0 0x7f6ffc12f630 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009860 tx=0x7f6fec0091a0 comp rx=0 tx=0).stop 2023-09-29T23:24:45.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.348+0000 7f7000ba2700 1 -- 172.21.15.92:0/146067738 shutdown_connections 2023-09-29T23:24:45.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.348+0000 7f7000ba2700 1 --2- 172.21.15.92:0/146067738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ffc06b0c0 0x7f6ffc12f630 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:45.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.348+0000 7f7000ba2700 1 -- 172.21.15.92:0/146067738 >> 172.21.15.92:0/146067738 conn(0x7f6ffc06a5b0 msgr2=0x7f6ffc06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:45.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.348+0000 7f7000ba2700 1 -- 172.21.15.92:0/146067738 shutdown_connections 2023-09-29T23:24:45.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.348+0000 7f7000ba2700 1 -- 172.21.15.92:0/146067738 wait complete. 2023-09-29T23:24:45.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.349+0000 7f7000ba2700 1 Processor -- start 2023-09-29T23:24:45.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.349+0000 7f7000ba2700 1 -- start start 2023-09-29T23:24:45.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.350+0000 7f7000ba2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ffc06b0c0 0x7f6ffc11a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:45.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.350+0000 7f7000ba2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ffc11c060 con 0x7f6ffc06b0c0 2023-09-29T23:24:45.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.350+0000 7f6ffb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ffc06b0c0 0x7f6ffc11a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:45.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.350+0000 7f6ffb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ffc06b0c0 0x7f6ffc11a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49900/0 (socket says 172.21.15.92:49900) 2023-09-29T23:24:45.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.350+0000 7f6ffb7fe700 1 -- 172.21.15.92:0/3029928736 learned_addr learned my addr 172.21.15.92:0/3029928736 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:24:45.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.350+0000 7f6ffb7fe700 1 -- 172.21.15.92:0/3029928736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec009420 con 0x7f6ffc06b0c0 2023-09-29T23:24:45.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.350+0000 7f6ffb7fe700 1 --2- 172.21.15.92:0/3029928736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ffc06b0c0 0x7f6ffc11a9b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6fec000c00 tx=0x7f6fec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:45.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.350+0000 7f6fe37fe700 1 -- 172.21.15.92:0/3029928736 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fec011dd0 con 0x7f6ffc06b0c0 2023-09-29T23:24:45.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.350+0000 7f6fe37fe700 1 -- 172.21.15.92:0/3029928736 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec020070 con 0x7f6ffc06b0c0 2023-09-29T23:24:45.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.350+0000 7f6fe37fe700 1 -- 172.21.15.92:0/3029928736 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6fec01c5d0 con 0x7f6ffc06b0c0 2023-09-29T23:24:45.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.350+0000 7f7000ba2700 1 -- 172.21.15.92:0/3029928736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ffc11e720 con 0x7f6ffc06b0c0 2023-09-29T23:24:45.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.350+0000 7f7000ba2700 1 -- 172.21.15.92:0/3029928736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ffc11e2b0 con 0x7f6ffc06b0c0 2023-09-29T23:24:45.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.351+0000 7f6fe37fe700 1 -- 172.21.15.92:0/3029928736 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f6fec022030 con 0x7f6ffc06b0c0 2023-09-29T23:24:45.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.351+0000 7f7000ba2700 1 -- 172.21.15.92:0/3029928736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ffc05f230 con 0x7f6ffc06b0c0 2023-09-29T23:24:45.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.351+0000 7f6fe37fe700 1 --2- 172.21.15.92:0/3029928736 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6fe8035640 0x7f6fe8037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:45.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.351+0000 7f6fe37fe700 1 -- 172.21.15.92:0/3029928736 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f6fec049340 con 0x7f6ffc06b0c0 2023-09-29T23:24:45.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.351+0000 7f6ffaffd700 1 --2- 172.21.15.92:0/3029928736 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6fe8035640 0x7f6fe8037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:45.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.352+0000 7f6ffaffd700 1 --2- 172.21.15.92:0/3029928736 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6fe8035640 0x7f6fe8037af0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0a3600 tx=0x7f6ff0007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:45.356 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.356+0000 7f6fe37fe700 1 -- 172.21.15.92:0/3029928736 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fec01c730 con 0x7f6ffc06b0c0 2023-09-29T23:24:45.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.576+0000 7f7000ba2700 1 -- 172.21.15.92:0/3029928736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6ffc12f320 con 0x7f6ffc06b0c0 2023-09-29T23:24:45.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.577+0000 7f6fe37fe700 1 -- 172.21.15.92:0/3029928736 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f6fec0243d0 con 0x7f6ffc06b0c0 2023-09-29T23:24:45.577 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:24:45.577 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:24:45.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.579+0000 7f7000ba2700 1 -- 172.21.15.92:0/3029928736 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6fe8035640 msgr2=0x7f6fe8037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:45.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.579+0000 7f7000ba2700 1 --2- 172.21.15.92:0/3029928736 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6fe8035640 0x7f6fe8037af0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0a3600 tx=0x7f6ff0007b30 comp rx=0 tx=0).stop 2023-09-29T23:24:45.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.579+0000 7f7000ba2700 1 -- 172.21.15.92:0/3029928736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ffc06b0c0 msgr2=0x7f6ffc11a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:45.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.579+0000 7f7000ba2700 1 --2- 172.21.15.92:0/3029928736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ffc06b0c0 0x7f6ffc11a9b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6fec000c00 tx=0x7f6fec016000 comp rx=0 tx=0).stop 2023-09-29T23:24:45.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.579+0000 7f7000ba2700 1 -- 172.21.15.92:0/3029928736 shutdown_connections 2023-09-29T23:24:45.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.579+0000 7f7000ba2700 1 --2- 172.21.15.92:0/3029928736 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6fe8035640 0x7f6fe8037af0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:45.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.579+0000 7f7000ba2700 1 --2- 172.21.15.92:0/3029928736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ffc06b0c0 0x7f6ffc11a9b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:45.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.579+0000 7f7000ba2700 1 -- 172.21.15.92:0/3029928736 >> 172.21.15.92:0/3029928736 conn(0x7f6ffc06a5b0 msgr2=0x7f6ffc12dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:45.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.579+0000 7f7000ba2700 1 -- 172.21.15.92:0/3029928736 shutdown_connections 2023-09-29T23:24:45.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:45.579+0000 7f7000ba2700 1 -- 172.21.15.92:0/3029928736 wait complete. 2023-09-29T23:24:48.591 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:24:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.717+0000 7f2b5e958700 1 Processor -- start 2023-09-29T23:24:48.717 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.717+0000 7f2b5e958700 1 -- start start 2023-09-29T23:24:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.717+0000 7f2b5e958700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2b5809ec90 0x7f2b58096010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:48.718 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.717+0000 7f2b5e958700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b58096b40 con 0x7f2b58097fb0 2023-09-29T23:24:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.717+0000 7f2b5e958700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b58098380 con 0x7f2b5809ec90 2023-09-29T23:24:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.718+0000 7f2b5d155700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2b5809ec90 0x7f2b58096010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.718+0000 7f2b5d956700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f2b58097fb0 0x7f2b58095900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:33072/0 (socket says 172.21.15.92:33072) 2023-09-29T23:24:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.718+0000 7f2b5d956700 1 -- 172.21.15.92:0/3156099063 learned_addr learned my addr 172.21.15.92:0/3156099063 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:24:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.718+0000 7f2b5d155700 1 -- 172.21.15.92:0/3156099063 >> v1:172.21.15.92:6789/0 conn(0x7f2b58097fb0 legacy=0x7f2b58095900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.718+0000 7f2b5d155700 1 -- 172.21.15.92:0/3156099063 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b580977d0 con 0x7f2b5809ec90 2023-09-29T23:24:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.718+0000 7f2b5d155700 1 --2- 172.21.15.92:0/3156099063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b5809ec90 0x7f2b58096010 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c009860 tx=0x7f2b4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c117a4a2eabe83 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.718+0000 7f2b5c954700 1 -- 172.21.15.92:0/3156099063 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b4c00b710 con 0x7f2b5809ec90 2023-09-29T23:24:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.718+0000 7f2b5c954700 1 -- 172.21.15.92:0/3156099063 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4c00b870 con 0x7f2b5809ec90 2023-09-29T23:24:48.719 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.718+0000 7f2b5c954700 1 -- 172.21.15.92:0/3156099063 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b4c00bb60 con 0x7f2b5809ec90 2023-09-29T23:24:48.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.719+0000 7f2b5e958700 1 -- 172.21.15.92:0/3156099063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b5809ec90 msgr2=0x7f2b58096010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:48.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.719+0000 7f2b5e958700 1 --2- 172.21.15.92:0/3156099063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b5809ec90 0x7f2b58096010 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c009860 tx=0x7f2b4c0091a0 comp rx=0 tx=0).stop 2023-09-29T23:24:48.721 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.719+0000 7f2b5e958700 1 -- 172.21.15.92:0/3156099063 shutdown_connections 2023-09-29T23:24:48.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.719+0000 7f2b5e958700 1 --2- 172.21.15.92:0/3156099063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b5809ec90 0x7f2b58096010 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:48.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.719+0000 7f2b5e958700 1 -- 172.21.15.92:0/3156099063 >> 172.21.15.92:0/3156099063 conn(0x7f2b5806b270 msgr2=0x7f2b5806d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:48.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.719+0000 7f2b5e958700 1 -- 172.21.15.92:0/3156099063 shutdown_connections 2023-09-29T23:24:48.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.719+0000 7f2b5e958700 1 -- 172.21.15.92:0/3156099063 wait complete. 2023-09-29T23:24:48.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.720+0000 7f2b5e958700 1 Processor -- start 2023-09-29T23:24:48.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.720+0000 7f2b5e958700 1 -- start start 2023-09-29T23:24:48.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.720+0000 7f2b5e958700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b58097fb0 0x7f2b58086000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:48.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.720+0000 7f2b5e958700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b580870f0 con 0x7f2b58097fb0 2023-09-29T23:24:48.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.720+0000 7f2b5d956700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b58097fb0 0x7f2b58086000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:48.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.720+0000 7f2b5d956700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b58097fb0 0x7f2b58086000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49916/0 (socket says 172.21.15.92:49916) 2023-09-29T23:24:48.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.720+0000 7f2b5d956700 1 -- 172.21.15.92:0/3570356657 learned_addr learned my addr 172.21.15.92:0/3570356657 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:24:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.721+0000 7f2b5d956700 1 -- 172.21.15.92:0/3570356657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c009420 con 0x7f2b58097fb0 2023-09-29T23:24:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.721+0000 7f2b5d956700 1 --2- 172.21.15.92:0/3570356657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b58097fb0 0x7f2b58086000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000ca40 tx=0x7f2b50001790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.721+0000 7f2b55ffb700 1 -- 172.21.15.92:0/3570356657 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b50005d80 con 0x7f2b58097fb0 2023-09-29T23:24:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.721+0000 7f2b55ffb700 1 -- 172.21.15.92:0/3570356657 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5000a5d0 con 0x7f2b58097fb0 2023-09-29T23:24:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.721+0000 7f2b5e958700 1 -- 172.21.15.92:0/3570356657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b58089470 con 0x7f2b58097fb0 2023-09-29T23:24:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.721+0000 7f2b55ffb700 1 -- 172.21.15.92:0/3570356657 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b5000a8c0 con 0x7f2b58097fb0 2023-09-29T23:24:48.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.721+0000 7f2b5e958700 1 -- 172.21.15.92:0/3570356657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b58087470 con 0x7f2b58097fb0 2023-09-29T23:24:48.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.722+0000 7f2b55ffb700 1 -- 172.21.15.92:0/3570356657 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f2b5000aa20 con 0x7f2b58097fb0 2023-09-29T23:24:48.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.722+0000 7f2b55ffb700 1 --2- 172.21.15.92:0/3570356657 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2b44035640 0x7f2b44037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:48.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.722+0000 7f2b55ffb700 1 -- 172.21.15.92:0/3570356657 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f2b50046dd0 con 0x7f2b58097fb0 2023-09-29T23:24:48.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.722+0000 7f2b5d155700 1 --2- 172.21.15.92:0/3570356657 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2b44035640 0x7f2b44037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:48.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.722+0000 7f2b5e958700 1 -- 172.21.15.92:0/3570356657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b58096d50 con 0x7f2b58097fb0 2023-09-29T23:24:48.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.722+0000 7f2b5d155700 1 --2- 172.21.15.92:0/3570356657 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2b44035640 0x7f2b44037af0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0091e0 tx=0x7f2b4c016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:48.726 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.727+0000 7f2b55ffb700 1 -- 172.21.15.92:0/3570356657 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b50018030 con 0x7f2b58097fb0 2023-09-29T23:24:48.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.949+0000 7f2b5e958700 1 -- 172.21.15.92:0/3570356657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2b5805f230 con 0x7f2b58097fb0 2023-09-29T23:24:48.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.950+0000 7f2b55ffb700 1 -- 172.21.15.92:0/3570356657 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f2b5000f260 con 0x7f2b58097fb0 2023-09-29T23:24:48.950 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:24:48.950 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:24:48.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.951+0000 7f2b5e958700 1 -- 172.21.15.92:0/3570356657 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2b44035640 msgr2=0x7f2b44037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:48.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.951+0000 7f2b5e958700 1 --2- 172.21.15.92:0/3570356657 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2b44035640 0x7f2b44037af0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0091e0 tx=0x7f2b4c016000 comp rx=0 tx=0).stop 2023-09-29T23:24:48.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.951+0000 7f2b5e958700 1 -- 172.21.15.92:0/3570356657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b58097fb0 msgr2=0x7f2b58086000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:48.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.951+0000 7f2b5e958700 1 --2- 172.21.15.92:0/3570356657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b58097fb0 0x7f2b58086000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000ca40 tx=0x7f2b50001790 comp rx=0 tx=0).stop 2023-09-29T23:24:48.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.952+0000 7f2b5e958700 1 -- 172.21.15.92:0/3570356657 shutdown_connections 2023-09-29T23:24:48.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.952+0000 7f2b5e958700 1 --2- 172.21.15.92:0/3570356657 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2b44035640 0x7f2b44037af0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:48.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.952+0000 7f2b5e958700 1 --2- 172.21.15.92:0/3570356657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b58097fb0 0x7f2b58086000 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:48.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.952+0000 7f2b5e958700 1 -- 172.21.15.92:0/3570356657 >> 172.21.15.92:0/3570356657 conn(0x7f2b5806b270 msgr2=0x7f2b5806b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:48.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.952+0000 7f2b5e958700 1 -- 172.21.15.92:0/3570356657 shutdown_connections 2023-09-29T23:24:48.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:48.952+0000 7f2b5e958700 1 -- 172.21.15.92:0/3570356657 wait complete. 2023-09-29T23:24:51.964 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:24:52.089 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.087+0000 7f6f212c9700 1 Processor -- start 2023-09-29T23:24:52.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.087+0000 7f6f212c9700 1 -- start start 2023-09-29T23:24:52.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.088+0000 7f6f212c9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6f1c096ca0 0x7f6f1c097070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:52.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.088+0000 7f6f212c9700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f1c098700 con 0x7f6f1c0975b0 2023-09-29T23:24:52.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.088+0000 7f6f212c9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f1c09f430 con 0x7f6f1c096ca0 2023-09-29T23:24:52.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.088+0000 7f6f1affd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6f1c096ca0 0x7f6f1c097070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:52.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.088+0000 7f6f1a7fc700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f6f1c0975b0 0x7f6f1c130630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:41490/0 (socket says 172.21.15.92:41490) 2023-09-29T23:24:52.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.088+0000 7f6f1a7fc700 1 -- 172.21.15.92:0/2770439905 learned_addr learned my addr 172.21.15.92:0/2770439905 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:24:52.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.088+0000 7f6f1affd700 1 -- 172.21.15.92:0/2770439905 >> v1:172.21.15.92:6789/0 conn(0x7f6f1c0975b0 legacy=0x7f6f1c130630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:52.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.088+0000 7f6f1affd700 1 -- 172.21.15.92:0/2770439905 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1c06fab0 con 0x7f6f1c096ca0 2023-09-29T23:24:52.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.088+0000 7f6f19ffb700 1 -- 172.21.15.92:0/2770439905 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691044212 0 0) 0x7f6f1c098700 con 0x7f6f1c0975b0 2023-09-29T23:24:52.090 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.088+0000 7f6f1affd700 1 --2- 172.21.15.92:0/2770439905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f1c096ca0 0x7f6f1c097070 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009e30 tx=0x7f6f0c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a07d2b9a7188488 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:52.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.088+0000 7f6f19ffb700 1 -- 172.21.15.92:0/2770439905 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f0c00e070 con 0x7f6f1c096ca0 2023-09-29T23:24:52.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.088+0000 7f6f19ffb700 1 -- 172.21.15.92:0/2770439905 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c00bd70 con 0x7f6f1c096ca0 2023-09-29T23:24:52.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.088+0000 7f6f19ffb700 1 -- 172.21.15.92:0/2770439905 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f0c0125b0 con 0x7f6f1c096ca0 2023-09-29T23:24:52.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.089+0000 7f6f212c9700 1 -- 172.21.15.92:0/2770439905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f1c096ca0 msgr2=0x7f6f1c097070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:52.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.089+0000 7f6f212c9700 1 --2- 172.21.15.92:0/2770439905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f1c096ca0 0x7f6f1c097070 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009e30 tx=0x7f6f0c009780 comp rx=0 tx=0).stop 2023-09-29T23:24:52.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.089+0000 7f6f212c9700 1 -- 172.21.15.92:0/2770439905 shutdown_connections 2023-09-29T23:24:52.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.089+0000 7f6f212c9700 1 --2- 172.21.15.92:0/2770439905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f1c096ca0 0x7f6f1c097070 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:52.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.089+0000 7f6f212c9700 1 -- 172.21.15.92:0/2770439905 >> 172.21.15.92:0/2770439905 conn(0x7f6f1c06bd70 msgr2=0x7f6f1c06e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:52.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.089+0000 7f6f212c9700 1 -- 172.21.15.92:0/2770439905 shutdown_connections 2023-09-29T23:24:52.091 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.089+0000 7f6f212c9700 1 -- 172.21.15.92:0/2770439905 wait complete. 2023-09-29T23:24:52.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.090+0000 7f6f212c9700 1 Processor -- start 2023-09-29T23:24:52.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.090+0000 7f6f212c9700 1 -- start start 2023-09-29T23:24:52.093 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.090+0000 7f6f212c9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f1c096ca0 0x7f6f1c08afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.090+0000 7f6f212c9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c08e250 con 0x7f6f1c096ca0 2023-09-29T23:24:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.090+0000 7f6f1affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f1c096ca0 0x7f6f1c08afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.090+0000 7f6f1affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f1c096ca0 0x7f6f1c08afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34824/0 (socket says 172.21.15.92:34824) 2023-09-29T23:24:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.090+0000 7f6f1affd700 1 -- 172.21.15.92:0/873336754 learned_addr learned my addr 172.21.15.92:0/873336754 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:24:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.091+0000 7f6f1affd700 1 -- 172.21.15.92:0/873336754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c009a20 con 0x7f6f1c096ca0 2023-09-29T23:24:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.091+0000 7f6f1affd700 1 --2- 172.21.15.92:0/873336754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f1c096ca0 0x7f6f1c08afc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0097c0 tx=0x7f6f0c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.091+0000 7f6f12ffd700 1 -- 172.21.15.92:0/873336754 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f0c022070 con 0x7f6f1c096ca0 2023-09-29T23:24:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.091+0000 7f6f12ffd700 1 -- 172.21.15.92:0/873336754 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c01b530 con 0x7f6f1c096ca0 2023-09-29T23:24:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.091+0000 7f6f212c9700 1 -- 172.21.15.92:0/873336754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f1c08dfb0 con 0x7f6f1c096ca0 2023-09-29T23:24:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.091+0000 7f6f12ffd700 1 -- 172.21.15.92:0/873336754 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f0c01b820 con 0x7f6f1c096ca0 2023-09-29T23:24:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.091+0000 7f6f212c9700 1 -- 172.21.15.92:0/873336754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f1c08e800 con 0x7f6f1c096ca0 2023-09-29T23:24:52.094 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.092+0000 7f6f12ffd700 1 -- 172.21.15.92:0/873336754 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f6f0c01b9d0 con 0x7f6f1c096ca0 2023-09-29T23:24:52.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.092+0000 7f6f212c9700 1 -- 172.21.15.92:0/873336754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f1c0994e0 con 0x7f6f1c096ca0 2023-09-29T23:24:52.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.092+0000 7f6f12ffd700 1 --2- 172.21.15.92:0/873336754 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6efc035640 0x7f6efc037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:52.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.092+0000 7f6f12ffd700 1 -- 172.21.15.92:0/873336754 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f6f0c04ab70 con 0x7f6f1c096ca0 2023-09-29T23:24:52.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.092+0000 7f6f1a7fc700 1 --2- 172.21.15.92:0/873336754 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6efc035640 0x7f6efc037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:52.095 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.092+0000 7f6f1a7fc700 1 --2- 172.21.15.92:0/873336754 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6efc035640 0x7f6efc037af0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f040011e0 tx=0x7f6f040079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:52.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.096+0000 7f6f12ffd700 1 -- 172.21.15.92:0/873336754 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f0c010b50 con 0x7f6f1c096ca0 2023-09-29T23:24:52.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.319+0000 7f6f212c9700 1 -- 172.21.15.92:0/873336754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6f1c05f230 con 0x7f6f1c096ca0 2023-09-29T23:24:52.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.320+0000 7f6f12ffd700 1 -- 172.21.15.92:0/873336754 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f6f0c010760 con 0x7f6f1c096ca0 2023-09-29T23:24:52.320 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:24:52.320 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:24:52.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.322+0000 7f6f212c9700 1 -- 172.21.15.92:0/873336754 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6efc035640 msgr2=0x7f6efc037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:52.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.322+0000 7f6f212c9700 1 --2- 172.21.15.92:0/873336754 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6efc035640 0x7f6efc037af0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f040011e0 tx=0x7f6f040079d0 comp rx=0 tx=0).stop 2023-09-29T23:24:52.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.322+0000 7f6f212c9700 1 -- 172.21.15.92:0/873336754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f1c096ca0 msgr2=0x7f6f1c08afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:52.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.322+0000 7f6f212c9700 1 --2- 172.21.15.92:0/873336754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f1c096ca0 0x7f6f1c08afc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0097c0 tx=0x7f6f0c018000 comp rx=0 tx=0).stop 2023-09-29T23:24:52.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.322+0000 7f6f212c9700 1 -- 172.21.15.92:0/873336754 shutdown_connections 2023-09-29T23:24:52.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.322+0000 7f6f212c9700 1 --2- 172.21.15.92:0/873336754 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6efc035640 0x7f6efc037af0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:52.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.322+0000 7f6f212c9700 1 --2- 172.21.15.92:0/873336754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f1c096ca0 0x7f6f1c08afc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:52.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.322+0000 7f6f212c9700 1 -- 172.21.15.92:0/873336754 >> 172.21.15.92:0/873336754 conn(0x7f6f1c06bd70 msgr2=0x7f6f1c06d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:52.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.322+0000 7f6f212c9700 1 -- 172.21.15.92:0/873336754 shutdown_connections 2023-09-29T23:24:52.323 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:52.322+0000 7f6f212c9700 1 -- 172.21.15.92:0/873336754 wait complete. 2023-09-29T23:24:55.336 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:24:55.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.465+0000 7fef76e1a700 1 Processor -- start 2023-09-29T23:24:55.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.466+0000 7fef76e1a700 1 -- start start 2023-09-29T23:24:55.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.466+0000 7fef76e1a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fef7009fd80 0x7fef700a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:55.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.466+0000 7fef76e1a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef70098710 con 0x7fef7012f8b0 2023-09-29T23:24:55.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.466+0000 7fef76e1a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7012f340 con 0x7fef7009fd80 2023-09-29T23:24:55.467 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.466+0000 7fef74bb6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fef7009fd80 0x7fef700a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:55.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.466+0000 7fef67fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fef7012f8b0 0x7fef70095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:41506/0 (socket says 172.21.15.92:41506) 2023-09-29T23:24:55.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.466+0000 7fef67fff700 1 -- 172.21.15.92:0/2316422997 learned_addr learned my addr 172.21.15.92:0/2316422997 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:24:55.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.466+0000 7fef74bb6700 1 -- 172.21.15.92:0/2316422997 >> v1:172.21.15.92:6789/0 conn(0x7fef7012f8b0 legacy=0x7fef70095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:55.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.466+0000 7fef74bb6700 1 -- 172.21.15.92:0/2316422997 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef700997e0 con 0x7fef7009fd80 2023-09-29T23:24:55.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.467+0000 7fef74bb6700 1 --2- 172.21.15.92:0/2316422997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7009fd80 0x7fef700a3090 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009de0 tx=0x7fef6c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f83c6fc2aeb2ce1 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:55.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.467+0000 7fef677fe700 1 -- 172.21.15.92:0/2316422997 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef6c00e070 con 0x7fef7009fd80 2023-09-29T23:24:55.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.467+0000 7fef677fe700 1 -- 172.21.15.92:0/2316422997 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c00bc80 con 0x7fef7009fd80 2023-09-29T23:24:55.468 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.467+0000 7fef677fe700 1 -- 172.21.15.92:0/2316422997 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef6c012430 con 0x7fef7009fd80 2023-09-29T23:24:55.470 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.467+0000 7fef76e1a700 1 -- 172.21.15.92:0/2316422997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7009fd80 msgr2=0x7fef700a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:55.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.467+0000 7fef76e1a700 1 --2- 172.21.15.92:0/2316422997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7009fd80 0x7fef700a3090 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009de0 tx=0x7fef6c009780 comp rx=0 tx=0).stop 2023-09-29T23:24:55.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.467+0000 7fef76e1a700 1 -- 172.21.15.92:0/2316422997 shutdown_connections 2023-09-29T23:24:55.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.467+0000 7fef76e1a700 1 --2- 172.21.15.92:0/2316422997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7009fd80 0x7fef700a3090 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:55.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.467+0000 7fef76e1a700 1 -- 172.21.15.92:0/2316422997 >> 172.21.15.92:0/2316422997 conn(0x7fef70068000 msgr2=0x7fef700a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:55.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.467+0000 7fef76e1a700 1 -- 172.21.15.92:0/2316422997 shutdown_connections 2023-09-29T23:24:55.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.467+0000 7fef76e1a700 1 -- 172.21.15.92:0/2316422997 wait complete. 2023-09-29T23:24:55.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.468+0000 7fef76e1a700 1 Processor -- start 2023-09-29T23:24:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.468+0000 7fef76e1a700 1 -- start start 2023-09-29T23:24:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.469+0000 7fef76e1a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7009fd80 0x7fef70119fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.469+0000 7fef76e1a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7011e610 con 0x7fef7009fd80 2023-09-29T23:24:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.469+0000 7fef74bb6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7009fd80 0x7fef70119fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.469+0000 7fef74bb6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7009fd80 0x7fef70119fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34834/0 (socket says 172.21.15.92:34834) 2023-09-29T23:24:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.469+0000 7fef74bb6700 1 -- 172.21.15.92:0/1024261316 learned_addr learned my addr 172.21.15.92:0/1024261316 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:24:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.469+0000 7fef74bb6700 1 -- 172.21.15.92:0/1024261316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c009a20 con 0x7fef7009fd80 2023-09-29T23:24:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.469+0000 7fef74bb6700 1 --2- 172.21.15.92:0/1024261316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7009fd80 0x7fef70119fa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0099f0 tx=0x7fef6c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.469+0000 7fef64ff9700 1 -- 172.21.15.92:0/1024261316 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef6c027470 con 0x7fef7009fd80 2023-09-29T23:24:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.470+0000 7fef64ff9700 1 -- 172.21.15.92:0/1024261316 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c0275d0 con 0x7fef7009fd80 2023-09-29T23:24:55.476 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.470+0000 7fef64ff9700 1 -- 172.21.15.92:0/1024261316 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef6c0278c0 con 0x7fef7009fd80 2023-09-29T23:24:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.470+0000 7fef76e1a700 1 -- 172.21.15.92:0/1024261316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7011ba50 con 0x7fef7009fd80 2023-09-29T23:24:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.470+0000 7fef76e1a700 1 -- 172.21.15.92:0/1024261316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7011d460 con 0x7fef7009fd80 2023-09-29T23:24:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.470+0000 7fef64ff9700 1 -- 172.21.15.92:0/1024261316 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fef6c024070 con 0x7fef7009fd80 2023-09-29T23:24:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.470+0000 7fef76e1a700 1 -- 172.21.15.92:0/1024261316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7005f230 con 0x7fef7009fd80 2023-09-29T23:24:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.471+0000 7fef64ff9700 1 --2- 172.21.15.92:0/1024261316 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fef5c035640 0x7fef5c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:55.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.471+0000 7fef64ff9700 1 -- 172.21.15.92:0/1024261316 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fef6c049cc0 con 0x7fef7009fd80 2023-09-29T23:24:55.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.471+0000 7fef67fff700 1 --2- 172.21.15.92:0/1024261316 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fef5c035640 0x7fef5c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:55.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.471+0000 7fef67fff700 1 --2- 172.21.15.92:0/1024261316 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fef5c035640 0x7fef5c037af0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fef600016a0 tx=0x7fef60007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:55.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.475+0000 7fef64ff9700 1 -- 172.21.15.92:0/1024261316 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef6c027a20 con 0x7fef7009fd80 2023-09-29T23:24:55.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.697+0000 7fef76e1a700 1 -- 172.21.15.92:0/1024261316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fef7004bb40 con 0x7fef7009fd80 2023-09-29T23:24:55.697 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.697+0000 7fef64ff9700 1 -- 172.21.15.92:0/1024261316 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fef6c01cba0 con 0x7fef7009fd80 2023-09-29T23:24:55.698 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:24:55.698 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:24:55.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.699+0000 7fef76e1a700 1 -- 172.21.15.92:0/1024261316 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fef5c035640 msgr2=0x7fef5c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:55.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.699+0000 7fef76e1a700 1 --2- 172.21.15.92:0/1024261316 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fef5c035640 0x7fef5c037af0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fef600016a0 tx=0x7fef60007b30 comp rx=0 tx=0).stop 2023-09-29T23:24:55.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.699+0000 7fef76e1a700 1 -- 172.21.15.92:0/1024261316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7009fd80 msgr2=0x7fef70119fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:55.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.699+0000 7fef76e1a700 1 --2- 172.21.15.92:0/1024261316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7009fd80 0x7fef70119fa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0099f0 tx=0x7fef6c018000 comp rx=0 tx=0).stop 2023-09-29T23:24:55.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.699+0000 7fef76e1a700 1 -- 172.21.15.92:0/1024261316 shutdown_connections 2023-09-29T23:24:55.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.699+0000 7fef76e1a700 1 --2- 172.21.15.92:0/1024261316 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fef5c035640 0x7fef5c037af0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:55.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.699+0000 7fef76e1a700 1 --2- 172.21.15.92:0/1024261316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7009fd80 0x7fef70119fa0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:55.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.699+0000 7fef76e1a700 1 -- 172.21.15.92:0/1024261316 >> 172.21.15.92:0/1024261316 conn(0x7fef70068000 msgr2=0x7fef70094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:55.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.699+0000 7fef76e1a700 1 -- 172.21.15.92:0/1024261316 shutdown_connections 2023-09-29T23:24:55.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:55.699+0000 7fef76e1a700 1 -- 172.21.15.92:0/1024261316 wait complete. 2023-09-29T23:24:58.711 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:24:58.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.834+0000 7f731e967700 1 Processor -- start 2023-09-29T23:24:58.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.834+0000 7f731e967700 1 -- start start 2023-09-29T23:24:58.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.834+0000 7f731e967700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f731812f6b0 0x7f7318134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:58.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.834+0000 7f731e967700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731809b730 con 0x7f731806f100 2023-09-29T23:24:58.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.834+0000 7f731e967700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731806a870 con 0x7f731812f6b0 2023-09-29T23:24:58.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.834+0000 7f731d164700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f731812f6b0 0x7f7318134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:58.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.834+0000 7f731d965700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f731806f100 0x7f731812efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:41520/0 (socket says 172.21.15.92:41520) 2023-09-29T23:24:58.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.834+0000 7f731d965700 1 -- 172.21.15.92:0/3189556572 learned_addr learned my addr 172.21.15.92:0/3189556572 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:24:58.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.835+0000 7f731c963700 1 -- 172.21.15.92:0/3189556572 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911317941 0 0) 0x7f731809b730 con 0x7f731806f100 2023-09-29T23:24:58.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.835+0000 7f731c963700 1 -- 172.21.15.92:0/3189556572 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7304003570 con 0x7f731806f100 2023-09-29T23:24:58.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.835+0000 7f731d164700 1 -- 172.21.15.92:0/3189556572 >> v1:172.21.15.92:6789/0 conn(0x7f731806f100 legacy=0x7f731812efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:58.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.835+0000 7f731d164700 1 -- 172.21.15.92:0/3189556572 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731809b9d0 con 0x7f731812f6b0 2023-09-29T23:24:58.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.835+0000 7f731d164700 1 --2- 172.21.15.92:0/3189556572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f731812f6b0 0x7f7318134330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7308009860 tx=0x7f73080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c92efa4b31c7cb9 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:58.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.835+0000 7f731c963700 1 -- 172.21.15.92:0/3189556572 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7308011630 con 0x7f731812f6b0 2023-09-29T23:24:58.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.835+0000 7f731c963700 1 -- 172.21.15.92:0/3189556572 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7308011790 con 0x7f731812f6b0 2023-09-29T23:24:58.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.835+0000 7f731c963700 1 -- 172.21.15.92:0/3189556572 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7308011920 con 0x7f731812f6b0 2023-09-29T23:24:58.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.835+0000 7f731e967700 1 -- 172.21.15.92:0/3189556572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f731812f6b0 msgr2=0x7f7318134330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.835+0000 7f731e967700 1 --2- 172.21.15.92:0/3189556572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f731812f6b0 0x7f7318134330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7308009860 tx=0x7f73080091a0 comp rx=0 tx=0).stop 2023-09-29T23:24:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.836+0000 7f731e967700 1 -- 172.21.15.92:0/3189556572 shutdown_connections 2023-09-29T23:24:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.836+0000 7f731e967700 1 --2- 172.21.15.92:0/3189556572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f731812f6b0 0x7f7318134330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.836+0000 7f731e967700 1 -- 172.21.15.92:0/3189556572 >> 172.21.15.92:0/3189556572 conn(0x7f7318094a70 msgr2=0x7f731806e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.836+0000 7f731e967700 1 -- 172.21.15.92:0/3189556572 shutdown_connections 2023-09-29T23:24:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.836+0000 7f731e967700 1 -- 172.21.15.92:0/3189556572 wait complete. 2023-09-29T23:24:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.836+0000 7f731e967700 1 Processor -- start 2023-09-29T23:24:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.836+0000 7f731e967700 1 -- start start 2023-09-29T23:24:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.837+0000 7f731e967700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f731806f100 0x7f731812beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.837+0000 7f731e967700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731811e990 con 0x7f731806f100 2023-09-29T23:24:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.837+0000 7f731d965700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f731806f100 0x7f731812beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.837+0000 7f731d965700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f731806f100 0x7f731812beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34848/0 (socket says 172.21.15.92:34848) 2023-09-29T23:24:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.837+0000 7f731d965700 1 -- 172.21.15.92:0/3513183441 learned_addr learned my addr 172.21.15.92:0/3513183441 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:24:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.837+0000 7f731d965700 1 -- 172.21.15.92:0/3513183441 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7308009420 con 0x7f731806f100 2023-09-29T23:24:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.837+0000 7f731d965700 1 --2- 172.21.15.92:0/3513183441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f731806f100 0x7f731812beb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f731400c490 tx=0x7f7314007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.837+0000 7f730dffb700 1 -- 172.21.15.92:0/3513183441 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7314005b30 con 0x7f731806f100 2023-09-29T23:24:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.837+0000 7f730dffb700 1 -- 172.21.15.92:0/3513183441 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7314005c90 con 0x7f731806f100 2023-09-29T23:24:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.837+0000 7f731e967700 1 -- 172.21.15.92:0/3513183441 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731811e680 con 0x7f731806f100 2023-09-29T23:24:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.837+0000 7f730dffb700 1 -- 172.21.15.92:0/3513183441 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73140070d0 con 0x7f731806f100 2023-09-29T23:24:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.838+0000 7f731e967700 1 -- 172.21.15.92:0/3513183441 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731811dd80 con 0x7f731806f100 2023-09-29T23:24:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.838+0000 7f730dffb700 1 -- 172.21.15.92:0/3513183441 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f7314007230 con 0x7f731806f100 2023-09-29T23:24:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.838+0000 7f730dffb700 1 --2- 172.21.15.92:0/3513183441 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f72fc035640 0x7f72fc037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:24:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.838+0000 7f731e967700 1 -- 172.21.15.92:0/3513183441 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731805f230 con 0x7f731806f100 2023-09-29T23:24:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.839+0000 7f730dffb700 1 -- 172.21.15.92:0/3513183441 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f7314046940 con 0x7f731806f100 2023-09-29T23:24:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.839+0000 7f731d164700 1 --2- 172.21.15.92:0/3513183441 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f72fc035640 0x7f72fc037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:24:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.839+0000 7f731d164700 1 --2- 172.21.15.92:0/3513183441 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f72fc035640 0x7f72fc037af0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f73080030c0 tx=0x7f7308016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:24:58.843 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:58.843+0000 7f730dffb700 1 -- 172.21.15.92:0/3513183441 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7314017080 con 0x7f731806f100 2023-09-29T23:24:59.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:59.065+0000 7f731e967700 1 -- 172.21.15.92:0/3513183441 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f731806b250 con 0x7f731806f100 2023-09-29T23:24:59.065 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:59.065+0000 7f730dffb700 1 -- 172.21.15.92:0/3513183441 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f73140186d0 con 0x7f731806f100 2023-09-29T23:24:59.065 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:24:59.065 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:24:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:59.067+0000 7f731e967700 1 -- 172.21.15.92:0/3513183441 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f72fc035640 msgr2=0x7f72fc037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:59.067+0000 7f731e967700 1 --2- 172.21.15.92:0/3513183441 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f72fc035640 0x7f72fc037af0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f73080030c0 tx=0x7f7308016000 comp rx=0 tx=0).stop 2023-09-29T23:24:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:59.067+0000 7f731e967700 1 -- 172.21.15.92:0/3513183441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f731806f100 msgr2=0x7f731812beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:24:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:59.067+0000 7f731e967700 1 --2- 172.21.15.92:0/3513183441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f731806f100 0x7f731812beb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f731400c490 tx=0x7f7314007e00 comp rx=0 tx=0).stop 2023-09-29T23:24:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:59.067+0000 7f731e967700 1 -- 172.21.15.92:0/3513183441 shutdown_connections 2023-09-29T23:24:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:59.067+0000 7f731e967700 1 --2- 172.21.15.92:0/3513183441 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f72fc035640 0x7f72fc037af0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:59.067+0000 7f731e967700 1 --2- 172.21.15.92:0/3513183441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f731806f100 0x7f731812beb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:24:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:59.067+0000 7f731e967700 1 -- 172.21.15.92:0/3513183441 >> 172.21.15.92:0/3513183441 conn(0x7f7318094a70 msgr2=0x7f731812ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:24:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:59.067+0000 7f731e967700 1 -- 172.21.15.92:0/3513183441 shutdown_connections 2023-09-29T23:24:59.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:24:59.067+0000 7f731e967700 1 -- 172.21.15.92:0/3513183441 wait complete. 2023-09-29T23:25:02.079 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:25:02.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.202+0000 7f009b29b700 1 Processor -- start 2023-09-29T23:25:02.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.202+0000 7f009b29b700 1 -- start start 2023-09-29T23:25:02.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.202+0000 7f009b29b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f00940a3030 0x7f009412f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:02.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.202+0000 7f009b29b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00940997f0 con 0x7f009412fae0 2023-09-29T23:25:02.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.202+0000 7f009b29b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00940a3400 con 0x7f00940a3030 2023-09-29T23:25:02.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.202+0000 7f0099037700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f00940a3030 0x7f009412f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:02.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.202+0000 7f0098836700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f009412fae0 0x7f0094095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:33288/0 (socket says 172.21.15.92:33288) 2023-09-29T23:25:02.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.202+0000 7f0099037700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f00940a3030 0x7f009412f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60710/0 (socket says 172.21.15.92:60710) 2023-09-29T23:25:02.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.202+0000 7f0098836700 1 -- 172.21.15.92:0/2043446297 learned_addr learned my addr 172.21.15.92:0/2043446297 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:25:02.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.203+0000 7f0099037700 1 -- 172.21.15.92:0/2043446297 >> v1:172.21.15.92:6789/0 conn(0x7f009412fae0 legacy=0x7f0094095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:02.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.203+0000 7f0099037700 1 -- 172.21.15.92:0/2043446297 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00940977a0 con 0x7f00940a3030 2023-09-29T23:25:02.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.203+0000 7f0099037700 1 --2- 172.21.15.92:0/2043446297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00940a3030 0x7f009412f5a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0090009de0 tx=0x7f0090009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26eef54f089b0112 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:02.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.203+0000 7f008bfff700 1 -- 172.21.15.92:0/2043446297 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f009000e070 con 0x7f00940a3030 2023-09-29T23:25:02.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.203+0000 7f008bfff700 1 -- 172.21.15.92:0/2043446297 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009000bd10 con 0x7f00940a3030 2023-09-29T23:25:02.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.203+0000 7f008bfff700 1 -- 172.21.15.92:0/2043446297 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0090012430 con 0x7f00940a3030 2023-09-29T23:25:02.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.203+0000 7f009b29b700 1 -- 172.21.15.92:0/2043446297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00940a3030 msgr2=0x7f009412f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:02.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.203+0000 7f009b29b700 1 --2- 172.21.15.92:0/2043446297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00940a3030 0x7f009412f5a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0090009de0 tx=0x7f0090009780 comp rx=0 tx=0).stop 2023-09-29T23:25:02.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.203+0000 7f009b29b700 1 -- 172.21.15.92:0/2043446297 shutdown_connections 2023-09-29T23:25:02.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.203+0000 7f009b29b700 1 --2- 172.21.15.92:0/2043446297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00940a3030 0x7f009412f5a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:02.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.203+0000 7f009b29b700 1 -- 172.21.15.92:0/2043446297 >> 172.21.15.92:0/2043446297 conn(0x7f0094067fc0 msgr2=0x7f00940a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:02.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.203+0000 7f009b29b700 1 -- 172.21.15.92:0/2043446297 shutdown_connections 2023-09-29T23:25:02.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.203+0000 7f009b29b700 1 -- 172.21.15.92:0/2043446297 wait complete. 2023-09-29T23:25:02.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.204+0000 7f009b29b700 1 Processor -- start 2023-09-29T23:25:02.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.204+0000 7f009b29b700 1 -- start start 2023-09-29T23:25:02.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.205+0000 7f009b29b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00940a3030 0x7f009412c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:02.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.205+0000 7f009b29b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009411daa0 con 0x7f00940a3030 2023-09-29T23:25:02.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.205+0000 7f0099037700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00940a3030 0x7f009412c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:02.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.205+0000 7f0099037700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00940a3030 0x7f009412c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60718/0 (socket says 172.21.15.92:60718) 2023-09-29T23:25:02.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.205+0000 7f0099037700 1 -- 172.21.15.92:0/116947784 learned_addr learned my addr 172.21.15.92:0/116947784 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:25:02.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.205+0000 7f0099037700 1 -- 172.21.15.92:0/116947784 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0090009a20 con 0x7f00940a3030 2023-09-29T23:25:02.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.205+0000 7f0099037700 1 --2- 172.21.15.92:0/116947784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00940a3030 0x7f009412c400 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f00900099f0 tx=0x7f0090018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:02.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.205+0000 7f00897fa700 1 -- 172.21.15.92:0/116947784 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f009001d640 con 0x7f00940a3030 2023-09-29T23:25:02.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.205+0000 7f00897fa700 1 -- 172.21.15.92:0/116947784 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009001d7a0 con 0x7f00940a3030 2023-09-29T23:25:02.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.205+0000 7f009b29b700 1 -- 172.21.15.92:0/116947784 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009411be40 con 0x7f00940a3030 2023-09-29T23:25:02.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.205+0000 7f00897fa700 1 -- 172.21.15.92:0/116947784 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f009001da90 con 0x7f00940a3030 2023-09-29T23:25:02.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.205+0000 7f009b29b700 1 -- 172.21.15.92:0/116947784 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009411c6a0 con 0x7f00940a3030 2023-09-29T23:25:02.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.206+0000 7f00897fa700 1 -- 172.21.15.92:0/116947784 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f0090024070 con 0x7f00940a3030 2023-09-29T23:25:02.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.206+0000 7f00897fa700 1 --2- 172.21.15.92:0/116947784 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0078035640 0x7f0078037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:02.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.206+0000 7f00897fa700 1 -- 172.21.15.92:0/116947784 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f009004a2f0 con 0x7f00940a3030 2023-09-29T23:25:02.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.206+0000 7f0098836700 1 --2- 172.21.15.92:0/116947784 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0078035640 0x7f0078037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:02.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.206+0000 7f009b29b700 1 -- 172.21.15.92:0/116947784 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f009411bcb0 con 0x7f00940a3030 2023-09-29T23:25:02.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.207+0000 7f0098836700 1 --2- 172.21.15.92:0/116947784 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0078035640 0x7f0078037af0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f00840016a0 tx=0x7f0084007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:02.213 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.211+0000 7f00897fa700 1 -- 172.21.15.92:0/116947784 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f009002f3a0 con 0x7f00940a3030 2023-09-29T23:25:02.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.433+0000 7f009b29b700 1 -- 172.21.15.92:0/116947784 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f009405f230 con 0x7f00940a3030 2023-09-29T23:25:02.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.433+0000 7f00897fa700 1 -- 172.21.15.92:0/116947784 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f009001cba0 con 0x7f00940a3030 2023-09-29T23:25:02.434 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:25:02.434 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:25:02.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.435+0000 7f009b29b700 1 -- 172.21.15.92:0/116947784 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0078035640 msgr2=0x7f0078037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:02.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.435+0000 7f009b29b700 1 --2- 172.21.15.92:0/116947784 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0078035640 0x7f0078037af0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f00840016a0 tx=0x7f0084007b30 comp rx=0 tx=0).stop 2023-09-29T23:25:02.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.435+0000 7f009b29b700 1 -- 172.21.15.92:0/116947784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00940a3030 msgr2=0x7f009412c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:02.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.435+0000 7f009b29b700 1 --2- 172.21.15.92:0/116947784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00940a3030 0x7f009412c400 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f00900099f0 tx=0x7f0090018000 comp rx=0 tx=0).stop 2023-09-29T23:25:02.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.435+0000 7f009b29b700 1 -- 172.21.15.92:0/116947784 shutdown_connections 2023-09-29T23:25:02.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.435+0000 7f009b29b700 1 --2- 172.21.15.92:0/116947784 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0078035640 0x7f0078037af0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:02.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.435+0000 7f009b29b700 1 --2- 172.21.15.92:0/116947784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00940a3030 0x7f009412c400 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:02.436 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.435+0000 7f009b29b700 1 -- 172.21.15.92:0/116947784 >> 172.21.15.92:0/116947784 conn(0x7f0094067fc0 msgr2=0x7f009412d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:02.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.435+0000 7f009b29b700 1 -- 172.21.15.92:0/116947784 shutdown_connections 2023-09-29T23:25:02.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:02.435+0000 7f009b29b700 1 -- 172.21.15.92:0/116947784 wait complete. 2023-09-29T23:25:05.447 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:25:05.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.575+0000 7ff30f3d1700 1 Processor -- start 2023-09-29T23:25:05.576 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.576+0000 7ff30f3d1700 1 -- start start 2023-09-29T23:25:05.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.576+0000 7ff30f3d1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff3080a3030 0x7ff30812f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:05.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.576+0000 7ff30f3d1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3080997f0 con 0x7ff30812fae0 2023-09-29T23:25:05.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.576+0000 7ff30f3d1700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3080a3400 con 0x7ff3080a3030 2023-09-29T23:25:05.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.576+0000 7ff30d16d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff3080a3030 0x7ff30812f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:05.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.576+0000 7ff30c96c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ff30812fae0 0x7ff308095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:33290/0 (socket says 172.21.15.92:33290) 2023-09-29T23:25:05.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.576+0000 7ff30c96c700 1 -- 172.21.15.92:0/3154080945 learned_addr learned my addr 172.21.15.92:0/3154080945 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:25:05.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.576+0000 7ff30d16d700 1 -- 172.21.15.92:0/3154080945 >> v1:172.21.15.92:6789/0 conn(0x7ff30812fae0 legacy=0x7ff308095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:05.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.576+0000 7ff30d16d700 1 -- 172.21.15.92:0/3154080945 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3080977a0 con 0x7ff3080a3030 2023-09-29T23:25:05.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.577+0000 7ff30d16d700 1 --2- 172.21.15.92:0/3154080945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3080a3030 0x7ff30812f5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff304009860 tx=0x7ff3040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392284c0ade9e0b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:05.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.577+0000 7ff2fffff700 1 -- 172.21.15.92:0/3154080945 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff30400b710 con 0x7ff3080a3030 2023-09-29T23:25:05.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.577+0000 7ff2fffff700 1 -- 172.21.15.92:0/3154080945 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30400b870 con 0x7ff3080a3030 2023-09-29T23:25:05.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.577+0000 7ff2fffff700 1 -- 172.21.15.92:0/3154080945 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff30400ba20 con 0x7ff3080a3030 2023-09-29T23:25:05.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.577+0000 7ff30f3d1700 1 -- 172.21.15.92:0/3154080945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3080a3030 msgr2=0x7ff30812f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:05.579 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.577+0000 7ff30f3d1700 1 --2- 172.21.15.92:0/3154080945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3080a3030 0x7ff30812f5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff304009860 tx=0x7ff3040091a0 comp rx=0 tx=0).stop 2023-09-29T23:25:05.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.577+0000 7ff30f3d1700 1 -- 172.21.15.92:0/3154080945 shutdown_connections 2023-09-29T23:25:05.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.577+0000 7ff30f3d1700 1 --2- 172.21.15.92:0/3154080945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3080a3030 0x7ff30812f5a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:05.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.577+0000 7ff30f3d1700 1 -- 172.21.15.92:0/3154080945 >> 172.21.15.92:0/3154080945 conn(0x7ff308067fc0 msgr2=0x7ff3080a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:05.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.577+0000 7ff30f3d1700 1 -- 172.21.15.92:0/3154080945 shutdown_connections 2023-09-29T23:25:05.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.577+0000 7ff30f3d1700 1 -- 172.21.15.92:0/3154080945 wait complete. 2023-09-29T23:25:05.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.578+0000 7ff30f3d1700 1 Processor -- start 2023-09-29T23:25:05.580 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.578+0000 7ff30f3d1700 1 -- start start 2023-09-29T23:25:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.579+0000 7ff30f3d1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3080a3030 0x7ff30812c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.579+0000 7ff30f3d1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30811daa0 con 0x7ff3080a3030 2023-09-29T23:25:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.579+0000 7ff30d16d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3080a3030 0x7ff30812c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.579+0000 7ff30d16d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3080a3030 0x7ff30812c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60738/0 (socket says 172.21.15.92:60738) 2023-09-29T23:25:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.579+0000 7ff30d16d700 1 -- 172.21.15.92:0/2929771851 learned_addr learned my addr 172.21.15.92:0/2929771851 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:25:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.579+0000 7ff30d16d700 1 -- 172.21.15.92:0/2929771851 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff304009420 con 0x7ff3080a3030 2023-09-29T23:25:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.579+0000 7ff30d16d700 1 --2- 172.21.15.92:0/2929771851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3080a3030 0x7ff30812c400 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff304000c00 tx=0x7ff304016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.579+0000 7ff2fd7fa700 1 -- 172.21.15.92:0/2929771851 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff304024470 con 0x7ff3080a3030 2023-09-29T23:25:05.582 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.579+0000 7ff30f3d1700 1 -- 172.21.15.92:0/2929771851 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30811be40 con 0x7ff3080a3030 2023-09-29T23:25:05.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.579+0000 7ff2fd7fa700 1 -- 172.21.15.92:0/2929771851 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3040245d0 con 0x7ff3080a3030 2023-09-29T23:25:05.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.579+0000 7ff2fd7fa700 1 -- 172.21.15.92:0/2929771851 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3040248a0 con 0x7ff3080a3030 2023-09-29T23:25:05.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.580+0000 7ff30f3d1700 1 -- 172.21.15.92:0/2929771851 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30811c6a0 con 0x7ff3080a3030 2023-09-29T23:25:05.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.580+0000 7ff2fd7fa700 1 -- 172.21.15.92:0/2929771851 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7ff304021070 con 0x7ff3080a3030 2023-09-29T23:25:05.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.580+0000 7ff30f3d1700 1 -- 172.21.15.92:0/2929771851 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff30811bcb0 con 0x7ff3080a3030 2023-09-29T23:25:05.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.580+0000 7ff2fd7fa700 1 --2- 172.21.15.92:0/2929771851 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff2ec0355f0 0x7ff2ec037aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:05.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.580+0000 7ff2fd7fa700 1 -- 172.21.15.92:0/2929771851 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7ff304049540 con 0x7ff3080a3030 2023-09-29T23:25:05.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.580+0000 7ff30c96c700 1 --2- 172.21.15.92:0/2929771851 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff2ec0355f0 0x7ff2ec037aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:05.583 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.581+0000 7ff30c96c700 1 --2- 172.21.15.92:0/2929771851 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff2ec0355f0 0x7ff2ec037aa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80016a0 tx=0x7ff2f8007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:05.585 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.585+0000 7ff2fd7fa700 1 -- 172.21.15.92:0/2929771851 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff304023790 con 0x7ff3080a3030 2023-09-29T23:25:05.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.809+0000 7ff30f3d1700 1 -- 172.21.15.92:0/2929771851 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff30805f230 con 0x7ff3080a3030 2023-09-29T23:25:05.809 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.809+0000 7ff2fd7fa700 1 -- 172.21.15.92:0/2929771851 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7ff3040233d0 con 0x7ff3080a3030 2023-09-29T23:25:05.810 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:25:05.810 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:25:05.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.811+0000 7ff30f3d1700 1 -- 172.21.15.92:0/2929771851 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff2ec0355f0 msgr2=0x7ff2ec037aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:05.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.811+0000 7ff30f3d1700 1 --2- 172.21.15.92:0/2929771851 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff2ec0355f0 0x7ff2ec037aa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80016a0 tx=0x7ff2f8007b30 comp rx=0 tx=0).stop 2023-09-29T23:25:05.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.811+0000 7ff30f3d1700 1 -- 172.21.15.92:0/2929771851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3080a3030 msgr2=0x7ff30812c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:05.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.811+0000 7ff30f3d1700 1 --2- 172.21.15.92:0/2929771851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3080a3030 0x7ff30812c400 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff304000c00 tx=0x7ff304016000 comp rx=0 tx=0).stop 2023-09-29T23:25:05.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.811+0000 7ff30f3d1700 1 -- 172.21.15.92:0/2929771851 shutdown_connections 2023-09-29T23:25:05.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.811+0000 7ff30f3d1700 1 --2- 172.21.15.92:0/2929771851 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff2ec0355f0 0x7ff2ec037aa0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:05.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.811+0000 7ff30f3d1700 1 --2- 172.21.15.92:0/2929771851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3080a3030 0x7ff30812c400 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:05.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.811+0000 7ff30f3d1700 1 -- 172.21.15.92:0/2929771851 >> 172.21.15.92:0/2929771851 conn(0x7ff308067fc0 msgr2=0x7ff30812d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:05.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.811+0000 7ff30f3d1700 1 -- 172.21.15.92:0/2929771851 shutdown_connections 2023-09-29T23:25:05.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:05.811+0000 7ff30f3d1700 1 -- 172.21.15.92:0/2929771851 wait complete. 2023-09-29T23:25:08.823 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:25:08.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.944+0000 7f4c7711b700 1 Processor -- start 2023-09-29T23:25:08.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.944+0000 7f4c7711b700 1 -- start start 2023-09-29T23:25:08.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.945+0000 7f4c7711b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4c7012fd40 0x7f4c70134530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:08.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.945+0000 7f4c7711b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c7009ca80 con 0x7f4c7006b0c0 2023-09-29T23:25:08.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.945+0000 7f4c7711b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c7006b490 con 0x7f4c7012fd40 2023-09-29T23:25:08.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.945+0000 7f4c75918700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4c7012fd40 0x7f4c70134530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:08.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.945+0000 7f4c76119700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f4c7006b0c0 0x7f4c7012f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:33296/0 (socket says 172.21.15.92:33296) 2023-09-29T23:25:08.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.945+0000 7f4c76119700 1 -- 172.21.15.92:0/1039982664 learned_addr learned my addr 172.21.15.92:0/1039982664 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:25:08.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.945+0000 7f4c75918700 1 -- 172.21.15.92:0/1039982664 >> v1:172.21.15.92:6789/0 conn(0x7f4c7006b0c0 legacy=0x7f4c7012f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:08.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.945+0000 7f4c75918700 1 -- 172.21.15.92:0/1039982664 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7009be20 con 0x7f4c7012fd40 2023-09-29T23:25:08.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.945+0000 7f4c75918700 1 --2- 172.21.15.92:0/1039982664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7012fd40 0x7f4c70134530 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009860 tx=0x7f4c600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137d732bd433245d server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:08.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.945+0000 7f4c75117700 1 -- 172.21.15.92:0/1039982664 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c6000b680 con 0x7f4c7012fd40 2023-09-29T23:25:08.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.945+0000 7f4c75117700 1 -- 172.21.15.92:0/1039982664 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6000b7e0 con 0x7f4c7012fd40 2023-09-29T23:25:08.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.945+0000 7f4c75117700 1 -- 172.21.15.92:0/1039982664 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c6000bad0 con 0x7f4c7012fd40 2023-09-29T23:25:08.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.946+0000 7f4c7711b700 1 -- 172.21.15.92:0/1039982664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7012fd40 msgr2=0x7f4c70134530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:08.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.946+0000 7f4c7711b700 1 --2- 172.21.15.92:0/1039982664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7012fd40 0x7f4c70134530 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009860 tx=0x7f4c600091a0 comp rx=0 tx=0).stop 2023-09-29T23:25:08.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.946+0000 7f4c7711b700 1 -- 172.21.15.92:0/1039982664 shutdown_connections 2023-09-29T23:25:08.947 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.946+0000 7f4c7711b700 1 --2- 172.21.15.92:0/1039982664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7012fd40 0x7f4c70134530 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:08.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.946+0000 7f4c7711b700 1 -- 172.21.15.92:0/1039982664 >> 172.21.15.92:0/1039982664 conn(0x7f4c7006a5b0 msgr2=0x7f4c7006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:08.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.946+0000 7f4c7711b700 1 -- 172.21.15.92:0/1039982664 shutdown_connections 2023-09-29T23:25:08.948 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.946+0000 7f4c7711b700 1 -- 172.21.15.92:0/1039982664 wait complete. 2023-09-29T23:25:08.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.947+0000 7f4c7711b700 1 Processor -- start 2023-09-29T23:25:08.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.947+0000 7f4c7711b700 1 -- start start 2023-09-29T23:25:08.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.947+0000 7f4c7711b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7006b0c0 0x7f4c7011df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:08.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.947+0000 7f4c7711b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7011c800 con 0x7f4c7006b0c0 2023-09-29T23:25:08.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.947+0000 7f4c76119700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7006b0c0 0x7f4c7011df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:08.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.947+0000 7f4c76119700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7006b0c0 0x7f4c7011df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60752/0 (socket says 172.21.15.92:60752) 2023-09-29T23:25:08.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.947+0000 7f4c76119700 1 -- 172.21.15.92:0/757880832 learned_addr learned my addr 172.21.15.92:0/757880832 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:25:08.950 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.947+0000 7f4c76119700 1 -- 172.21.15.92:0/757880832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c60009420 con 0x7f4c7006b0c0 2023-09-29T23:25:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.947+0000 7f4c76119700 1 --2- 172.21.15.92:0/757880832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7006b0c0 0x7f4c7011df70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00cb70 tx=0x7f4c6c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.948+0000 7f4c667fc700 1 -- 172.21.15.92:0/757880832 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c6c00a9a0 con 0x7f4c7006b0c0 2023-09-29T23:25:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.948+0000 7f4c667fc700 1 -- 172.21.15.92:0/757880832 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6c00ab00 con 0x7f4c7006b0c0 2023-09-29T23:25:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.948+0000 7f4c7711b700 1 -- 172.21.15.92:0/757880832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7011db50 con 0x7f4c7006b0c0 2023-09-29T23:25:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.948+0000 7f4c667fc700 1 -- 172.21.15.92:0/757880832 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c6c00adb0 con 0x7f4c7006b0c0 2023-09-29T23:25:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.948+0000 7f4c7711b700 1 -- 172.21.15.92:0/757880832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7011bef0 con 0x7f4c7006b0c0 2023-09-29T23:25:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.949+0000 7f4c7711b700 1 -- 172.21.15.92:0/757880832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7011c940 con 0x7f4c7006b0c0 2023-09-29T23:25:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.949+0000 7f4c667fc700 1 -- 172.21.15.92:0/757880832 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f4c6c0070f0 con 0x7f4c7006b0c0 2023-09-29T23:25:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.949+0000 7f4c667fc700 1 --2- 172.21.15.92:0/757880832 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4c54035630 0x7f4c54037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:08.951 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.949+0000 7f4c667fc700 1 -- 172.21.15.92:0/757880832 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f4c6c047760 con 0x7f4c7006b0c0 2023-09-29T23:25:08.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.949+0000 7f4c75918700 1 --2- 172.21.15.92:0/757880832 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4c54035630 0x7f4c54037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:08.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.949+0000 7f4c75918700 1 --2- 172.21.15.92:0/757880832 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4c54035630 0x7f4c54037ae0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009860 tx=0x7f4c60016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:08.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:08.953+0000 7f4c667fc700 1 -- 172.21.15.92:0/757880832 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c7011c940 con 0x7f4c7006b0c0 2023-09-29T23:25:09.175 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:09.175+0000 7f4c7711b700 1 -- 172.21.15.92:0/757880832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4c7009ca80 con 0x7f4c7006b0c0 2023-09-29T23:25:09.176 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:09.175+0000 7f4c667fc700 1 -- 172.21.15.92:0/757880832 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f4c7009ca80 con 0x7f4c7006b0c0 2023-09-29T23:25:09.176 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:25:09.176 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:25:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:09.177+0000 7f4c7711b700 1 -- 172.21.15.92:0/757880832 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4c54035630 msgr2=0x7f4c54037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:09.177+0000 7f4c7711b700 1 --2- 172.21.15.92:0/757880832 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4c54035630 0x7f4c54037ae0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009860 tx=0x7f4c60016000 comp rx=0 tx=0).stop 2023-09-29T23:25:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:09.177+0000 7f4c7711b700 1 -- 172.21.15.92:0/757880832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7006b0c0 msgr2=0x7f4c7011df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:09.177+0000 7f4c7711b700 1 --2- 172.21.15.92:0/757880832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7006b0c0 0x7f4c7011df70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00cb70 tx=0x7f4c6c001a30 comp rx=0 tx=0).stop 2023-09-29T23:25:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:09.177+0000 7f4c7711b700 1 -- 172.21.15.92:0/757880832 shutdown_connections 2023-09-29T23:25:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:09.177+0000 7f4c7711b700 1 --2- 172.21.15.92:0/757880832 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4c54035630 0x7f4c54037ae0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:09.178 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:09.177+0000 7f4c7711b700 1 --2- 172.21.15.92:0/757880832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7006b0c0 0x7f4c7011df70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:09.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:09.177+0000 7f4c7711b700 1 -- 172.21.15.92:0/757880832 >> 172.21.15.92:0/757880832 conn(0x7f4c7006a5b0 msgr2=0x7f4c7012de20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:09.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:09.178+0000 7f4c7711b700 1 -- 172.21.15.92:0/757880832 shutdown_connections 2023-09-29T23:25:09.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:09.178+0000 7f4c7711b700 1 -- 172.21.15.92:0/757880832 wait complete. 2023-09-29T23:25:12.189 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:25:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.311+0000 7f72b5c89700 1 Processor -- start 2023-09-29T23:25:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.311+0000 7f72b5c89700 1 -- start start 2023-09-29T23:25:12.316 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.311+0000 7f72b5c89700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f72b006b0c0 0x7f72b012f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.311+0000 7f72b5c89700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b009ca80 con 0x7f72b012fb70 2023-09-29T23:25:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.311+0000 7f72b5c89700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b006b490 con 0x7f72b006b0c0 2023-09-29T23:25:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.312+0000 7f72b4c87700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f72b006b0c0 0x7f72b012f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.312+0000 7f72affff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f72b012fb70 0x7f72b0099530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54668/0 (socket says 172.21.15.92:54668) 2023-09-29T23:25:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.312+0000 7f72affff700 1 -- 172.21.15.92:0/4182542282 learned_addr learned my addr 172.21.15.92:0/4182542282 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:25:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.312+0000 7f72b4c87700 1 -- 172.21.15.92:0/4182542282 >> v1:172.21.15.92:6789/0 conn(0x7f72b012fb70 legacy=0x7f72b0099530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.312+0000 7f72b4c87700 1 -- 172.21.15.92:0/4182542282 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b009be20 con 0x7f72b006b0c0 2023-09-29T23:25:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.312+0000 7f72af7fe700 1 -- 172.21.15.92:0/4182542282 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946540453 0 0) 0x7f729c001110 con 0x7f72b012fb70 2023-09-29T23:25:12.317 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.312+0000 7f72b4c87700 1 --2- 172.21.15.92:0/4182542282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72b006b0c0 0x7f72b012f630 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009860 tx=0x7f72a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f87a410c654f2c server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:12.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.312+0000 7f72af7fe700 1 -- 172.21.15.92:0/4182542282 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72a400b680 con 0x7f72b006b0c0 2023-09-29T23:25:12.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.312+0000 7f72af7fe700 1 -- 172.21.15.92:0/4182542282 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a400b7e0 con 0x7f72b006b0c0 2023-09-29T23:25:12.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.312+0000 7f72af7fe700 1 -- 172.21.15.92:0/4182542282 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72a400bad0 con 0x7f72b006b0c0 2023-09-29T23:25:12.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.313+0000 7f72b5c89700 1 -- 172.21.15.92:0/4182542282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72b006b0c0 msgr2=0x7f72b012f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:12.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.313+0000 7f72b5c89700 1 --2- 172.21.15.92:0/4182542282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72b006b0c0 0x7f72b012f630 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009860 tx=0x7f72a40091a0 comp rx=0 tx=0).stop 2023-09-29T23:25:12.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.313+0000 7f72b5c89700 1 -- 172.21.15.92:0/4182542282 shutdown_connections 2023-09-29T23:25:12.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.313+0000 7f72b5c89700 1 --2- 172.21.15.92:0/4182542282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72b006b0c0 0x7f72b012f630 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:12.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.313+0000 7f72b5c89700 1 -- 172.21.15.92:0/4182542282 >> 172.21.15.92:0/4182542282 conn(0x7f72b006a5b0 msgr2=0x7f72b006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:12.318 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.313+0000 7f72b5c89700 1 -- 172.21.15.92:0/4182542282 shutdown_connections 2023-09-29T23:25:12.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.313+0000 7f72b5c89700 1 -- 172.21.15.92:0/4182542282 wait complete. 2023-09-29T23:25:12.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.314+0000 7f72b5c89700 1 Processor -- start 2023-09-29T23:25:12.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.314+0000 7f72b5c89700 1 -- start start 2023-09-29T23:25:12.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.314+0000 7f72b5c89700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72b006b0c0 0x7f72b011df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:12.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.314+0000 7f72b5c89700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b011d7f0 con 0x7f72b006b0c0 2023-09-29T23:25:12.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.314+0000 7f72b4c87700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72b006b0c0 0x7f72b011df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:12.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.314+0000 7f72b4c87700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72b006b0c0 0x7f72b011df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35698/0 (socket says 172.21.15.92:35698) 2023-09-29T23:25:12.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.314+0000 7f72b4c87700 1 -- 172.21.15.92:0/894328646 learned_addr learned my addr 172.21.15.92:0/894328646 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:25:12.319 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.315+0000 7f72b4c87700 1 -- 172.21.15.92:0/894328646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a4009420 con 0x7f72b006b0c0 2023-09-29T23:25:12.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.315+0000 7f72b4c87700 1 --2- 172.21.15.92:0/894328646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72b006b0c0 0x7f72b011df40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f72a40091e0 tx=0x7f72a4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:12.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.315+0000 7f72acff9700 1 -- 172.21.15.92:0/894328646 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72a4011cf0 con 0x7f72b006b0c0 2023-09-29T23:25:12.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.315+0000 7f72acff9700 1 -- 172.21.15.92:0/894328646 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a4020070 con 0x7f72b006b0c0 2023-09-29T23:25:12.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.315+0000 7f72b5c89700 1 -- 172.21.15.92:0/894328646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b011bec0 con 0x7f72b006b0c0 2023-09-29T23:25:12.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.315+0000 7f72acff9700 1 -- 172.21.15.92:0/894328646 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72a401b450 con 0x7f72b006b0c0 2023-09-29T23:25:12.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.315+0000 7f72b5c89700 1 -- 172.21.15.92:0/894328646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b012ce90 con 0x7f72b006b0c0 2023-09-29T23:25:12.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.316+0000 7f72acff9700 1 -- 172.21.15.92:0/894328646 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f72a4022030 con 0x7f72b006b0c0 2023-09-29T23:25:12.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.316+0000 7f72acff9700 1 --2- 172.21.15.92:0/894328646 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7294035630 0x7f7294037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:12.320 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.316+0000 7f72b5c89700 1 -- 172.21.15.92:0/894328646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b005f230 con 0x7f72b006b0c0 2023-09-29T23:25:12.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.316+0000 7f72acff9700 1 -- 172.21.15.92:0/894328646 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f72a40493b0 con 0x7f72b006b0c0 2023-09-29T23:25:12.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.316+0000 7f72affff700 1 --2- 172.21.15.92:0/894328646 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7294035630 0x7f7294037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:12.321 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.316+0000 7f72affff700 1 --2- 172.21.15.92:0/894328646 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7294035630 0x7f7294037ae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f729c007fd0 tx=0x7f729c001250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:12.322 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.321+0000 7f72acff9700 1 -- 172.21.15.92:0/894328646 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72a401b680 con 0x7f72b006b0c0 2023-09-29T23:25:12.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.543+0000 7f72b5c89700 1 -- 172.21.15.92:0/894328646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f72b012f320 con 0x7f72b006b0c0 2023-09-29T23:25:12.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.543+0000 7f72acff9700 1 -- 172.21.15.92:0/894328646 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f72a40193f0 con 0x7f72b006b0c0 2023-09-29T23:25:12.544 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:25:12.544 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:25:12.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.545+0000 7f72b5c89700 1 -- 172.21.15.92:0/894328646 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7294035630 msgr2=0x7f7294037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:12.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.545+0000 7f72b5c89700 1 --2- 172.21.15.92:0/894328646 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7294035630 0x7f7294037ae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f729c007fd0 tx=0x7f729c001250 comp rx=0 tx=0).stop 2023-09-29T23:25:12.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.545+0000 7f72b5c89700 1 -- 172.21.15.92:0/894328646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72b006b0c0 msgr2=0x7f72b011df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:12.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.545+0000 7f72b5c89700 1 --2- 172.21.15.92:0/894328646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72b006b0c0 0x7f72b011df40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f72a40091e0 tx=0x7f72a4016000 comp rx=0 tx=0).stop 2023-09-29T23:25:12.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.545+0000 7f72b5c89700 1 -- 172.21.15.92:0/894328646 shutdown_connections 2023-09-29T23:25:12.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.545+0000 7f72b5c89700 1 --2- 172.21.15.92:0/894328646 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7294035630 0x7f7294037ae0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:12.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.545+0000 7f72b5c89700 1 --2- 172.21.15.92:0/894328646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72b006b0c0 0x7f72b011df40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:12.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.545+0000 7f72b5c89700 1 -- 172.21.15.92:0/894328646 >> 172.21.15.92:0/894328646 conn(0x7f72b006a5b0 msgr2=0x7f72b012dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:12.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.545+0000 7f72b5c89700 1 -- 172.21.15.92:0/894328646 shutdown_connections 2023-09-29T23:25:12.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:12.545+0000 7f72b5c89700 1 -- 172.21.15.92:0/894328646 wait complete. 2023-09-29T23:25:15.558 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:25:15.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.679+0000 7fa782106700 1 Processor -- start 2023-09-29T23:25:15.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.679+0000 7fa782106700 1 -- start start 2023-09-29T23:25:15.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.680+0000 7fa782106700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa77c12ffc0 0x7fa77c0a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:15.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.680+0000 7fa782106700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77c098710 con 0x7fa77c09fd80 2023-09-29T23:25:15.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.680+0000 7fa782106700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77c12f340 con 0x7fa77c12ffc0 2023-09-29T23:25:15.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.680+0000 7fa77affd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa77c12ffc0 0x7fa77c0a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:15.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.680+0000 7fa77b7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fa77c09fd80 0x7fa77c12f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54672/0 (socket says 172.21.15.92:54672) 2023-09-29T23:25:15.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.680+0000 7fa77affd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa77c12ffc0 0x7fa77c0a3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35708/0 (socket says 172.21.15.92:35708) 2023-09-29T23:25:15.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.680+0000 7fa77b7fe700 1 -- 172.21.15.92:0/876021954 learned_addr learned my addr 172.21.15.92:0/876021954 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:25:15.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.680+0000 7fa77affd700 1 -- 172.21.15.92:0/876021954 >> v1:172.21.15.92:6789/0 conn(0x7fa77c09fd80 legacy=0x7fa77c12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:15.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.680+0000 7fa77affd700 1 -- 172.21.15.92:0/876021954 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c0997e0 con 0x7fa77c12ffc0 2023-09-29T23:25:15.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.680+0000 7fa77affd700 1 --2- 172.21.15.92:0/876021954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa77c12ffc0 0x7fa77c0a3090 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa770009860 tx=0x7fa7700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10408c963a99b7ae server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:15.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.680+0000 7fa77a7fc700 1 -- 172.21.15.92:0/876021954 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa77000b680 con 0x7fa77c12ffc0 2023-09-29T23:25:15.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.680+0000 7fa77a7fc700 1 -- 172.21.15.92:0/876021954 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77000b7e0 con 0x7fa77c12ffc0 2023-09-29T23:25:15.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.680+0000 7fa77a7fc700 1 -- 172.21.15.92:0/876021954 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa77000b990 con 0x7fa77c12ffc0 2023-09-29T23:25:15.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.681+0000 7fa782106700 1 -- 172.21.15.92:0/876021954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa77c12ffc0 msgr2=0x7fa77c0a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:15.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.681+0000 7fa782106700 1 --2- 172.21.15.92:0/876021954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa77c12ffc0 0x7fa77c0a3090 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa770009860 tx=0x7fa7700091a0 comp rx=0 tx=0).stop 2023-09-29T23:25:15.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.681+0000 7fa782106700 1 -- 172.21.15.92:0/876021954 shutdown_connections 2023-09-29T23:25:15.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.681+0000 7fa782106700 1 --2- 172.21.15.92:0/876021954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa77c12ffc0 0x7fa77c0a3090 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:15.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.681+0000 7fa782106700 1 -- 172.21.15.92:0/876021954 >> 172.21.15.92:0/876021954 conn(0x7fa77c068000 msgr2=0x7fa77c0a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:15.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.681+0000 7fa782106700 1 -- 172.21.15.92:0/876021954 shutdown_connections 2023-09-29T23:25:15.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.681+0000 7fa782106700 1 -- 172.21.15.92:0/876021954 wait complete. 2023-09-29T23:25:15.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.682+0000 7fa782106700 1 Processor -- start 2023-09-29T23:25:15.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.682+0000 7fa782106700 1 -- start start 2023-09-29T23:25:15.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.682+0000 7fa782106700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa77c09fd80 0x7fa77c11def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.682+0000 7fa782106700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c11cb30 con 0x7fa77c09fd80 2023-09-29T23:25:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.682+0000 7fa77b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa77c09fd80 0x7fa77c11def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.682+0000 7fa77b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa77c09fd80 0x7fa77c11def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35722/0 (socket says 172.21.15.92:35722) 2023-09-29T23:25:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.682+0000 7fa77b7fe700 1 -- 172.21.15.92:0/37190152 learned_addr learned my addr 172.21.15.92:0/37190152 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:25:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.683+0000 7fa77b7fe700 1 -- 172.21.15.92:0/37190152 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa770009420 con 0x7fa77c09fd80 2023-09-29T23:25:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.683+0000 7fa77b7fe700 1 --2- 172.21.15.92:0/37190152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa77c09fd80 0x7fa77c11def0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00cb70 tx=0x7fa76c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:15.687 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.683+0000 7fa7637fe700 1 -- 172.21.15.92:0/37190152 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa76c00a910 con 0x7fa77c09fd80 2023-09-29T23:25:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.683+0000 7fa7637fe700 1 -- 172.21.15.92:0/37190152 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76c00aa70 con 0x7fa77c09fd80 2023-09-29T23:25:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.683+0000 7fa782106700 1 -- 172.21.15.92:0/37190152 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77c11da60 con 0x7fa77c09fd80 2023-09-29T23:25:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.683+0000 7fa7637fe700 1 -- 172.21.15.92:0/37190152 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa76c00ad20 con 0x7fa77c09fd80 2023-09-29T23:25:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.683+0000 7fa782106700 1 -- 172.21.15.92:0/37190152 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77c11a750 con 0x7fa77c09fd80 2023-09-29T23:25:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.684+0000 7fa7637fe700 1 -- 172.21.15.92:0/37190152 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fa76c0070f0 con 0x7fa77c09fd80 2023-09-29T23:25:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.684+0000 7fa782106700 1 -- 172.21.15.92:0/37190152 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77c0a30e0 con 0x7fa77c09fd80 2023-09-29T23:25:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.684+0000 7fa7637fe700 1 --2- 172.21.15.92:0/37190152 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa768035630 0x7fa768037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:15.688 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.684+0000 7fa7637fe700 1 -- 172.21.15.92:0/37190152 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fa76c0478b0 con 0x7fa77c09fd80 2023-09-29T23:25:15.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.684+0000 7fa77affd700 1 --2- 172.21.15.92:0/37190152 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa768035630 0x7fa768037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:15.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.684+0000 7fa77affd700 1 --2- 172.21.15.92:0/37190152 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa768035630 0x7fa768037ae0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa770009860 tx=0x7fa770016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:15.689 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.689+0000 7fa7637fe700 1 -- 172.21.15.92:0/37190152 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa76c0073a0 con 0x7fa77c09fd80 2023-09-29T23:25:15.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.912+0000 7fa782106700 1 -- 172.21.15.92:0/37190152 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa77c0a1ba0 con 0x7fa77c09fd80 2023-09-29T23:25:15.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.912+0000 7fa7637fe700 1 -- 172.21.15.92:0/37190152 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fa76c0113a0 con 0x7fa77c09fd80 2023-09-29T23:25:15.913 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:25:15.913 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:25:15.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.915+0000 7fa782106700 1 -- 172.21.15.92:0/37190152 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa768035630 msgr2=0x7fa768037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:15.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.915+0000 7fa782106700 1 --2- 172.21.15.92:0/37190152 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa768035630 0x7fa768037ae0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa770009860 tx=0x7fa770016000 comp rx=0 tx=0).stop 2023-09-29T23:25:15.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.915+0000 7fa782106700 1 -- 172.21.15.92:0/37190152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa77c09fd80 msgr2=0x7fa77c11def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:15.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.915+0000 7fa782106700 1 --2- 172.21.15.92:0/37190152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa77c09fd80 0x7fa77c11def0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00cb70 tx=0x7fa76c001a30 comp rx=0 tx=0).stop 2023-09-29T23:25:15.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.915+0000 7fa782106700 1 -- 172.21.15.92:0/37190152 shutdown_connections 2023-09-29T23:25:15.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.915+0000 7fa782106700 1 --2- 172.21.15.92:0/37190152 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa768035630 0x7fa768037ae0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:15.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.915+0000 7fa782106700 1 --2- 172.21.15.92:0/37190152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa77c09fd80 0x7fa77c11def0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:15.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.915+0000 7fa782106700 1 -- 172.21.15.92:0/37190152 >> 172.21.15.92:0/37190152 conn(0x7fa77c068000 msgr2=0x7fa77c12def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:15.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.915+0000 7fa782106700 1 -- 172.21.15.92:0/37190152 shutdown_connections 2023-09-29T23:25:15.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:15.915+0000 7fa782106700 1 -- 172.21.15.92:0/37190152 wait complete. 2023-09-29T23:25:18.927 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:25:19.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.048+0000 7f90b4a90700 1 Processor -- start 2023-09-29T23:25:19.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.048+0000 7f90b4a90700 1 -- start start 2023-09-29T23:25:19.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.049+0000 7f90b4a90700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f90b012ffc0 0x7f90b00a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:19.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.049+0000 7f90b4a90700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b0098710 con 0x7f90b009fd80 2023-09-29T23:25:19.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.049+0000 7f90b4a90700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b012f340 con 0x7f90b012ffc0 2023-09-29T23:25:19.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.049+0000 7f90add9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f90b012ffc0 0x7f90b00a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:19.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.049+0000 7f90ae59c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f90b009fd80 0x7f90b012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54688/0 (socket says 172.21.15.92:54688) 2023-09-29T23:25:19.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.049+0000 7f90ae59c700 1 -- 172.21.15.92:0/252115819 learned_addr learned my addr 172.21.15.92:0/252115819 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:25:19.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.049+0000 7f90add9b700 1 -- 172.21.15.92:0/252115819 >> v1:172.21.15.92:6789/0 conn(0x7f90b009fd80 legacy=0x7f90b012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:19.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.049+0000 7f90add9b700 1 -- 172.21.15.92:0/252115819 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b00997e0 con 0x7f90b012ffc0 2023-09-29T23:25:19.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.050+0000 7f90add9b700 1 --2- 172.21.15.92:0/252115819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90b012ffc0 0x7f90b00a3090 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009860 tx=0x7f90a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d319aa8b27b3d634 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:19.051 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.050+0000 7f90ad59a700 1 -- 172.21.15.92:0/252115819 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90a400b680 con 0x7f90b012ffc0 2023-09-29T23:25:19.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.050+0000 7f90ad59a700 1 -- 172.21.15.92:0/252115819 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a400b7e0 con 0x7f90b012ffc0 2023-09-29T23:25:19.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.050+0000 7f90ad59a700 1 -- 172.21.15.92:0/252115819 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90a400b990 con 0x7f90b012ffc0 2023-09-29T23:25:19.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.050+0000 7f90b4a90700 1 -- 172.21.15.92:0/252115819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90b012ffc0 msgr2=0x7f90b00a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:19.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.050+0000 7f90b4a90700 1 --2- 172.21.15.92:0/252115819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90b012ffc0 0x7f90b00a3090 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009860 tx=0x7f90a40091a0 comp rx=0 tx=0).stop 2023-09-29T23:25:19.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.050+0000 7f90b4a90700 1 -- 172.21.15.92:0/252115819 shutdown_connections 2023-09-29T23:25:19.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.050+0000 7f90b4a90700 1 --2- 172.21.15.92:0/252115819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90b012ffc0 0x7f90b00a3090 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:19.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.050+0000 7f90b4a90700 1 -- 172.21.15.92:0/252115819 >> 172.21.15.92:0/252115819 conn(0x7f90b0068000 msgr2=0x7f90b00a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:19.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.050+0000 7f90b4a90700 1 -- 172.21.15.92:0/252115819 shutdown_connections 2023-09-29T23:25:19.052 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.050+0000 7f90b4a90700 1 -- 172.21.15.92:0/252115819 wait complete. 2023-09-29T23:25:19.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.051+0000 7f90b4a90700 1 Processor -- start 2023-09-29T23:25:19.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.051+0000 7f90b4a90700 1 -- start start 2023-09-29T23:25:19.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.051+0000 7f90b4a90700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90b009fd80 0x7f90b011def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:19.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.051+0000 7f90b4a90700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b011cb30 con 0x7f90b009fd80 2023-09-29T23:25:19.054 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.052+0000 7f90ae59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90b009fd80 0x7f90b011def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:19.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.052+0000 7f90ae59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90b009fd80 0x7f90b011def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35746/0 (socket says 172.21.15.92:35746) 2023-09-29T23:25:19.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.052+0000 7f90ae59c700 1 -- 172.21.15.92:0/2576836633 learned_addr learned my addr 172.21.15.92:0/2576836633 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:25:19.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.052+0000 7f90ae59c700 1 -- 172.21.15.92:0/2576836633 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a4009420 con 0x7f90b009fd80 2023-09-29T23:25:19.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.052+0000 7f90ae59c700 1 --2- 172.21.15.92:0/2576836633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90b009fd80 0x7f90b011def0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f90a000cb70 tx=0x7f90a0001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:19.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.052+0000 7f909e7fc700 1 -- 172.21.15.92:0/2576836633 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90a000a910 con 0x7f90b009fd80 2023-09-29T23:25:19.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.052+0000 7f909e7fc700 1 -- 172.21.15.92:0/2576836633 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a000aa70 con 0x7f90b009fd80 2023-09-29T23:25:19.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.052+0000 7f909e7fc700 1 -- 172.21.15.92:0/2576836633 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90a000ad20 con 0x7f90b009fd80 2023-09-29T23:25:19.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.052+0000 7f90b4a90700 1 -- 172.21.15.92:0/2576836633 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b011da60 con 0x7f90b009fd80 2023-09-29T23:25:19.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.052+0000 7f90b4a90700 1 -- 172.21.15.92:0/2576836633 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b011a750 con 0x7f90b009fd80 2023-09-29T23:25:19.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.053+0000 7f909e7fc700 1 -- 172.21.15.92:0/2576836633 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f90a00070f0 con 0x7f90b009fd80 2023-09-29T23:25:19.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.053+0000 7f90b4a90700 1 -- 172.21.15.92:0/2576836633 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b00a30e0 con 0x7f90b009fd80 2023-09-29T23:25:19.055 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.053+0000 7f909e7fc700 1 --2- 172.21.15.92:0/2576836633 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9090035630 0x7f9090037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:19.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.053+0000 7f909e7fc700 1 -- 172.21.15.92:0/2576836633 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f90a0047890 con 0x7f90b009fd80 2023-09-29T23:25:19.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.053+0000 7f90add9b700 1 --2- 172.21.15.92:0/2576836633 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9090035630 0x7f9090037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:19.056 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.053+0000 7f90add9b700 1 --2- 172.21.15.92:0/2576836633 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9090035630 0x7f9090037ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009860 tx=0x7f90a4016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:19.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.058+0000 7f909e7fc700 1 -- 172.21.15.92:0/2576836633 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90a00073a0 con 0x7f90b009fd80 2023-09-29T23:25:19.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.278+0000 7f90b4a90700 1 -- 172.21.15.92:0/2576836633 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f90b00a1ba0 con 0x7f90b009fd80 2023-09-29T23:25:19.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.278+0000 7f909e7fc700 1 -- 172.21.15.92:0/2576836633 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f90a00113a0 con 0x7f90b009fd80 2023-09-29T23:25:19.279 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:25:19.279 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:25:19.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.280+0000 7f90b4a90700 1 -- 172.21.15.92:0/2576836633 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9090035630 msgr2=0x7f9090037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:19.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.280+0000 7f90b4a90700 1 --2- 172.21.15.92:0/2576836633 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9090035630 0x7f9090037ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009860 tx=0x7f90a4016000 comp rx=0 tx=0).stop 2023-09-29T23:25:19.281 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.281+0000 7f90b4a90700 1 -- 172.21.15.92:0/2576836633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90b009fd80 msgr2=0x7f90b011def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:19.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.281+0000 7f90b4a90700 1 --2- 172.21.15.92:0/2576836633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90b009fd80 0x7f90b011def0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f90a000cb70 tx=0x7f90a0001a30 comp rx=0 tx=0).stop 2023-09-29T23:25:19.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.281+0000 7f90b4a90700 1 -- 172.21.15.92:0/2576836633 shutdown_connections 2023-09-29T23:25:19.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.281+0000 7f90b4a90700 1 --2- 172.21.15.92:0/2576836633 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9090035630 0x7f9090037ae0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:19.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.281+0000 7f90b4a90700 1 --2- 172.21.15.92:0/2576836633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90b009fd80 0x7f90b011def0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:19.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.281+0000 7f90b4a90700 1 -- 172.21.15.92:0/2576836633 >> 172.21.15.92:0/2576836633 conn(0x7f90b0068000 msgr2=0x7f90b012def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:19.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.281+0000 7f90b4a90700 1 -- 172.21.15.92:0/2576836633 shutdown_connections 2023-09-29T23:25:19.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:19.281+0000 7f90b4a90700 1 -- 172.21.15.92:0/2576836633 wait complete. 2023-09-29T23:25:22.293 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:25:22.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.413+0000 7f5a97207700 1 Processor -- start 2023-09-29T23:25:22.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.413+0000 7f5a97207700 1 -- start start 2023-09-29T23:25:22.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.413+0000 7f5a97207700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5a9009a400 0x7f5a90134440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:22.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.413+0000 7f5a97207700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9009c010 con 0x7f5a9009c4e0 2023-09-29T23:25:22.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.413+0000 7f5a97207700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9009c8b0 con 0x7f5a9009a400 2023-09-29T23:25:22.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.414+0000 7f5a96205700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f5a9009c4e0 0x7f5a90099cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:36430/0 (socket says 172.21.15.92:36430) 2023-09-29T23:25:22.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.414+0000 7f5a96205700 1 -- 172.21.15.92:0/236918356 learned_addr learned my addr 172.21.15.92:0/236918356 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:25:22.415 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.414+0000 7f5a95a04700 1 --2- 172.21.15.92:0/236918356 >> v2:172.21.15.92:3300/0 conn(0x7f5a9009a400 0x7f5a90134440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:22.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.414+0000 7f5a95203700 1 -- 172.21.15.92:0/236918356 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253192713 0 0) 0x7f5a9009c010 con 0x7f5a9009c4e0 2023-09-29T23:25:22.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.414+0000 7f5a95203700 1 -- 172.21.15.92:0/236918356 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a7c003570 con 0x7f5a9009c4e0 2023-09-29T23:25:22.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.414+0000 7f5a95a04700 1 -- 172.21.15.92:0/236918356 >> v1:172.21.15.92:6789/0 conn(0x7f5a9009c4e0 legacy=0x7f5a90099cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:22.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.414+0000 7f5a95a04700 1 -- 172.21.15.92:0/236918356 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9009cc10 con 0x7f5a9009a400 2023-09-29T23:25:22.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.414+0000 7f5a95a04700 1 --2- 172.21.15.92:0/236918356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a9009a400 0x7f5a90134440 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009860 tx=0x7f5a800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f4c96b6fd70575 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:22.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.414+0000 7f5a95203700 1 -- 172.21.15.92:0/236918356 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a80011630 con 0x7f5a9009a400 2023-09-29T23:25:22.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.414+0000 7f5a95203700 1 -- 172.21.15.92:0/236918356 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a80011790 con 0x7f5a9009a400 2023-09-29T23:25:22.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.414+0000 7f5a95203700 1 -- 172.21.15.92:0/236918356 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a80011a60 con 0x7f5a9009a400 2023-09-29T23:25:22.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.415+0000 7f5a97207700 1 -- 172.21.15.92:0/236918356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a9009a400 msgr2=0x7f5a90134440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:22.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.415+0000 7f5a97207700 1 --2- 172.21.15.92:0/236918356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a9009a400 0x7f5a90134440 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009860 tx=0x7f5a800091a0 comp rx=0 tx=0).stop 2023-09-29T23:25:22.416 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.415+0000 7f5a97207700 1 -- 172.21.15.92:0/236918356 shutdown_connections 2023-09-29T23:25:22.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.415+0000 7f5a97207700 1 --2- 172.21.15.92:0/236918356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a9009a400 0x7f5a90134440 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:22.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.415+0000 7f5a97207700 1 -- 172.21.15.92:0/236918356 >> 172.21.15.92:0/236918356 conn(0x7f5a900680f0 msgr2=0x7f5a900684f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:22.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.415+0000 7f5a97207700 1 -- 172.21.15.92:0/236918356 shutdown_connections 2023-09-29T23:25:22.417 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.415+0000 7f5a97207700 1 -- 172.21.15.92:0/236918356 wait complete. 2023-09-29T23:25:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.416+0000 7f5a97207700 1 Processor -- start 2023-09-29T23:25:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.416+0000 7f5a97207700 1 -- start start 2023-09-29T23:25:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.416+0000 7f5a97207700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a9009a400 0x7f5a9011de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.416+0000 7f5a97207700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9011e570 con 0x7f5a9009a400 2023-09-29T23:25:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.416+0000 7f5a96205700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a9009a400 0x7f5a9011de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.416+0000 7f5a96205700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a9009a400 0x7f5a9011de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43524/0 (socket says 172.21.15.92:43524) 2023-09-29T23:25:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.416+0000 7f5a96205700 1 -- 172.21.15.92:0/2974732473 learned_addr learned my addr 172.21.15.92:0/2974732473 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:25:22.419 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.416+0000 7f5a96205700 1 -- 172.21.15.92:0/2974732473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a80009420 con 0x7f5a9009a400 2023-09-29T23:25:22.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.416+0000 7f5a96205700 1 --2- 172.21.15.92:0/2974732473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a9009a400 0x7f5a9011de90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800cc30 tx=0x7f5a88001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:22.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.417+0000 7f5a867fc700 1 -- 172.21.15.92:0/2974732473 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a8800ab00 con 0x7f5a9009a400 2023-09-29T23:25:22.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.417+0000 7f5a867fc700 1 -- 172.21.15.92:0/2974732473 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8800ac80 con 0x7f5a9009a400 2023-09-29T23:25:22.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.417+0000 7f5a97207700 1 -- 172.21.15.92:0/2974732473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9011c840 con 0x7f5a9009a400 2023-09-29T23:25:22.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.417+0000 7f5a867fc700 1 -- 172.21.15.92:0/2974732473 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a880070f0 con 0x7f5a9009a400 2023-09-29T23:25:22.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.417+0000 7f5a97207700 1 -- 172.21.15.92:0/2974732473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9012ce50 con 0x7f5a9009a400 2023-09-29T23:25:22.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.417+0000 7f5a867fc700 1 -- 172.21.15.92:0/2974732473 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f5a88007360 con 0x7f5a9009a400 2023-09-29T23:25:22.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.417+0000 7f5a867fc700 1 --2- 172.21.15.92:0/2974732473 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5a74035640 0x7f5a74037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:22.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.418+0000 7f5a867fc700 1 -- 172.21.15.92:0/2974732473 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f5a88047aa0 con 0x7f5a9009a400 2023-09-29T23:25:22.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.418+0000 7f5a95a04700 1 --2- 172.21.15.92:0/2974732473 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5a74035640 0x7f5a74037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:22.420 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.418+0000 7f5a97207700 1 -- 172.21.15.92:0/2974732473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9011e6c0 con 0x7f5a9009a400 2023-09-29T23:25:22.421 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.418+0000 7f5a95a04700 1 --2- 172.21.15.92:0/2974732473 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5a74035640 0x7f5a74037af0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a800091e0 tx=0x7f5a80016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:22.422 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.422+0000 7f5a867fc700 1 -- 172.21.15.92:0/2974732473 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a88007610 con 0x7f5a9009a400 2023-09-29T23:25:22.647 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.647+0000 7f5a97207700 1 -- 172.21.15.92:0/2974732473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5a9005f230 con 0x7f5a9009a400 2023-09-29T23:25:22.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.647+0000 7f5a867fc700 1 -- 172.21.15.92:0/2974732473 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f5a88010300 con 0x7f5a9009a400 2023-09-29T23:25:22.648 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:25:22.648 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:25:22.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.649+0000 7f5a97207700 1 -- 172.21.15.92:0/2974732473 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5a74035640 msgr2=0x7f5a74037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:22.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.649+0000 7f5a97207700 1 --2- 172.21.15.92:0/2974732473 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5a74035640 0x7f5a74037af0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a800091e0 tx=0x7f5a80016000 comp rx=0 tx=0).stop 2023-09-29T23:25:22.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.649+0000 7f5a97207700 1 -- 172.21.15.92:0/2974732473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a9009a400 msgr2=0x7f5a9011de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:22.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.649+0000 7f5a97207700 1 --2- 172.21.15.92:0/2974732473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a9009a400 0x7f5a9011de90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800cc30 tx=0x7f5a88001b10 comp rx=0 tx=0).stop 2023-09-29T23:25:22.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.649+0000 7f5a97207700 1 -- 172.21.15.92:0/2974732473 shutdown_connections 2023-09-29T23:25:22.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.649+0000 7f5a97207700 1 --2- 172.21.15.92:0/2974732473 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5a74035640 0x7f5a74037af0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:22.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.649+0000 7f5a97207700 1 --2- 172.21.15.92:0/2974732473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a9009a400 0x7f5a9011de90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:22.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.649+0000 7f5a97207700 1 -- 172.21.15.92:0/2974732473 >> 172.21.15.92:0/2974732473 conn(0x7f5a900680f0 msgr2=0x7f5a90095900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:22.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.649+0000 7f5a97207700 1 -- 172.21.15.92:0/2974732473 shutdown_connections 2023-09-29T23:25:22.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:22.649+0000 7f5a97207700 1 -- 172.21.15.92:0/2974732473 wait complete. 2023-09-29T23:25:25.662 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:25:25.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.782+0000 7ff23677c700 1 Processor -- start 2023-09-29T23:25:25.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.782+0000 7ff23677c700 1 -- start start 2023-09-29T23:25:25.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.783+0000 7ff23677c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff230095de0 0x7ff230132650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:25.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.783+0000 7ff23677c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff230099540 con 0x7ff230095300 2023-09-29T23:25:25.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.783+0000 7ff23677c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2300961d0 con 0x7ff230095de0 2023-09-29T23:25:25.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.783+0000 7ff22f7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff230095de0 0x7ff230132650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:25.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.783+0000 7ff22ffff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ff230095300 0x7ff2300956d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:36444/0 (socket says 172.21.15.92:36444) 2023-09-29T23:25:25.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.783+0000 7ff22ffff700 1 -- 172.21.15.92:0/1333656191 learned_addr learned my addr 172.21.15.92:0/1333656191 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:25:25.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.783+0000 7ff22f7fe700 1 -- 172.21.15.92:0/1333656191 >> v1:172.21.15.92:6789/0 conn(0x7ff230095300 legacy=0x7ff2300956d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:25.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.783+0000 7ff22f7fe700 1 -- 172.21.15.92:0/1333656191 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23006a190 con 0x7ff230095de0 2023-09-29T23:25:25.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.783+0000 7ff22f7fe700 1 --2- 172.21.15.92:0/1333656191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff230095de0 0x7ff230132650 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff224009860 tx=0x7ff2240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447468ab5b370f3e server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:25.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.783+0000 7ff22effd700 1 -- 172.21.15.92:0/1333656191 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff22400b680 con 0x7ff230095de0 2023-09-29T23:25:25.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.784+0000 7ff22effd700 1 -- 172.21.15.92:0/1333656191 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22400b7e0 con 0x7ff230095de0 2023-09-29T23:25:25.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.784+0000 7ff22effd700 1 -- 172.21.15.92:0/1333656191 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff22400b990 con 0x7ff230095de0 2023-09-29T23:25:25.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.784+0000 7ff23677c700 1 -- 172.21.15.92:0/1333656191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff230095de0 msgr2=0x7ff230132650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:25.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.784+0000 7ff23677c700 1 --2- 172.21.15.92:0/1333656191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff230095de0 0x7ff230132650 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff224009860 tx=0x7ff2240091a0 comp rx=0 tx=0).stop 2023-09-29T23:25:25.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.784+0000 7ff23677c700 1 -- 172.21.15.92:0/1333656191 shutdown_connections 2023-09-29T23:25:25.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.784+0000 7ff23677c700 1 --2- 172.21.15.92:0/1333656191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff230095de0 0x7ff230132650 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:25.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.784+0000 7ff23677c700 1 -- 172.21.15.92:0/1333656191 >> 172.21.15.92:0/1333656191 conn(0x7ff23006bd70 msgr2=0x7ff23006e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:25.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.784+0000 7ff23677c700 1 -- 172.21.15.92:0/1333656191 shutdown_connections 2023-09-29T23:25:25.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.784+0000 7ff23677c700 1 -- 172.21.15.92:0/1333656191 wait complete. 2023-09-29T23:25:25.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.785+0000 7ff23677c700 1 Processor -- start 2023-09-29T23:25:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.785+0000 7ff23677c700 1 -- start start 2023-09-29T23:25:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.785+0000 7ff23677c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff230095300 0x7ff23008bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.785+0000 7ff23677c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23008f1f0 con 0x7ff230095300 2023-09-29T23:25:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.785+0000 7ff22ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff230095300 0x7ff23008bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.786+0000 7ff22ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff230095300 0x7ff23008bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43544/0 (socket says 172.21.15.92:43544) 2023-09-29T23:25:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.786+0000 7ff22ffff700 1 -- 172.21.15.92:0/2929863141 learned_addr learned my addr 172.21.15.92:0/2929863141 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:25:25.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.786+0000 7ff22ffff700 1 -- 172.21.15.92:0/2929863141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff224009420 con 0x7ff230095300 2023-09-29T23:25:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.786+0000 7ff22ffff700 1 --2- 172.21.15.92:0/2929863141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff230095300 0x7ff23008bee0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff22000c6c0 tx=0x7ff220007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.786+0000 7ff217fff700 1 -- 172.21.15.92:0/2929863141 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff220007540 con 0x7ff230095300 2023-09-29T23:25:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.786+0000 7ff217fff700 1 -- 172.21.15.92:0/2929863141 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2200057f0 con 0x7ff230095300 2023-09-29T23:25:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.786+0000 7ff217fff700 1 -- 172.21.15.92:0/2929863141 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff220005ae0 con 0x7ff230095300 2023-09-29T23:25:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.786+0000 7ff23677c700 1 -- 172.21.15.92:0/2929863141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23008ef50 con 0x7ff230095300 2023-09-29T23:25:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.786+0000 7ff23677c700 1 -- 172.21.15.92:0/2929863141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23008f770 con 0x7ff230095300 2023-09-29T23:25:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.787+0000 7ff217fff700 1 -- 172.21.15.92:0/2929863141 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7ff220005c40 con 0x7ff230095300 2023-09-29T23:25:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.787+0000 7ff23677c700 1 -- 172.21.15.92:0/2929863141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23008d370 con 0x7ff230095300 2023-09-29T23:25:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.787+0000 7ff217fff700 1 --2- 172.21.15.92:0/2929863141 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff21c035640 0x7ff21c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.787+0000 7ff217fff700 1 -- 172.21.15.92:0/2929863141 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7ff220046b60 con 0x7ff230095300 2023-09-29T23:25:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.787+0000 7ff22f7fe700 1 --2- 172.21.15.92:0/2929863141 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff21c035640 0x7ff21c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:25.790 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.788+0000 7ff22f7fe700 1 --2- 172.21.15.92:0/2929863141 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff21c035640 0x7ff21c037af0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff2240091e0 tx=0x7ff224016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:25.793 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:25.792+0000 7ff217fff700 1 -- 172.21.15.92:0/2929863141 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff22000ee20 con 0x7ff230095300 2023-09-29T23:25:26.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:26.013+0000 7ff23677c700 1 -- 172.21.15.92:0/2929863141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff23009a650 con 0x7ff230095300 2023-09-29T23:25:26.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:26.014+0000 7ff217fff700 1 -- 172.21.15.92:0/2929863141 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7ff220017020 con 0x7ff230095300 2023-09-29T23:25:26.015 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:25:26.016 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:25:26.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:26.016+0000 7ff23677c700 1 -- 172.21.15.92:0/2929863141 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff21c035640 msgr2=0x7ff21c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:26.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:26.016+0000 7ff23677c700 1 --2- 172.21.15.92:0/2929863141 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff21c035640 0x7ff21c037af0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff2240091e0 tx=0x7ff224016000 comp rx=0 tx=0).stop 2023-09-29T23:25:26.017 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:26.016+0000 7ff23677c700 1 -- 172.21.15.92:0/2929863141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff230095300 msgr2=0x7ff23008bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:26.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:26.016+0000 7ff23677c700 1 --2- 172.21.15.92:0/2929863141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff230095300 0x7ff23008bee0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff22000c6c0 tx=0x7ff220007de0 comp rx=0 tx=0).stop 2023-09-29T23:25:26.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:26.016+0000 7ff23677c700 1 -- 172.21.15.92:0/2929863141 shutdown_connections 2023-09-29T23:25:26.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:26.016+0000 7ff23677c700 1 --2- 172.21.15.92:0/2929863141 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff21c035640 0x7ff21c037af0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:26.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:26.016+0000 7ff23677c700 1 --2- 172.21.15.92:0/2929863141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff230095300 0x7ff23008bee0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:26.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:26.016+0000 7ff23677c700 1 -- 172.21.15.92:0/2929863141 >> 172.21.15.92:0/2929863141 conn(0x7ff23006bd70 msgr2=0x7ff23006d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:26.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:26.016+0000 7ff23677c700 1 -- 172.21.15.92:0/2929863141 shutdown_connections 2023-09-29T23:25:26.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:26.016+0000 7ff23677c700 1 -- 172.21.15.92:0/2929863141 wait complete. 2023-09-29T23:25:29.029 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:25:29.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.152+0000 7f9aad02d700 1 Processor -- start 2023-09-29T23:25:29.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.152+0000 7f9aad02d700 1 -- start start 2023-09-29T23:25:29.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.153+0000 7f9aad02d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9aa809fd80 0x7f9aa80a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:29.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.153+0000 7f9aad02d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa8098710 con 0x7f9aa812f8b0 2023-09-29T23:25:29.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.153+0000 7f9aad02d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa812f340 con 0x7f9aa809fd80 2023-09-29T23:25:29.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.153+0000 7f9aa6d9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9aa809fd80 0x7f9aa80a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:29.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.153+0000 7f9a9e59c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f9aa812f8b0 0x7f9aa8095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:36460/0 (socket says 172.21.15.92:36460) 2023-09-29T23:25:29.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.153+0000 7f9a9e59c700 1 -- 172.21.15.92:0/2419784500 learned_addr learned my addr 172.21.15.92:0/2419784500 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:25:29.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.153+0000 7f9aa6d9d700 1 -- 172.21.15.92:0/2419784500 >> v1:172.21.15.92:6789/0 conn(0x7f9aa812f8b0 legacy=0x7f9aa8095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:29.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.153+0000 7f9aa659c700 1 -- 172.21.15.92:0/2419784500 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947032894 0 0) 0x7f9aa8098710 con 0x7f9aa812f8b0 2023-09-29T23:25:29.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.153+0000 7f9aa6d9d700 1 -- 172.21.15.92:0/2419784500 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa80997e0 con 0x7f9aa809fd80 2023-09-29T23:25:29.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.153+0000 7f9aa6d9d700 1 --2- 172.21.15.92:0/2419784500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa809fd80 0x7f9aa80a3090 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009860 tx=0x7f9a980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a7e2b5df90b94 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:29.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.153+0000 7f9aa659c700 1 -- 172.21.15.92:0/2419784500 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a9800b680 con 0x7f9aa809fd80 2023-09-29T23:25:29.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.153+0000 7f9aa659c700 1 -- 172.21.15.92:0/2419784500 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9800b7e0 con 0x7f9aa809fd80 2023-09-29T23:25:29.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.153+0000 7f9aa659c700 1 -- 172.21.15.92:0/2419784500 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a9800b990 con 0x7f9aa809fd80 2023-09-29T23:25:29.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.154+0000 7f9aad02d700 1 -- 172.21.15.92:0/2419784500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa809fd80 msgr2=0x7f9aa80a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:29.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.154+0000 7f9aad02d700 1 --2- 172.21.15.92:0/2419784500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa809fd80 0x7f9aa80a3090 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009860 tx=0x7f9a980091a0 comp rx=0 tx=0).stop 2023-09-29T23:25:29.157 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.154+0000 7f9aad02d700 1 -- 172.21.15.92:0/2419784500 shutdown_connections 2023-09-29T23:25:29.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.154+0000 7f9aad02d700 1 --2- 172.21.15.92:0/2419784500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa809fd80 0x7f9aa80a3090 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:29.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.154+0000 7f9aad02d700 1 -- 172.21.15.92:0/2419784500 >> 172.21.15.92:0/2419784500 conn(0x7f9aa8068000 msgr2=0x7f9aa80a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:29.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.154+0000 7f9aad02d700 1 -- 172.21.15.92:0/2419784500 shutdown_connections 2023-09-29T23:25:29.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.154+0000 7f9aad02d700 1 -- 172.21.15.92:0/2419784500 wait complete. 2023-09-29T23:25:29.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.155+0000 7f9aad02d700 1 Processor -- start 2023-09-29T23:25:29.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.155+0000 7f9aad02d700 1 -- start start 2023-09-29T23:25:29.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.155+0000 7f9aad02d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa809fd80 0x7f9aa811da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:29.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.155+0000 7f9aad02d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa811e1b0 con 0x7f9aa809fd80 2023-09-29T23:25:29.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.155+0000 7f9aa6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa809fd80 0x7f9aa811da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:29.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.155+0000 7f9aa6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa809fd80 0x7f9aa811da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43566/0 (socket says 172.21.15.92:43566) 2023-09-29T23:25:29.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.155+0000 7f9aa6d9d700 1 -- 172.21.15.92:0/1069943816 learned_addr learned my addr 172.21.15.92:0/1069943816 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:25:29.158 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.156+0000 7f9aa6d9d700 1 -- 172.21.15.92:0/1069943816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a98009420 con 0x7f9aa809fd80 2023-09-29T23:25:29.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.156+0000 7f9aa6d9d700 1 --2- 172.21.15.92:0/1069943816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa809fd80 0x7f9aa811da60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9a98000c00 tx=0x7f9a98016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:29.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.156+0000 7f9a9f7fe700 1 -- 172.21.15.92:0/1069943816 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a98011d30 con 0x7f9aa809fd80 2023-09-29T23:25:29.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.156+0000 7f9a9f7fe700 1 -- 172.21.15.92:0/1069943816 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a98020070 con 0x7f9aa809fd80 2023-09-29T23:25:29.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.156+0000 7f9a9f7fe700 1 -- 172.21.15.92:0/1069943816 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a9801b450 con 0x7f9aa809fd80 2023-09-29T23:25:29.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.156+0000 7f9aad02d700 1 -- 172.21.15.92:0/1069943816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa811ec00 con 0x7f9aa809fd80 2023-09-29T23:25:29.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.156+0000 7f9aad02d700 1 -- 172.21.15.92:0/1069943816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa811c2f0 con 0x7f9aa809fd80 2023-09-29T23:25:29.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.157+0000 7f9a9f7fe700 1 -- 172.21.15.92:0/1069943816 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f9a98022030 con 0x7f9aa809fd80 2023-09-29T23:25:29.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.157+0000 7f9aad02d700 1 -- 172.21.15.92:0/1069943816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa805f230 con 0x7f9aa809fd80 2023-09-29T23:25:29.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.157+0000 7f9a9f7fe700 1 --2- 172.21.15.92:0/1069943816 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9a88035640 0x7f9a88037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:29.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.157+0000 7f9a9f7fe700 1 -- 172.21.15.92:0/1069943816 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f9a980491b0 con 0x7f9aa809fd80 2023-09-29T23:25:29.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.157+0000 7f9a9e59c700 1 --2- 172.21.15.92:0/1069943816 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9a88035640 0x7f9a88037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:29.159 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.157+0000 7f9a9e59c700 1 --2- 172.21.15.92:0/1069943816 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9a88035640 0x7f9a88037af0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9a900011e0 tx=0x7f9a900079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:29.161 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.161+0000 7f9a9f7fe700 1 -- 172.21.15.92:0/1069943816 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a980249c0 con 0x7f9aa809fd80 2023-09-29T23:25:29.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.389+0000 7f9aad02d700 1 -- 172.21.15.92:0/1069943816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9aa804bb40 con 0x7f9aa809fd80 2023-09-29T23:25:29.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.389+0000 7f9a9f7fe700 1 -- 172.21.15.92:0/1069943816 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f9a980193f0 con 0x7f9aa809fd80 2023-09-29T23:25:29.390 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:25:29.390 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:25:29.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.391+0000 7f9aad02d700 1 -- 172.21.15.92:0/1069943816 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9a88035640 msgr2=0x7f9a88037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:29.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.391+0000 7f9aad02d700 1 --2- 172.21.15.92:0/1069943816 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9a88035640 0x7f9a88037af0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9a900011e0 tx=0x7f9a900079d0 comp rx=0 tx=0).stop 2023-09-29T23:25:29.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.391+0000 7f9aad02d700 1 -- 172.21.15.92:0/1069943816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa809fd80 msgr2=0x7f9aa811da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:29.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.391+0000 7f9aad02d700 1 --2- 172.21.15.92:0/1069943816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa809fd80 0x7f9aa811da60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9a98000c00 tx=0x7f9a98016000 comp rx=0 tx=0).stop 2023-09-29T23:25:29.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.391+0000 7f9aad02d700 1 -- 172.21.15.92:0/1069943816 shutdown_connections 2023-09-29T23:25:29.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.391+0000 7f9aad02d700 1 --2- 172.21.15.92:0/1069943816 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9a88035640 0x7f9a88037af0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:29.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.391+0000 7f9aad02d700 1 --2- 172.21.15.92:0/1069943816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa809fd80 0x7f9aa811da60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:29.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.391+0000 7f9aad02d700 1 -- 172.21.15.92:0/1069943816 >> 172.21.15.92:0/1069943816 conn(0x7f9aa8068000 msgr2=0x7f9aa8094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:29.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.391+0000 7f9aad02d700 1 -- 172.21.15.92:0/1069943816 shutdown_connections 2023-09-29T23:25:29.392 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:29.391+0000 7f9aad02d700 1 -- 172.21.15.92:0/1069943816 wait complete. 2023-09-29T23:25:32.404 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:25:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.525+0000 7f8ff5f42700 1 Processor -- start 2023-09-29T23:25:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.525+0000 7f8ff5f42700 1 -- start start 2023-09-29T23:25:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.526+0000 7f8ff5f42700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8ff009fd80 0x7f8ff00a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.526+0000 7f8ff5f42700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff0098710 con 0x7f8ff012f8b0 2023-09-29T23:25:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.526+0000 7f8ff5f42700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff012f340 con 0x7f8ff009fd80 2023-09-29T23:25:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.526+0000 7f8fef7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8ff009fd80 0x7f8ff00a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.526+0000 7f8feeffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f8ff012f8b0 0x7f8ff0095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:45488/0 (socket says 172.21.15.92:45488) 2023-09-29T23:25:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.526+0000 7f8feeffd700 1 -- 172.21.15.92:0/1188195199 learned_addr learned my addr 172.21.15.92:0/1188195199 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:25:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.526+0000 7f8fef7fe700 1 -- 172.21.15.92:0/1188195199 >> v1:172.21.15.92:6789/0 conn(0x7f8ff012f8b0 legacy=0x7f8ff0095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.526+0000 7f8fef7fe700 1 -- 172.21.15.92:0/1188195199 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff00997e0 con 0x7f8ff009fd80 2023-09-29T23:25:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.526+0000 7f8fef7fe700 1 --2- 172.21.15.92:0/1188195199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ff009fd80 0x7f8ff00a3090 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009de0 tx=0x7f8fe0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd7ec27d44527fd server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.526+0000 7f8fee7fc700 1 -- 172.21.15.92:0/1188195199 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8fe000e070 con 0x7f8ff009fd80 2023-09-29T23:25:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.526+0000 7f8fee7fc700 1 -- 172.21.15.92:0/1188195199 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe000bc80 con 0x7f8ff009fd80 2023-09-29T23:25:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.526+0000 7f8fee7fc700 1 -- 172.21.15.92:0/1188195199 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8fe0012430 con 0x7f8ff009fd80 2023-09-29T23:25:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.527+0000 7f8ff5f42700 1 -- 172.21.15.92:0/1188195199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ff009fd80 msgr2=0x7f8ff00a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.527+0000 7f8ff5f42700 1 --2- 172.21.15.92:0/1188195199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ff009fd80 0x7f8ff00a3090 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009de0 tx=0x7f8fe0009780 comp rx=0 tx=0).stop 2023-09-29T23:25:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.527+0000 7f8ff5f42700 1 -- 172.21.15.92:0/1188195199 shutdown_connections 2023-09-29T23:25:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.527+0000 7f8ff5f42700 1 --2- 172.21.15.92:0/1188195199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ff009fd80 0x7f8ff00a3090 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.527+0000 7f8ff5f42700 1 -- 172.21.15.92:0/1188195199 >> 172.21.15.92:0/1188195199 conn(0x7f8ff0068000 msgr2=0x7f8ff00a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.527+0000 7f8ff5f42700 1 -- 172.21.15.92:0/1188195199 shutdown_connections 2023-09-29T23:25:32.530 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.527+0000 7f8ff5f42700 1 -- 172.21.15.92:0/1188195199 wait complete. 2023-09-29T23:25:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.528+0000 7f8ff5f42700 1 Processor -- start 2023-09-29T23:25:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.528+0000 7f8ff5f42700 1 -- start start 2023-09-29T23:25:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.528+0000 7f8ff5f42700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ff009fd80 0x7f8ff0119fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.528+0000 7f8ff5f42700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff011e610 con 0x7f8ff009fd80 2023-09-29T23:25:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.528+0000 7f8fef7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ff009fd80 0x7f8ff0119fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.529+0000 7f8fef7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ff009fd80 0x7f8ff0119fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52702/0 (socket says 172.21.15.92:52702) 2023-09-29T23:25:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.529+0000 7f8fef7fe700 1 -- 172.21.15.92:0/3468043083 learned_addr learned my addr 172.21.15.92:0/3468043083 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:25:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.529+0000 7f8fef7fe700 1 -- 172.21.15.92:0/3468043083 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe0009a20 con 0x7f8ff009fd80 2023-09-29T23:25:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.529+0000 7f8fef7fe700 1 --2- 172.21.15.92:0/3468043083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ff009fd80 0x7f8ff0119fa0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00099f0 tx=0x7f8fe0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.529+0000 7f8fd77fe700 1 -- 172.21.15.92:0/3468043083 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8fe0027470 con 0x7f8ff009fd80 2023-09-29T23:25:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.529+0000 7f8fd77fe700 1 -- 172.21.15.92:0/3468043083 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe00275d0 con 0x7f8ff009fd80 2023-09-29T23:25:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.529+0000 7f8ff5f42700 1 -- 172.21.15.92:0/3468043083 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff011ba50 con 0x7f8ff009fd80 2023-09-29T23:25:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.529+0000 7f8fd77fe700 1 -- 172.21.15.92:0/3468043083 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8fe00278c0 con 0x7f8ff009fd80 2023-09-29T23:25:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.529+0000 7f8ff5f42700 1 -- 172.21.15.92:0/3468043083 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff011d460 con 0x7f8ff009fd80 2023-09-29T23:25:32.533 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.530+0000 7f8fd77fe700 1 -- 172.21.15.92:0/3468043083 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f8fe0024070 con 0x7f8ff009fd80 2023-09-29T23:25:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.530+0000 7f8fd77fe700 1 --2- 172.21.15.92:0/3468043083 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8fdc035640 0x7f8fdc037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.530+0000 7f8ff5f42700 1 -- 172.21.15.92:0/3468043083 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff005f230 con 0x7f8ff009fd80 2023-09-29T23:25:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.530+0000 7f8fd77fe700 1 -- 172.21.15.92:0/3468043083 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f8fe0049cc0 con 0x7f8ff009fd80 2023-09-29T23:25:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.530+0000 7f8feeffd700 1 --2- 172.21.15.92:0/3468043083 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8fdc035640 0x7f8fdc037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:32.534 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.530+0000 7f8feeffd700 1 --2- 172.21.15.92:0/3468043083 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8fdc035640 0x7f8fdc037af0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40016a0 tx=0x7f8fe4007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:32.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.535+0000 7f8fd77fe700 1 -- 172.21.15.92:0/3468043083 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8fe0027a20 con 0x7f8ff009fd80 2023-09-29T23:25:32.757 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.757+0000 7f8ff5f42700 1 -- 172.21.15.92:0/3468043083 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8ff004bb40 con 0x7f8ff009fd80 2023-09-29T23:25:32.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.757+0000 7f8fd77fe700 1 -- 172.21.15.92:0/3468043083 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f8fe001cba0 con 0x7f8ff009fd80 2023-09-29T23:25:32.758 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:25:32.758 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:25:32.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.760+0000 7f8ff5f42700 1 -- 172.21.15.92:0/3468043083 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8fdc035640 msgr2=0x7f8fdc037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:32.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.760+0000 7f8ff5f42700 1 --2- 172.21.15.92:0/3468043083 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8fdc035640 0x7f8fdc037af0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40016a0 tx=0x7f8fe4007b30 comp rx=0 tx=0).stop 2023-09-29T23:25:32.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.760+0000 7f8ff5f42700 1 -- 172.21.15.92:0/3468043083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ff009fd80 msgr2=0x7f8ff0119fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:32.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.760+0000 7f8ff5f42700 1 --2- 172.21.15.92:0/3468043083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ff009fd80 0x7f8ff0119fa0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00099f0 tx=0x7f8fe0018000 comp rx=0 tx=0).stop 2023-09-29T23:25:32.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.760+0000 7f8ff5f42700 1 -- 172.21.15.92:0/3468043083 shutdown_connections 2023-09-29T23:25:32.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.760+0000 7f8ff5f42700 1 --2- 172.21.15.92:0/3468043083 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8fdc035640 0x7f8fdc037af0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:32.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.760+0000 7f8ff5f42700 1 --2- 172.21.15.92:0/3468043083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ff009fd80 0x7f8ff0119fa0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:32.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.760+0000 7f8ff5f42700 1 -- 172.21.15.92:0/3468043083 >> 172.21.15.92:0/3468043083 conn(0x7f8ff0068000 msgr2=0x7f8ff0094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:32.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.760+0000 7f8ff5f42700 1 -- 172.21.15.92:0/3468043083 shutdown_connections 2023-09-29T23:25:32.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:32.760+0000 7f8ff5f42700 1 -- 172.21.15.92:0/3468043083 wait complete. 2023-09-29T23:25:35.772 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:25:35.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.894+0000 7f0872606700 1 Processor -- start 2023-09-29T23:25:35.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.894+0000 7f0872606700 1 -- start start 2023-09-29T23:25:35.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.895+0000 7f0872606700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f086c096ca0 0x7f086c097070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:35.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.895+0000 7f0872606700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c098700 con 0x7f086c0975b0 2023-09-29T23:25:35.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.895+0000 7f0872606700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c09f430 con 0x7f086c096ca0 2023-09-29T23:25:35.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.895+0000 7f086bfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f086c096ca0 0x7f086c097070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:35.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.895+0000 7f086b7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f086c0975b0 0x7f086c130630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:45492/0 (socket says 172.21.15.92:45492) 2023-09-29T23:25:35.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.895+0000 7f086b7fe700 1 -- 172.21.15.92:0/4277216449 learned_addr learned my addr 172.21.15.92:0/4277216449 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:25:35.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.895+0000 7f086bfff700 1 -- 172.21.15.92:0/4277216449 >> v1:172.21.15.92:6789/0 conn(0x7f086c0975b0 legacy=0x7f086c130630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:35.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.895+0000 7f086bfff700 1 -- 172.21.15.92:0/4277216449 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c06fab0 con 0x7f086c096ca0 2023-09-29T23:25:35.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.895+0000 7f086affd700 1 -- 172.21.15.92:0/4277216449 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 647011460 0 0) 0x7f086c098700 con 0x7f086c0975b0 2023-09-29T23:25:35.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.895+0000 7f086bfff700 1 --2- 172.21.15.92:0/4277216449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f086c096ca0 0x7f086c097070 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f085c009850 tx=0x7f085c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc65cc3d0d2e4be server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:35.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.895+0000 7f086affd700 1 -- 172.21.15.92:0/4277216449 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f085c005d50 con 0x7f086c096ca0 2023-09-29T23:25:35.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.896+0000 7f086affd700 1 -- 172.21.15.92:0/4277216449 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c006030 con 0x7f086c096ca0 2023-09-29T23:25:35.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.896+0000 7f086affd700 1 -- 172.21.15.92:0/4277216449 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f085c006300 con 0x7f086c096ca0 2023-09-29T23:25:35.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.896+0000 7f0872606700 1 -- 172.21.15.92:0/4277216449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f086c096ca0 msgr2=0x7f086c097070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:35.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.896+0000 7f0872606700 1 --2- 172.21.15.92:0/4277216449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f086c096ca0 0x7f086c097070 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f085c009850 tx=0x7f085c009120 comp rx=0 tx=0).stop 2023-09-29T23:25:35.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.896+0000 7f0872606700 1 -- 172.21.15.92:0/4277216449 shutdown_connections 2023-09-29T23:25:35.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.896+0000 7f0872606700 1 --2- 172.21.15.92:0/4277216449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f086c096ca0 0x7f086c097070 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:35.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.896+0000 7f0872606700 1 -- 172.21.15.92:0/4277216449 >> 172.21.15.92:0/4277216449 conn(0x7f086c06bd70 msgr2=0x7f086c06e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:35.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.896+0000 7f0872606700 1 -- 172.21.15.92:0/4277216449 shutdown_connections 2023-09-29T23:25:35.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.896+0000 7f0872606700 1 -- 172.21.15.92:0/4277216449 wait complete. 2023-09-29T23:25:35.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.897+0000 7f0872606700 1 Processor -- start 2023-09-29T23:25:35.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.897+0000 7f0872606700 1 -- start start 2023-09-29T23:25:35.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.897+0000 7f0872606700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f086c096ca0 0x7f086c091ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:35.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.897+0000 7f0872606700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c092d20 con 0x7f086c096ca0 2023-09-29T23:25:35.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.897+0000 7f086bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f086c096ca0 0x7f086c091ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:35.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.898+0000 7f086bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f086c096ca0 0x7f086c091ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52716/0 (socket says 172.21.15.92:52716) 2023-09-29T23:25:35.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.898+0000 7f086bfff700 1 -- 172.21.15.92:0/3817635242 learned_addr learned my addr 172.21.15.92:0/3817635242 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:25:35.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.898+0000 7f086bfff700 1 -- 172.21.15.92:0/3817635242 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c0093c0 con 0x7f086c096ca0 2023-09-29T23:25:35.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.898+0000 7f086bfff700 1 --2- 172.21.15.92:0/3817635242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f086c096ca0 0x7f086c091ea0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f085c009390 tx=0x7f085c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:35.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.898+0000 7f0853fff700 1 -- 172.21.15.92:0/3817635242 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f085c00bc10 con 0x7f086c096ca0 2023-09-29T23:25:35.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.898+0000 7f0853fff700 1 -- 172.21.15.92:0/3817635242 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c00bd70 con 0x7f086c096ca0 2023-09-29T23:25:35.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.898+0000 7f0872606700 1 -- 172.21.15.92:0/3817635242 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c092a10 con 0x7f086c096ca0 2023-09-29T23:25:35.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.898+0000 7f0853fff700 1 -- 172.21.15.92:0/3817635242 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f085c01c450 con 0x7f086c096ca0 2023-09-29T23:25:35.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.898+0000 7f0872606700 1 -- 172.21.15.92:0/3817635242 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c08fdb0 con 0x7f086c096ca0 2023-09-29T23:25:35.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.899+0000 7f0853fff700 1 -- 172.21.15.92:0/3817635242 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f085c023030 con 0x7f086c096ca0 2023-09-29T23:25:35.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.899+0000 7f0872606700 1 -- 172.21.15.92:0/3817635242 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c0927c0 con 0x7f086c096ca0 2023-09-29T23:25:35.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.899+0000 7f0853fff700 1 --2- 172.21.15.92:0/3817635242 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0858035640 0x7f0858037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:35.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.899+0000 7f0853fff700 1 -- 172.21.15.92:0/3817635242 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f085c0495d0 con 0x7f086c096ca0 2023-09-29T23:25:35.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.899+0000 7f086b7fe700 1 --2- 172.21.15.92:0/3817635242 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0858035640 0x7f0858037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:35.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.899+0000 7f086b7fe700 1 --2- 172.21.15.92:0/3817635242 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0858035640 0x7f0858037af0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f08600011e0 tx=0x7f08600079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:35.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:35.904+0000 7f0853fff700 1 -- 172.21.15.92:0/3817635242 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f085c024970 con 0x7f086c096ca0 2023-09-29T23:25:36.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:36.126+0000 7f0872606700 1 -- 172.21.15.92:0/3817635242 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f086c0994e0 con 0x7f086c096ca0 2023-09-29T23:25:36.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:36.127+0000 7f0853fff700 1 -- 172.21.15.92:0/3817635242 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f085c011420 con 0x7f086c096ca0 2023-09-29T23:25:36.127 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:25:36.127 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:25:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:36.128+0000 7f0872606700 1 -- 172.21.15.92:0/3817635242 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0858035640 msgr2=0x7f0858037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:36.128+0000 7f0872606700 1 --2- 172.21.15.92:0/3817635242 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0858035640 0x7f0858037af0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f08600011e0 tx=0x7f08600079d0 comp rx=0 tx=0).stop 2023-09-29T23:25:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:36.128+0000 7f0872606700 1 -- 172.21.15.92:0/3817635242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f086c096ca0 msgr2=0x7f086c091ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:36.128+0000 7f0872606700 1 --2- 172.21.15.92:0/3817635242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f086c096ca0 0x7f086c091ea0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f085c009390 tx=0x7f085c015000 comp rx=0 tx=0).stop 2023-09-29T23:25:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:36.129+0000 7f0872606700 1 -- 172.21.15.92:0/3817635242 shutdown_connections 2023-09-29T23:25:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:36.129+0000 7f0872606700 1 --2- 172.21.15.92:0/3817635242 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0858035640 0x7f0858037af0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:36.129+0000 7f0872606700 1 --2- 172.21.15.92:0/3817635242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f086c096ca0 0x7f086c091ea0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:36.129+0000 7f0872606700 1 -- 172.21.15.92:0/3817635242 >> 172.21.15.92:0/3817635242 conn(0x7f086c06bd70 msgr2=0x7f086c09da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:36.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:36.129+0000 7f0872606700 1 -- 172.21.15.92:0/3817635242 shutdown_connections 2023-09-29T23:25:36.130 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:36.129+0000 7f0872606700 1 -- 172.21.15.92:0/3817635242 wait complete. 2023-09-29T23:25:39.141 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:25:39.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.273+0000 7f06d3c53700 1 Processor -- start 2023-09-29T23:25:39.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.273+0000 7f06d3c53700 1 -- start start 2023-09-29T23:25:39.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.273+0000 7f06d3c53700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f06cc06a040 0x7f06cc134560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:39.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.273+0000 7f06d3c53700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06cc0a1580 con 0x7f06cc06f210 2023-09-29T23:25:39.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.273+0000 7f06d3c53700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06cc06f5e0 con 0x7f06cc06a040 2023-09-29T23:25:39.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.273+0000 7f06d11ee700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f06cc06a040 0x7f06cc134560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:39.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.273+0000 7f06d19ef700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f06cc06f210 0x7f06cc069930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:45506/0 (socket says 172.21.15.92:45506) 2023-09-29T23:25:39.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.273+0000 7f06d19ef700 1 -- 172.21.15.92:0/1145117383 learned_addr learned my addr 172.21.15.92:0/1145117383 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:25:39.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.274+0000 7f06d11ee700 1 -- 172.21.15.92:0/1145117383 >> v1:172.21.15.92:6789/0 conn(0x7f06cc06f210 legacy=0x7f06cc069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.274+0000 7f06d11ee700 1 -- 172.21.15.92:0/1145117383 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc09cc70 con 0x7f06cc06a040 2023-09-29T23:25:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.274+0000 7f06d11ee700 1 --2- 172.21.15.92:0/1145117383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06cc06a040 0x7f06cc134560 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009860 tx=0x7f06c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d703b2230b6d0b server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.274+0000 7f06d09ed700 1 -- 172.21.15.92:0/1145117383 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06c000b680 con 0x7f06cc06a040 2023-09-29T23:25:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.274+0000 7f06d09ed700 1 -- 172.21.15.92:0/1145117383 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c000b7e0 con 0x7f06cc06a040 2023-09-29T23:25:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.274+0000 7f06d09ed700 1 -- 172.21.15.92:0/1145117383 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06c000bad0 con 0x7f06cc06a040 2023-09-29T23:25:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.274+0000 7f06d3c53700 1 -- 172.21.15.92:0/1145117383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06cc06a040 msgr2=0x7f06cc134560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.274+0000 7f06d3c53700 1 --2- 172.21.15.92:0/1145117383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06cc06a040 0x7f06cc134560 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009860 tx=0x7f06c00091a0 comp rx=0 tx=0).stop 2023-09-29T23:25:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.274+0000 7f06d3c53700 1 -- 172.21.15.92:0/1145117383 shutdown_connections 2023-09-29T23:25:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.274+0000 7f06d3c53700 1 --2- 172.21.15.92:0/1145117383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06cc06a040 0x7f06cc134560 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.274+0000 7f06d3c53700 1 -- 172.21.15.92:0/1145117383 >> 172.21.15.92:0/1145117383 conn(0x7f06cc094a70 msgr2=0x7f06cc06eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.275+0000 7f06d3c53700 1 -- 172.21.15.92:0/1145117383 shutdown_connections 2023-09-29T23:25:39.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.275+0000 7f06d3c53700 1 -- 172.21.15.92:0/1145117383 wait complete. 2023-09-29T23:25:39.278 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.275+0000 7f06d3c53700 1 Processor -- start 2023-09-29T23:25:39.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.275+0000 7f06d3c53700 1 -- start start 2023-09-29T23:25:39.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.276+0000 7f06d3c53700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06cc06a040 0x7f06cc11ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:39.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.276+0000 7f06d3c53700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc12cbd0 con 0x7f06cc06a040 2023-09-29T23:25:39.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.276+0000 7f06d19ef700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06cc06a040 0x7f06cc11ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:39.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.276+0000 7f06d19ef700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06cc06a040 0x7f06cc11ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52734/0 (socket says 172.21.15.92:52734) 2023-09-29T23:25:39.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.276+0000 7f06d19ef700 1 -- 172.21.15.92:0/2847328259 learned_addr learned my addr 172.21.15.92:0/2847328259 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:25:39.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.276+0000 7f06d19ef700 1 -- 172.21.15.92:0/2847328259 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0009420 con 0x7f06cc06a040 2023-09-29T23:25:39.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.276+0000 7f06d19ef700 1 --2- 172.21.15.92:0/2847328259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06cc06a040 0x7f06cc11ac50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00ca40 tx=0x7f06bc001790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:39.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.276+0000 7f06c9ffb700 1 -- 172.21.15.92:0/2847328259 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06bc003100 con 0x7f06cc06a040 2023-09-29T23:25:39.279 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.276+0000 7f06c9ffb700 1 -- 172.21.15.92:0/2847328259 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06bc005d80 con 0x7f06cc06a040 2023-09-29T23:25:39.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.276+0000 7f06c9ffb700 1 -- 172.21.15.92:0/2847328259 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06bc00a770 con 0x7f06cc06a040 2023-09-29T23:25:39.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.276+0000 7f06d3c53700 1 -- 172.21.15.92:0/2847328259 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06cc133de0 con 0x7f06cc06a040 2023-09-29T23:25:39.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.277+0000 7f06d3c53700 1 -- 172.21.15.92:0/2847328259 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06cc11b330 con 0x7f06cc06a040 2023-09-29T23:25:39.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.277+0000 7f06c9ffb700 1 -- 172.21.15.92:0/2847328259 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f06bc00a8d0 con 0x7f06cc06a040 2023-09-29T23:25:39.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.277+0000 7f06c9ffb700 1 --2- 172.21.15.92:0/2847328259 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f06b8035640 0x7f06b8037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:39.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.277+0000 7f06c9ffb700 1 -- 172.21.15.92:0/2847328259 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f06bc046c20 con 0x7f06cc06a040 2023-09-29T23:25:39.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.277+0000 7f06d11ee700 1 --2- 172.21.15.92:0/2847328259 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f06b8035640 0x7f06b8037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:39.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.277+0000 7f06d3c53700 1 -- 172.21.15.92:0/2847328259 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06cc05f230 con 0x7f06cc06a040 2023-09-29T23:25:39.280 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.278+0000 7f06d11ee700 1 --2- 172.21.15.92:0/2847328259 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f06b8035640 0x7f06b8037af0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f06c00091e0 tx=0x7f06c0016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:39.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.282+0000 7f06c9ffb700 1 -- 172.21.15.92:0/2847328259 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06bc018030 con 0x7f06cc06a040 2023-09-29T23:25:39.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.504+0000 7f06d3c53700 1 -- 172.21.15.92:0/2847328259 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f06cc04bb40 con 0x7f06cc06a040 2023-09-29T23:25:39.504 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.504+0000 7f06c9ffb700 1 -- 172.21.15.92:0/2847328259 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f06bc0108f0 con 0x7f06cc06a040 2023-09-29T23:25:39.504 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:25:39.505 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:25:39.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.506+0000 7f06d3c53700 1 -- 172.21.15.92:0/2847328259 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f06b8035640 msgr2=0x7f06b8037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:39.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.506+0000 7f06d3c53700 1 --2- 172.21.15.92:0/2847328259 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f06b8035640 0x7f06b8037af0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f06c00091e0 tx=0x7f06c0016000 comp rx=0 tx=0).stop 2023-09-29T23:25:39.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.506+0000 7f06d3c53700 1 -- 172.21.15.92:0/2847328259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06cc06a040 msgr2=0x7f06cc11ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:39.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.506+0000 7f06d3c53700 1 --2- 172.21.15.92:0/2847328259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06cc06a040 0x7f06cc11ac50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00ca40 tx=0x7f06bc001790 comp rx=0 tx=0).stop 2023-09-29T23:25:39.507 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.506+0000 7f06d3c53700 1 -- 172.21.15.92:0/2847328259 shutdown_connections 2023-09-29T23:25:39.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.506+0000 7f06d3c53700 1 --2- 172.21.15.92:0/2847328259 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f06b8035640 0x7f06b8037af0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:39.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.506+0000 7f06d3c53700 1 --2- 172.21.15.92:0/2847328259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06cc06a040 0x7f06cc11ac50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:39.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.506+0000 7f06d3c53700 1 -- 172.21.15.92:0/2847328259 >> 172.21.15.92:0/2847328259 conn(0x7f06cc094a70 msgr2=0x7f06cc06d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:39.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.506+0000 7f06d3c53700 1 -- 172.21.15.92:0/2847328259 shutdown_connections 2023-09-29T23:25:39.508 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:39.506+0000 7f06d3c53700 1 -- 172.21.15.92:0/2847328259 wait complete. 2023-09-29T23:25:42.519 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:25:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.646+0000 7f37dcf6f700 1 Processor -- start 2023-09-29T23:25:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.646+0000 7f37dcf6f700 1 -- start start 2023-09-29T23:25:42.648 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.646+0000 7f37dcf6f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f37d806b0c0 0x7f37d812f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.646+0000 7f37dcf6f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d809ca80 con 0x7f37d812fb70 2023-09-29T23:25:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.646+0000 7f37dcf6f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d806b490 con 0x7f37d806b0c0 2023-09-29T23:25:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.647+0000 7f37d77fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f37d806b0c0 0x7f37d812f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.647+0000 7f37d6ffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f37d812fb70 0x7f37d8099530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:47626/0 (socket says 172.21.15.92:47626) 2023-09-29T23:25:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.647+0000 7f37d6ffd700 1 -- 172.21.15.92:0/2274040930 learned_addr learned my addr 172.21.15.92:0/2274040930 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:25:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.647+0000 7f37d77fe700 1 -- 172.21.15.92:0/2274040930 >> v1:172.21.15.92:6789/0 conn(0x7f37d812fb70 legacy=0x7f37d8099530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.647+0000 7f37d77fe700 1 -- 172.21.15.92:0/2274040930 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d809be20 con 0x7f37d806b0c0 2023-09-29T23:25:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.647+0000 7f37d67fc700 1 -- 172.21.15.92:0/2274040930 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718855448 0 0) 0x7f37cc001110 con 0x7f37d812fb70 2023-09-29T23:25:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.647+0000 7f37d77fe700 1 --2- 172.21.15.92:0/2274040930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37d806b0c0 0x7f37d812f630 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f37c8009de0 tx=0x7f37c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563ce10414bf7636 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.647+0000 7f37d67fc700 1 -- 172.21.15.92:0/2274040930 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37c800e070 con 0x7f37d806b0c0 2023-09-29T23:25:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.647+0000 7f37d67fc700 1 -- 172.21.15.92:0/2274040930 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c800bdc0 con 0x7f37d806b0c0 2023-09-29T23:25:42.649 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.647+0000 7f37d67fc700 1 -- 172.21.15.92:0/2274040930 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37c80125b0 con 0x7f37d806b0c0 2023-09-29T23:25:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.648+0000 7f37dcf6f700 1 -- 172.21.15.92:0/2274040930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37d806b0c0 msgr2=0x7f37d812f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.648+0000 7f37dcf6f700 1 --2- 172.21.15.92:0/2274040930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37d806b0c0 0x7f37d812f630 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f37c8009de0 tx=0x7f37c8009780 comp rx=0 tx=0).stop 2023-09-29T23:25:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.648+0000 7f37dcf6f700 1 -- 172.21.15.92:0/2274040930 shutdown_connections 2023-09-29T23:25:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.648+0000 7f37dcf6f700 1 --2- 172.21.15.92:0/2274040930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37d806b0c0 0x7f37d812f630 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.648+0000 7f37dcf6f700 1 -- 172.21.15.92:0/2274040930 >> 172.21.15.92:0/2274040930 conn(0x7f37d806a5b0 msgr2=0x7f37d806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.648+0000 7f37dcf6f700 1 -- 172.21.15.92:0/2274040930 shutdown_connections 2023-09-29T23:25:42.650 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.648+0000 7f37dcf6f700 1 -- 172.21.15.92:0/2274040930 wait complete. 2023-09-29T23:25:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.649+0000 7f37dcf6f700 1 Processor -- start 2023-09-29T23:25:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.649+0000 7f37dcf6f700 1 -- start start 2023-09-29T23:25:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.649+0000 7f37dcf6f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37d806b0c0 0x7f37d811dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.649+0000 7f37dcf6f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d811a7b0 con 0x7f37d806b0c0 2023-09-29T23:25:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.649+0000 7f37d77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37d806b0c0 0x7f37d811dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.649+0000 7f37d77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37d806b0c0 0x7f37d811dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47224/0 (socket says 172.21.15.92:47224) 2023-09-29T23:25:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.649+0000 7f37d77fe700 1 -- 172.21.15.92:0/661652053 learned_addr learned my addr 172.21.15.92:0/661652053 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:25:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.650+0000 7f37d77fe700 1 -- 172.21.15.92:0/661652053 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c8009a20 con 0x7f37d806b0c0 2023-09-29T23:25:42.652 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.650+0000 7f37d77fe700 1 --2- 172.21.15.92:0/661652053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37d806b0c0 0x7f37d811dfe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f37c80099f0 tx=0x7f37c8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.650+0000 7f37bf7fe700 1 -- 172.21.15.92:0/661652053 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37c8027470 con 0x7f37d806b0c0 2023-09-29T23:25:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.650+0000 7f37bf7fe700 1 -- 172.21.15.92:0/661652053 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c80275d0 con 0x7f37d806b0c0 2023-09-29T23:25:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.650+0000 7f37dcf6f700 1 -- 172.21.15.92:0/661652053 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d812cea0 con 0x7f37d806b0c0 2023-09-29T23:25:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.650+0000 7f37bf7fe700 1 -- 172.21.15.92:0/661652053 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37c80278c0 con 0x7f37d806b0c0 2023-09-29T23:25:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.650+0000 7f37dcf6f700 1 -- 172.21.15.92:0/661652053 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d811e6c0 con 0x7f37d806b0c0 2023-09-29T23:25:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.651+0000 7f37bf7fe700 1 -- 172.21.15.92:0/661652053 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f37c8024070 con 0x7f37d806b0c0 2023-09-29T23:25:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.651+0000 7f37bf7fe700 1 --2- 172.21.15.92:0/661652053 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f37c4035640 0x7f37c4037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.651+0000 7f37dcf6f700 1 -- 172.21.15.92:0/661652053 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d805f230 con 0x7f37d806b0c0 2023-09-29T23:25:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.651+0000 7f37bf7fe700 1 -- 172.21.15.92:0/661652053 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f37c8049d50 con 0x7f37d806b0c0 2023-09-29T23:25:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.651+0000 7f37d6ffd700 1 --2- 172.21.15.92:0/661652053 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f37c4035640 0x7f37c4037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:42.653 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.651+0000 7f37d6ffd700 1 --2- 172.21.15.92:0/661652053 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f37c4035640 0x7f37c4037af0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f37cc007fd0 tx=0x7f37cc001250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:42.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.656+0000 7f37bf7fe700 1 -- 172.21.15.92:0/661652053 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37c8027a20 con 0x7f37d806b0c0 2023-09-29T23:25:42.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.877+0000 7f37dcf6f700 1 -- 172.21.15.92:0/661652053 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f37d812f320 con 0x7f37d806b0c0 2023-09-29T23:25:42.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.877+0000 7f37bf7fe700 1 -- 172.21.15.92:0/661652053 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f37c801cba0 con 0x7f37d806b0c0 2023-09-29T23:25:42.878 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:25:42.878 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:25:42.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.879+0000 7f37dcf6f700 1 -- 172.21.15.92:0/661652053 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f37c4035640 msgr2=0x7f37c4037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:42.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.879+0000 7f37dcf6f700 1 --2- 172.21.15.92:0/661652053 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f37c4035640 0x7f37c4037af0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f37cc007fd0 tx=0x7f37cc001250 comp rx=0 tx=0).stop 2023-09-29T23:25:42.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.879+0000 7f37dcf6f700 1 -- 172.21.15.92:0/661652053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37d806b0c0 msgr2=0x7f37d811dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:42.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.879+0000 7f37dcf6f700 1 --2- 172.21.15.92:0/661652053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37d806b0c0 0x7f37d811dfe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f37c80099f0 tx=0x7f37c8018000 comp rx=0 tx=0).stop 2023-09-29T23:25:42.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.879+0000 7f37dcf6f700 1 -- 172.21.15.92:0/661652053 shutdown_connections 2023-09-29T23:25:42.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.879+0000 7f37dcf6f700 1 --2- 172.21.15.92:0/661652053 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f37c4035640 0x7f37c4037af0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:42.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.879+0000 7f37dcf6f700 1 --2- 172.21.15.92:0/661652053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37d806b0c0 0x7f37d811dfe0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:42.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.879+0000 7f37dcf6f700 1 -- 172.21.15.92:0/661652053 >> 172.21.15.92:0/661652053 conn(0x7f37d806a5b0 msgr2=0x7f37d812dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:42.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.879+0000 7f37dcf6f700 1 -- 172.21.15.92:0/661652053 shutdown_connections 2023-09-29T23:25:42.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:42.879+0000 7f37dcf6f700 1 -- 172.21.15.92:0/661652053 wait complete. 2023-09-29T23:25:45.891 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:25:46.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.012+0000 7fd8a3e19700 1 Processor -- start 2023-09-29T23:25:46.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.012+0000 7fd8a3e19700 1 -- start start 2023-09-29T23:25:46.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.013+0000 7fd8a3e19700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd89c06f210 0x7fd89c069930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:46.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.013+0000 7fd8a3e19700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c0a1580 con 0x7fd89c069e70 2023-09-29T23:25:46.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.013+0000 7fd8a3e19700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89c06f5e0 con 0x7fd89c06f210 2023-09-29T23:25:46.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.013+0000 7fd8a1bb5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd89c06f210 0x7fd89c069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:46.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.013+0000 7fd8a13b4700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fd89c069e70 0x7fd89c12f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:47642/0 (socket says 172.21.15.92:47642) 2023-09-29T23:25:46.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.013+0000 7fd8a13b4700 1 -- 172.21.15.92:0/3890951014 learned_addr learned my addr 172.21.15.92:0/3890951014 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:25:46.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.013+0000 7fd8a1bb5700 1 -- 172.21.15.92:0/3890951014 >> v1:172.21.15.92:6789/0 conn(0x7fd89c069e70 legacy=0x7fd89c12f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:46.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.013+0000 7fd8a1bb5700 1 -- 172.21.15.92:0/3890951014 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c09cc70 con 0x7fd89c06f210 2023-09-29T23:25:46.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.013+0000 7fd8a0bb3700 1 -- 172.21.15.92:0/3890951014 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996677426 0 0) 0x7fd89c0a1580 con 0x7fd89c069e70 2023-09-29T23:25:46.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.013+0000 7fd8a1bb5700 1 --2- 172.21.15.92:0/3890951014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd89c06f210 0x7fd89c069930 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd898009e30 tx=0x7fd898009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3df5101453b9a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:46.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.014+0000 7fd8a0bb3700 1 -- 172.21.15.92:0/3890951014 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd89800e070 con 0x7fd89c06f210 2023-09-29T23:25:46.015 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.014+0000 7fd8a0bb3700 1 -- 172.21.15.92:0/3890951014 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89800bd70 con 0x7fd89c06f210 2023-09-29T23:25:46.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.014+0000 7fd8a0bb3700 1 -- 172.21.15.92:0/3890951014 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8980125b0 con 0x7fd89c06f210 2023-09-29T23:25:46.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.014+0000 7fd8a3e19700 1 -- 172.21.15.92:0/3890951014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd89c06f210 msgr2=0x7fd89c069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:46.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.014+0000 7fd8a3e19700 1 --2- 172.21.15.92:0/3890951014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd89c06f210 0x7fd89c069930 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd898009e30 tx=0x7fd898009780 comp rx=0 tx=0).stop 2023-09-29T23:25:46.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.014+0000 7fd8a3e19700 1 -- 172.21.15.92:0/3890951014 shutdown_connections 2023-09-29T23:25:46.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.014+0000 7fd8a3e19700 1 --2- 172.21.15.92:0/3890951014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd89c06f210 0x7fd89c069930 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:46.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.014+0000 7fd8a3e19700 1 -- 172.21.15.92:0/3890951014 >> 172.21.15.92:0/3890951014 conn(0x7fd89c094a70 msgr2=0x7fd89c06eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:46.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.014+0000 7fd8a3e19700 1 -- 172.21.15.92:0/3890951014 shutdown_connections 2023-09-29T23:25:46.016 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.014+0000 7fd8a3e19700 1 -- 172.21.15.92:0/3890951014 wait complete. 2023-09-29T23:25:46.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.015+0000 7fd8a3e19700 1 Processor -- start 2023-09-29T23:25:46.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.015+0000 7fd8a3e19700 1 -- start start 2023-09-29T23:25:46.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.015+0000 7fd8a3e19700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd89c069e70 0x7fd89c11e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:46.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.015+0000 7fd8a3e19700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c11a780 con 0x7fd89c069e70 2023-09-29T23:25:46.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.015+0000 7fd8a1bb5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd89c069e70 0x7fd89c11e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:46.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.015+0000 7fd8a1bb5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd89c069e70 0x7fd89c11e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47252/0 (socket says 172.21.15.92:47252) 2023-09-29T23:25:46.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.015+0000 7fd8a1bb5700 1 -- 172.21.15.92:0/3529067266 learned_addr learned my addr 172.21.15.92:0/3529067266 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:25:46.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.016+0000 7fd8a1bb5700 1 -- 172.21.15.92:0/3529067266 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd898009a20 con 0x7fd89c069e70 2023-09-29T23:25:46.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.016+0000 7fd8a1bb5700 1 --2- 172.21.15.92:0/3529067266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd89c069e70 0x7fd89c11e000 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd898009f90 tx=0x7fd898018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:46.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.016+0000 7fd891ffb700 1 -- 172.21.15.92:0/3529067266 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd898027470 con 0x7fd89c069e70 2023-09-29T23:25:46.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.016+0000 7fd891ffb700 1 -- 172.21.15.92:0/3529067266 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8980275f0 con 0x7fd89c069e70 2023-09-29T23:25:46.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.016+0000 7fd8a3e19700 1 -- 172.21.15.92:0/3529067266 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c11a9b0 con 0x7fd89c069e70 2023-09-29T23:25:46.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.016+0000 7fd891ffb700 1 -- 172.21.15.92:0/3529067266 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8980278e0 con 0x7fd89c069e70 2023-09-29T23:25:46.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.016+0000 7fd8a3e19700 1 -- 172.21.15.92:0/3529067266 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89c11bea0 con 0x7fd89c069e70 2023-09-29T23:25:46.019 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.017+0000 7fd891ffb700 1 -- 172.21.15.92:0/3529067266 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fd898024070 con 0x7fd89c069e70 2023-09-29T23:25:46.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.017+0000 7fd8a3e19700 1 -- 172.21.15.92:0/3529067266 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89c05f230 con 0x7fd89c069e70 2023-09-29T23:25:46.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.017+0000 7fd891ffb700 1 --2- 172.21.15.92:0/3529067266 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd880035640 0x7fd880037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:46.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.017+0000 7fd891ffb700 1 -- 172.21.15.92:0/3529067266 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fd898049dd0 con 0x7fd89c069e70 2023-09-29T23:25:46.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.017+0000 7fd8a13b4700 1 --2- 172.21.15.92:0/3529067266 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd880035640 0x7fd880037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:46.020 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.018+0000 7fd8a13b4700 1 --2- 172.21.15.92:0/3529067266 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd880035640 0x7fd880037af0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd88c001660 tx=0x7fd88c007bd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:46.022 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.022+0000 7fd891ffb700 1 -- 172.21.15.92:0/3529067266 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd89802f760 con 0x7fd89c069e70 2023-09-29T23:25:46.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.244+0000 7fd8a3e19700 1 -- 172.21.15.92:0/3529067266 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd89c09bdd0 con 0x7fd89c069e70 2023-09-29T23:25:46.245 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.245+0000 7fd891ffb700 1 -- 172.21.15.92:0/3529067266 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fd89804b020 con 0x7fd89c069e70 2023-09-29T23:25:46.245 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:25:46.245 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:25:46.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.246+0000 7fd8a3e19700 1 -- 172.21.15.92:0/3529067266 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd880035640 msgr2=0x7fd880037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:46.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.246+0000 7fd8a3e19700 1 --2- 172.21.15.92:0/3529067266 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd880035640 0x7fd880037af0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd88c001660 tx=0x7fd88c007bd0 comp rx=0 tx=0).stop 2023-09-29T23:25:46.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.247+0000 7fd8a3e19700 1 -- 172.21.15.92:0/3529067266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd89c069e70 msgr2=0x7fd89c11e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:46.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.247+0000 7fd8a3e19700 1 --2- 172.21.15.92:0/3529067266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd89c069e70 0x7fd89c11e000 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd898009f90 tx=0x7fd898018000 comp rx=0 tx=0).stop 2023-09-29T23:25:46.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.247+0000 7fd8a3e19700 1 -- 172.21.15.92:0/3529067266 shutdown_connections 2023-09-29T23:25:46.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.247+0000 7fd8a3e19700 1 --2- 172.21.15.92:0/3529067266 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd880035640 0x7fd880037af0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:46.247 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.247+0000 7fd8a3e19700 1 --2- 172.21.15.92:0/3529067266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd89c069e70 0x7fd89c11e000 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:46.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.247+0000 7fd8a3e19700 1 -- 172.21.15.92:0/3529067266 >> 172.21.15.92:0/3529067266 conn(0x7fd89c094a70 msgr2=0x7fd89c12ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:46.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.247+0000 7fd8a3e19700 1 -- 172.21.15.92:0/3529067266 shutdown_connections 2023-09-29T23:25:46.248 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:46.247+0000 7fd8a3e19700 1 -- 172.21.15.92:0/3529067266 wait complete. 2023-09-29T23:25:49.259 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:25:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.387+0000 7f1146237700 1 Processor -- start 2023-09-29T23:25:49.387 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.387+0000 7f1146237700 1 -- start start 2023-09-29T23:25:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.388+0000 7f1146237700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f11400a0bd0 0x7f1140097fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.388+0000 7f1146237700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1140097cd0 con 0x7f1140097810 2023-09-29T23:25:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.388+0000 7f1146237700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f114009a860 con 0x7f11400a0bd0 2023-09-29T23:25:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.388+0000 7f1145235700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f11400a0bd0 0x7f1140097fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.388+0000 7f1144a34700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f1140097810 0x7f114012cd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:47650/0 (socket says 172.21.15.92:47650) 2023-09-29T23:25:49.389 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.388+0000 7f1144a34700 1 -- 172.21.15.92:0/3672493557 learned_addr learned my addr 172.21.15.92:0/3672493557 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:25:49.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.388+0000 7f1145235700 1 -- 172.21.15.92:0/3672493557 >> v1:172.21.15.92:6789/0 conn(0x7f1140097810 legacy=0x7f114012cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:49.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.388+0000 7f1145235700 1 -- 172.21.15.92:0/3672493557 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114009a3f0 con 0x7f11400a0bd0 2023-09-29T23:25:49.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.388+0000 7f1145235700 1 --2- 172.21.15.92:0/3672493557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11400a0bd0 0x7f1140097fe0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1138009860 tx=0x7f11380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d14313a3d0789e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.389+0000 7f113ffff700 1 -- 172.21.15.92:0/3672493557 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f113800b680 con 0x7f11400a0bd0 2023-09-29T23:25:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.389+0000 7f113ffff700 1 -- 172.21.15.92:0/3672493557 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113800b7e0 con 0x7f11400a0bd0 2023-09-29T23:25:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.389+0000 7f113ffff700 1 -- 172.21.15.92:0/3672493557 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f113800b990 con 0x7f11400a0bd0 2023-09-29T23:25:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.390+0000 7f1146237700 1 -- 172.21.15.92:0/3672493557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11400a0bd0 msgr2=0x7f1140097fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.390+0000 7f1146237700 1 --2- 172.21.15.92:0/3672493557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11400a0bd0 0x7f1140097fe0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1138009860 tx=0x7f11380091a0 comp rx=0 tx=0).stop 2023-09-29T23:25:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.390+0000 7f1146237700 1 -- 172.21.15.92:0/3672493557 shutdown_connections 2023-09-29T23:25:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.390+0000 7f1146237700 1 --2- 172.21.15.92:0/3672493557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11400a0bd0 0x7f1140097fe0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:49.393 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.390+0000 7f1146237700 1 -- 172.21.15.92:0/3672493557 >> 172.21.15.92:0/3672493557 conn(0x7f1140095510 msgr2=0x7f1140095910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.390+0000 7f1146237700 1 -- 172.21.15.92:0/3672493557 shutdown_connections 2023-09-29T23:25:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.390+0000 7f1146237700 1 -- 172.21.15.92:0/3672493557 wait complete. 2023-09-29T23:25:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.390+0000 7f1146237700 1 Processor -- start 2023-09-29T23:25:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.391+0000 7f1146237700 1 -- start start 2023-09-29T23:25:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.391+0000 7f1146237700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1140097810 0x7f114011cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.391+0000 7f1146237700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114012ca90 con 0x7f1140097810 2023-09-29T23:25:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.391+0000 7f1145235700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1140097810 0x7f114011cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.391+0000 7f1145235700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1140097810 0x7f114011cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47280/0 (socket says 172.21.15.92:47280) 2023-09-29T23:25:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.391+0000 7f1145235700 1 -- 172.21.15.92:0/2901950590 learned_addr learned my addr 172.21.15.92:0/2901950590 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:25:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.392+0000 7f1145235700 1 -- 172.21.15.92:0/2901950590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1138009420 con 0x7f1140097810 2023-09-29T23:25:49.394 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.392+0000 7f1145235700 1 --2- 172.21.15.92:0/2901950590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1140097810 0x7f114011cb30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1138000c00 tx=0x7f1138016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:49.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.392+0000 7f113d7fa700 1 -- 172.21.15.92:0/2901950590 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1138025470 con 0x7f1140097810 2023-09-29T23:25:49.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.392+0000 7f113d7fa700 1 -- 172.21.15.92:0/2901950590 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11380255d0 con 0x7f1140097810 2023-09-29T23:25:49.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.392+0000 7f1146237700 1 -- 172.21.15.92:0/2901950590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11401317b0 con 0x7f1140097810 2023-09-29T23:25:49.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.392+0000 7f113d7fa700 1 -- 172.21.15.92:0/2901950590 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1138025880 con 0x7f1140097810 2023-09-29T23:25:49.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.392+0000 7f1146237700 1 -- 172.21.15.92:0/2901950590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114011d210 con 0x7f1140097810 2023-09-29T23:25:49.395 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.393+0000 7f113d7fa700 1 -- 172.21.15.92:0/2901950590 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f1138022070 con 0x7f1140097810 2023-09-29T23:25:49.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.393+0000 7f113d7fa700 1 --2- 172.21.15.92:0/2901950590 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f112c035640 0x7f112c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:49.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.393+0000 7f113d7fa700 1 -- 172.21.15.92:0/2901950590 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f1138049690 con 0x7f1140097810 2023-09-29T23:25:49.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.393+0000 7f1146237700 1 -- 172.21.15.92:0/2901950590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114005f230 con 0x7f1140097810 2023-09-29T23:25:49.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.393+0000 7f1144a34700 1 --2- 172.21.15.92:0/2901950590 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f112c035640 0x7f112c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:49.396 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.393+0000 7f1144a34700 1 --2- 172.21.15.92:0/2901950590 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f112c035640 0x7f112c037af0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11340016a0 tx=0x7f1134007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:49.397 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.397+0000 7f113d7fa700 1 -- 172.21.15.92:0/2901950590 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f113801b470 con 0x7f1140097810 2023-09-29T23:25:49.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.618+0000 7f1146237700 1 -- 172.21.15.92:0/2901950590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f114004bb40 con 0x7f1140097810 2023-09-29T23:25:49.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.618+0000 7f113d7fa700 1 -- 172.21.15.92:0/2901950590 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f11380193b0 con 0x7f1140097810 2023-09-29T23:25:49.618 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:25:49.619 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:25:49.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.620+0000 7f1146237700 1 -- 172.21.15.92:0/2901950590 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f112c035640 msgr2=0x7f112c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:49.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.620+0000 7f1146237700 1 --2- 172.21.15.92:0/2901950590 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f112c035640 0x7f112c037af0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11340016a0 tx=0x7f1134007b30 comp rx=0 tx=0).stop 2023-09-29T23:25:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.620+0000 7f1146237700 1 -- 172.21.15.92:0/2901950590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1140097810 msgr2=0x7f114011cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.620+0000 7f1146237700 1 --2- 172.21.15.92:0/2901950590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1140097810 0x7f114011cb30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1138000c00 tx=0x7f1138016000 comp rx=0 tx=0).stop 2023-09-29T23:25:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.620+0000 7f1146237700 1 -- 172.21.15.92:0/2901950590 shutdown_connections 2023-09-29T23:25:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.620+0000 7f1146237700 1 --2- 172.21.15.92:0/2901950590 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f112c035640 0x7f112c037af0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.620+0000 7f1146237700 1 --2- 172.21.15.92:0/2901950590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1140097810 0x7f114011cb30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.620+0000 7f1146237700 1 -- 172.21.15.92:0/2901950590 >> 172.21.15.92:0/2901950590 conn(0x7f1140095510 msgr2=0x7f114012fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.620+0000 7f1146237700 1 -- 172.21.15.92:0/2901950590 shutdown_connections 2023-09-29T23:25:49.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:49.620+0000 7f1146237700 1 -- 172.21.15.92:0/2901950590 wait complete. 2023-09-29T23:25:52.632 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:25:52.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.752+0000 7f94806ac700 1 Processor -- start 2023-09-29T23:25:52.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.752+0000 7f94806ac700 1 -- start start 2023-09-29T23:25:52.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.753+0000 7f94806ac700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f94780a3030 0x7f947812f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:52.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.753+0000 7f94806ac700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94780997f0 con 0x7f947812fae0 2023-09-29T23:25:52.754 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.753+0000 7f94806ac700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94780a3400 con 0x7f94780a3030 2023-09-29T23:25:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.753+0000 7f947e448700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f94780a3030 0x7f947812f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.753+0000 7f947dc47700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f947812fae0 0x7f9478095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:45486/0 (socket says 172.21.15.92:45486) 2023-09-29T23:25:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.753+0000 7f947dc47700 1 -- 172.21.15.92:0/1927383123 learned_addr learned my addr 172.21.15.92:0/1927383123 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:25:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.753+0000 7f947e448700 1 -- 172.21.15.92:0/1927383123 >> v1:172.21.15.92:6789/0 conn(0x7f947812fae0 legacy=0x7f9478095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.753+0000 7f947e448700 1 -- 172.21.15.92:0/1927383123 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94780977a0 con 0x7f94780a3030 2023-09-29T23:25:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.753+0000 7f947e448700 1 --2- 172.21.15.92:0/1927383123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94780a3030 0x7f947812f5a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9474009860 tx=0x7f94740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280ad71d1f36b1c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.753+0000 7f947d446700 1 -- 172.21.15.92:0/1927383123 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f947400b710 con 0x7f94780a3030 2023-09-29T23:25:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.753+0000 7f947d446700 1 -- 172.21.15.92:0/1927383123 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947400b870 con 0x7f94780a3030 2023-09-29T23:25:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.753+0000 7f947d446700 1 -- 172.21.15.92:0/1927383123 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f947400ba20 con 0x7f94780a3030 2023-09-29T23:25:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.754+0000 7f94806ac700 1 -- 172.21.15.92:0/1927383123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94780a3030 msgr2=0x7f947812f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:52.755 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.754+0000 7f94806ac700 1 --2- 172.21.15.92:0/1927383123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94780a3030 0x7f947812f5a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9474009860 tx=0x7f94740091a0 comp rx=0 tx=0).stop 2023-09-29T23:25:52.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.754+0000 7f94806ac700 1 -- 172.21.15.92:0/1927383123 shutdown_connections 2023-09-29T23:25:52.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.754+0000 7f94806ac700 1 --2- 172.21.15.92:0/1927383123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94780a3030 0x7f947812f5a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:52.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.754+0000 7f94806ac700 1 -- 172.21.15.92:0/1927383123 >> 172.21.15.92:0/1927383123 conn(0x7f9478067fc0 msgr2=0x7f94780a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:52.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.754+0000 7f94806ac700 1 -- 172.21.15.92:0/1927383123 shutdown_connections 2023-09-29T23:25:52.756 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.754+0000 7f94806ac700 1 -- 172.21.15.92:0/1927383123 wait complete. 2023-09-29T23:25:52.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.755+0000 7f94806ac700 1 Processor -- start 2023-09-29T23:25:52.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.755+0000 7f94806ac700 1 -- start start 2023-09-29T23:25:52.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.755+0000 7f94806ac700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94780a3030 0x7f947812c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:52.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.755+0000 7f94806ac700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947811daa0 con 0x7f94780a3030 2023-09-29T23:25:52.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.755+0000 7f947e448700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94780a3030 0x7f947812c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:52.758 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.755+0000 7f947e448700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94780a3030 0x7f947812c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43498/0 (socket says 172.21.15.92:43498) 2023-09-29T23:25:52.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.755+0000 7f947e448700 1 -- 172.21.15.92:0/2296110671 learned_addr learned my addr 172.21.15.92:0/2296110671 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:25:52.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.756+0000 7f947e448700 1 -- 172.21.15.92:0/2296110671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9474009420 con 0x7f94780a3030 2023-09-29T23:25:52.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.756+0000 7f947e448700 1 --2- 172.21.15.92:0/2296110671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94780a3030 0x7f947812c400 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9474000c00 tx=0x7f9474016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:52.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.756+0000 7f946e7fc700 1 -- 172.21.15.92:0/2296110671 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9474024470 con 0x7f94780a3030 2023-09-29T23:25:52.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.756+0000 7f946e7fc700 1 -- 172.21.15.92:0/2296110671 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94740245d0 con 0x7f94780a3030 2023-09-29T23:25:52.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.756+0000 7f946e7fc700 1 -- 172.21.15.92:0/2296110671 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94740248a0 con 0x7f94780a3030 2023-09-29T23:25:52.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.756+0000 7f94806ac700 1 -- 172.21.15.92:0/2296110671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947811be40 con 0x7f94780a3030 2023-09-29T23:25:52.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.756+0000 7f94806ac700 1 -- 172.21.15.92:0/2296110671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947811c6a0 con 0x7f94780a3030 2023-09-29T23:25:52.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.757+0000 7f946e7fc700 1 -- 172.21.15.92:0/2296110671 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f9474021070 con 0x7f94780a3030 2023-09-29T23:25:52.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.757+0000 7f946e7fc700 1 --2- 172.21.15.92:0/2296110671 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f945c035640 0x7f945c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:52.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.757+0000 7f94806ac700 1 -- 172.21.15.92:0/2296110671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947811bcb0 con 0x7f94780a3030 2023-09-29T23:25:52.759 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.757+0000 7f946e7fc700 1 -- 172.21.15.92:0/2296110671 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f9474049470 con 0x7f94780a3030 2023-09-29T23:25:52.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.757+0000 7f947dc47700 1 --2- 172.21.15.92:0/2296110671 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f945c035640 0x7f945c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:52.760 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.757+0000 7f947dc47700 1 --2- 172.21.15.92:0/2296110671 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f945c035640 0x7f945c037af0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f94680016a0 tx=0x7f9468007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:52.761 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.761+0000 7f946e7fc700 1 -- 172.21.15.92:0/2296110671 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94740239c0 con 0x7f94780a3030 2023-09-29T23:25:52.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.984+0000 7f94806ac700 1 -- 172.21.15.92:0/2296110671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f947805f230 con 0x7f94780a3030 2023-09-29T23:25:52.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.984+0000 7f946e7fc700 1 -- 172.21.15.92:0/2296110671 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f9474024a00 con 0x7f94780a3030 2023-09-29T23:25:52.985 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:25:52.985 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:25:52.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.986+0000 7f94806ac700 1 -- 172.21.15.92:0/2296110671 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f945c035640 msgr2=0x7f945c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:52.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.986+0000 7f94806ac700 1 --2- 172.21.15.92:0/2296110671 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f945c035640 0x7f945c037af0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f94680016a0 tx=0x7f9468007b30 comp rx=0 tx=0).stop 2023-09-29T23:25:52.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.986+0000 7f94806ac700 1 -- 172.21.15.92:0/2296110671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94780a3030 msgr2=0x7f947812c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:52.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.986+0000 7f94806ac700 1 --2- 172.21.15.92:0/2296110671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94780a3030 0x7f947812c400 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9474000c00 tx=0x7f9474016000 comp rx=0 tx=0).stop 2023-09-29T23:25:52.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.986+0000 7f94806ac700 1 -- 172.21.15.92:0/2296110671 shutdown_connections 2023-09-29T23:25:52.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.986+0000 7f94806ac700 1 --2- 172.21.15.92:0/2296110671 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f945c035640 0x7f945c037af0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:52.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.986+0000 7f94806ac700 1 --2- 172.21.15.92:0/2296110671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94780a3030 0x7f947812c400 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:52.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.987+0000 7f94806ac700 1 -- 172.21.15.92:0/2296110671 >> 172.21.15.92:0/2296110671 conn(0x7f9478067fc0 msgr2=0x7f947812d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:52.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.987+0000 7f94806ac700 1 -- 172.21.15.92:0/2296110671 shutdown_connections 2023-09-29T23:25:52.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:52.987+0000 7f94806ac700 1 -- 172.21.15.92:0/2296110671 wait complete. 2023-09-29T23:25:55.999 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:25:56.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.125+0000 7f2a91253700 1 Processor -- start 2023-09-29T23:25:56.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.125+0000 7f2a91253700 1 -- start start 2023-09-29T23:25:56.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.125+0000 7f2a91253700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2a8c094fd0 0x7f2a8c0953a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:56.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.125+0000 7f2a91253700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a8c06f700 con 0x7f2a8c0958e0 2023-09-29T23:25:56.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.125+0000 7f2a91253700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8c099e30 con 0x7f2a8c094fd0 2023-09-29T23:25:56.127 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.126+0000 7f2a8bfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2a8c094fd0 0x7f2a8c0953a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:56.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.126+0000 7f2a8b7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f2a8c0958e0 0x7f2a8c131430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:45494/0 (socket says 172.21.15.92:45494) 2023-09-29T23:25:56.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.126+0000 7f2a8b7fe700 1 -- 172.21.15.92:0/1663632646 learned_addr learned my addr 172.21.15.92:0/1663632646 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:25:56.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.126+0000 7f2a8affd700 1 -- 172.21.15.92:0/1663632646 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807499689 0 0) 0x7f2a8c06f700 con 0x7f2a8c0958e0 2023-09-29T23:25:56.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.126+0000 7f2a8affd700 1 -- 172.21.15.92:0/1663632646 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a74003570 con 0x7f2a8c0958e0 2023-09-29T23:25:56.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.126+0000 7f2a8bfff700 1 -- 172.21.15.92:0/1663632646 >> v1:172.21.15.92:6789/0 conn(0x7f2a8c0958e0 legacy=0x7f2a8c131430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:56.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.126+0000 7f2a8bfff700 1 -- 172.21.15.92:0/1663632646 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8c09f1d0 con 0x7f2a8c094fd0 2023-09-29T23:25:56.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.126+0000 7f2a8bfff700 1 --2- 172.21.15.92:0/1663632646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a8c094fd0 0x7f2a8c0953a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009850 tx=0x7f2a7c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5bd5de84fd7114 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:56.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.126+0000 7f2a8affd700 1 -- 172.21.15.92:0/1663632646 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a7c005c10 con 0x7f2a8c094fd0 2023-09-29T23:25:56.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.126+0000 7f2a8affd700 1 -- 172.21.15.92:0/1663632646 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c005d70 con 0x7f2a8c094fd0 2023-09-29T23:25:56.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.126+0000 7f2a8affd700 1 -- 172.21.15.92:0/1663632646 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a7c006190 con 0x7f2a8c094fd0 2023-09-29T23:25:56.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.127+0000 7f2a91253700 1 -- 172.21.15.92:0/1663632646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a8c094fd0 msgr2=0x7f2a8c0953a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:56.128 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.127+0000 7f2a91253700 1 --2- 172.21.15.92:0/1663632646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a8c094fd0 0x7f2a8c0953a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009850 tx=0x7f2a7c009120 comp rx=0 tx=0).stop 2023-09-29T23:25:56.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.127+0000 7f2a91253700 1 -- 172.21.15.92:0/1663632646 shutdown_connections 2023-09-29T23:25:56.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.127+0000 7f2a91253700 1 --2- 172.21.15.92:0/1663632646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a8c094fd0 0x7f2a8c0953a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:56.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.127+0000 7f2a91253700 1 -- 172.21.15.92:0/1663632646 >> 172.21.15.92:0/1663632646 conn(0x7f2a8c06b270 msgr2=0x7f2a8c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:56.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.127+0000 7f2a91253700 1 -- 172.21.15.92:0/1663632646 shutdown_connections 2023-09-29T23:25:56.129 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.127+0000 7f2a91253700 1 -- 172.21.15.92:0/1663632646 wait complete. 2023-09-29T23:25:56.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.127+0000 7f2a91253700 1 Processor -- start 2023-09-29T23:25:56.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.128+0000 7f2a91253700 1 -- start start 2023-09-29T23:25:56.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.128+0000 7f2a91253700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a8c094fd0 0x7f2a8c13e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:56.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.128+0000 7f2a91253700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c092990 con 0x7f2a8c094fd0 2023-09-29T23:25:56.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.128+0000 7f2a8bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a8c094fd0 0x7f2a8c13e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:56.131 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.128+0000 7f2a8bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a8c094fd0 0x7f2a8c13e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43518/0 (socket says 172.21.15.92:43518) 2023-09-29T23:25:56.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.128+0000 7f2a8bfff700 1 -- 172.21.15.92:0/1745008274 learned_addr learned my addr 172.21.15.92:0/1745008274 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:25:56.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.128+0000 7f2a8bfff700 1 -- 172.21.15.92:0/1745008274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c0093c0 con 0x7f2a8c094fd0 2023-09-29T23:25:56.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.129+0000 7f2a8bfff700 1 --2- 172.21.15.92:0/1745008274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a8c094fd0 0x7f2a8c13e520 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c006e50 tx=0x7f2a7c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:56.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.129+0000 7f2a73fff700 1 -- 172.21.15.92:0/1745008274 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a7c0063d0 con 0x7f2a8c094fd0 2023-09-29T23:25:56.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.129+0000 7f2a73fff700 1 -- 172.21.15.92:0/1745008274 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c006550 con 0x7f2a8c094fd0 2023-09-29T23:25:56.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.129+0000 7f2a91253700 1 -- 172.21.15.92:0/1745008274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8c092c30 con 0x7f2a8c094fd0 2023-09-29T23:25:56.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.129+0000 7f2a73fff700 1 -- 172.21.15.92:0/1745008274 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a7c006700 con 0x7f2a8c094fd0 2023-09-29T23:25:56.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.129+0000 7f2a91253700 1 -- 172.21.15.92:0/1745008274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8c091590 con 0x7f2a8c094fd0 2023-09-29T23:25:56.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.129+0000 7f2a73fff700 1 -- 172.21.15.92:0/1745008274 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f2a7c01d430 con 0x7f2a8c094fd0 2023-09-29T23:25:56.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.130+0000 7f2a91253700 1 -- 172.21.15.92:0/1745008274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a8c05f230 con 0x7f2a8c094fd0 2023-09-29T23:25:56.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.130+0000 7f2a73fff700 1 --2- 172.21.15.92:0/1745008274 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2a78035640 0x7f2a78037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:56.132 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.130+0000 7f2a73fff700 1 -- 172.21.15.92:0/1745008274 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f2a7c0490c0 con 0x7f2a8c094fd0 2023-09-29T23:25:56.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.130+0000 7f2a8b7fe700 1 --2- 172.21.15.92:0/1745008274 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2a78035640 0x7f2a78037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:56.133 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.130+0000 7f2a8b7fe700 1 --2- 172.21.15.92:0/1745008274 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2a78035640 0x7f2a78037af0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2a800058d0 tx=0x7f2a800079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:56.134 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.134+0000 7f2a73fff700 1 -- 172.21.15.92:0/1745008274 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a7c010380 con 0x7f2a8c094fd0 2023-09-29T23:25:56.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.359+0000 7f2a91253700 1 -- 172.21.15.92:0/1745008274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2a8c04bb40 con 0x7f2a8c094fd0 2023-09-29T23:25:56.360 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.360+0000 7f2a73fff700 1 -- 172.21.15.92:0/1745008274 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f2a7c024b60 con 0x7f2a8c094fd0 2023-09-29T23:25:56.360 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:25:56.360 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:25:56.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.361+0000 7f2a91253700 1 -- 172.21.15.92:0/1745008274 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2a78035640 msgr2=0x7f2a78037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:56.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.361+0000 7f2a91253700 1 --2- 172.21.15.92:0/1745008274 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2a78035640 0x7f2a78037af0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2a800058d0 tx=0x7f2a800079d0 comp rx=0 tx=0).stop 2023-09-29T23:25:56.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.361+0000 7f2a91253700 1 -- 172.21.15.92:0/1745008274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a8c094fd0 msgr2=0x7f2a8c13e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:56.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.361+0000 7f2a91253700 1 --2- 172.21.15.92:0/1745008274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a8c094fd0 0x7f2a8c13e520 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c006e50 tx=0x7f2a7c015000 comp rx=0 tx=0).stop 2023-09-29T23:25:56.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.362+0000 7f2a91253700 1 -- 172.21.15.92:0/1745008274 shutdown_connections 2023-09-29T23:25:56.362 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.362+0000 7f2a91253700 1 --2- 172.21.15.92:0/1745008274 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2a78035640 0x7f2a78037af0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:56.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.362+0000 7f2a91253700 1 --2- 172.21.15.92:0/1745008274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a8c094fd0 0x7f2a8c13e520 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:56.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.362+0000 7f2a91253700 1 -- 172.21.15.92:0/1745008274 >> 172.21.15.92:0/1745008274 conn(0x7f2a8c06b270 msgr2=0x7f2a8c06cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:56.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.362+0000 7f2a91253700 1 -- 172.21.15.92:0/1745008274 shutdown_connections 2023-09-29T23:25:56.363 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:56.362+0000 7f2a91253700 1 -- 172.21.15.92:0/1745008274 wait complete. 2023-09-29T23:25:59.374 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:25:59.497 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.495+0000 7fe7b1a88700 1 Processor -- start 2023-09-29T23:25:59.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.495+0000 7fe7b1a88700 1 -- start start 2023-09-29T23:25:59.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.496+0000 7fe7b1a88700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe7ac09c600 0x7fe7ac0a3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:59.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.496+0000 7fe7b1a88700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7ac098320 con 0x7fe7ac12bc80 2023-09-29T23:25:59.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.496+0000 7fe7b1a88700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7ac09c9d0 con 0x7fe7ac09c600 2023-09-29T23:25:59.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.496+0000 7fe7b0a86700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe7ac09c600 0x7fe7ac0a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:59.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.496+0000 7fe7abfff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fe7ac12bc80 0x7fe7ac12f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:45498/0 (socket says 172.21.15.92:45498) 2023-09-29T23:25:59.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.496+0000 7fe7abfff700 1 -- 172.21.15.92:0/3147719331 learned_addr learned my addr 172.21.15.92:0/3147719331 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:25:59.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.496+0000 7fe7b0a86700 1 -- 172.21.15.92:0/3147719331 >> v1:172.21.15.92:6789/0 conn(0x7fe7ac12bc80 legacy=0x7fe7ac12f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:59.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.496+0000 7fe7b0a86700 1 -- 172.21.15.92:0/3147719331 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac12c620 con 0x7fe7ac09c600 2023-09-29T23:25:59.498 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.496+0000 7fe7b0a86700 1 --2- 172.21.15.92:0/3147719331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7ac09c600 0x7fe7ac0a3030 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe794009860 tx=0x7fe7940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd8d2eff4a0266b server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:59.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.496+0000 7fe7ab7fe700 1 -- 172.21.15.92:0/3147719331 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe79400b680 con 0x7fe7ac09c600 2023-09-29T23:25:59.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.496+0000 7fe7ab7fe700 1 -- 172.21.15.92:0/3147719331 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79400b7e0 con 0x7fe7ac09c600 2023-09-29T23:25:59.499 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.496+0000 7fe7ab7fe700 1 -- 172.21.15.92:0/3147719331 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe79400bad0 con 0x7fe7ac09c600 2023-09-29T23:25:59.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.497+0000 7fe7b1a88700 1 -- 172.21.15.92:0/3147719331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7ac09c600 msgr2=0x7fe7ac0a3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:59.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.497+0000 7fe7b1a88700 1 --2- 172.21.15.92:0/3147719331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7ac09c600 0x7fe7ac0a3030 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe794009860 tx=0x7fe7940091a0 comp rx=0 tx=0).stop 2023-09-29T23:25:59.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.497+0000 7fe7b1a88700 1 -- 172.21.15.92:0/3147719331 shutdown_connections 2023-09-29T23:25:59.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.497+0000 7fe7b1a88700 1 --2- 172.21.15.92:0/3147719331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7ac09c600 0x7fe7ac0a3030 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:59.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.497+0000 7fe7b1a88700 1 -- 172.21.15.92:0/3147719331 >> 172.21.15.92:0/3147719331 conn(0x7fe7ac068080 msgr2=0x7fe7ac096a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:59.501 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.497+0000 7fe7b1a88700 1 -- 172.21.15.92:0/3147719331 shutdown_connections 2023-09-29T23:25:59.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.497+0000 7fe7b1a88700 1 -- 172.21.15.92:0/3147719331 wait complete. 2023-09-29T23:25:59.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.498+0000 7fe7b1a88700 1 Processor -- start 2023-09-29T23:25:59.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.498+0000 7fe7b1a88700 1 -- start start 2023-09-29T23:25:59.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.498+0000 7fe7b1a88700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7ac09c600 0x7fe7ac1198e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:59.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.498+0000 7fe7b1a88700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac11ac60 con 0x7fe7ac09c600 2023-09-29T23:25:59.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.498+0000 7fe7b0a86700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7ac09c600 0x7fe7ac1198e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:59.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.498+0000 7fe7b0a86700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7ac09c600 0x7fe7ac1198e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43538/0 (socket says 172.21.15.92:43538) 2023-09-29T23:25:59.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.498+0000 7fe7b0a86700 1 -- 172.21.15.92:0/27860338 learned_addr learned my addr 172.21.15.92:0/27860338 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:25:59.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.499+0000 7fe7b0a86700 1 -- 172.21.15.92:0/27860338 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe794009420 con 0x7fe7ac09c600 2023-09-29T23:25:59.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.499+0000 7fe7b0a86700 1 --2- 172.21.15.92:0/27860338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7ac09c600 0x7fe7ac1198e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe794000c00 tx=0x7fe794016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:59.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.499+0000 7fe7a8ff9700 1 -- 172.21.15.92:0/27860338 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe794024470 con 0x7fe7ac09c600 2023-09-29T23:25:59.502 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.499+0000 7fe7a8ff9700 1 -- 172.21.15.92:0/27860338 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7940245d0 con 0x7fe7ac09c600 2023-09-29T23:25:59.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.499+0000 7fe7a8ff9700 1 -- 172.21.15.92:0/27860338 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe794024880 con 0x7fe7ac09c600 2023-09-29T23:25:59.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.499+0000 7fe7b1a88700 1 -- 172.21.15.92:0/27860338 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ac11c600 con 0x7fe7ac09c600 2023-09-29T23:25:59.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.499+0000 7fe7b1a88700 1 -- 172.21.15.92:0/27860338 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7ac11d4a0 con 0x7fe7ac09c600 2023-09-29T23:25:59.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.500+0000 7fe7a8ff9700 1 -- 172.21.15.92:0/27860338 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fe794021070 con 0x7fe7ac09c600 2023-09-29T23:25:59.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.500+0000 7fe7b1a88700 1 -- 172.21.15.92:0/27860338 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7ac068b80 con 0x7fe7ac09c600 2023-09-29T23:25:59.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.500+0000 7fe7a8ff9700 1 --2- 172.21.15.92:0/27860338 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fe78c035640 0x7fe78c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:25:59.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.500+0000 7fe7a8ff9700 1 -- 172.21.15.92:0/27860338 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fe794049270 con 0x7fe7ac09c600 2023-09-29T23:25:59.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.500+0000 7fe7abfff700 1 --2- 172.21.15.92:0/27860338 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fe78c035640 0x7fe78c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:25:59.503 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.500+0000 7fe7abfff700 1 --2- 172.21.15.92:0/27860338 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fe78c035640 0x7fe78c037af0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe79c007fd0 tx=0x7fe79c007b90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:25:59.506 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.505+0000 7fe7a8ff9700 1 -- 172.21.15.92:0/27860338 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe79401a460 con 0x7fe7ac09c600 2023-09-29T23:25:59.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.726+0000 7fe7b1a88700 1 -- 172.21.15.92:0/27860338 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe7ac05f230 con 0x7fe7ac09c600 2023-09-29T23:25:59.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.726+0000 7fe7a8ff9700 1 -- 172.21.15.92:0/27860338 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fe79402c3a0 con 0x7fe7ac09c600 2023-09-29T23:25:59.728 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:25:59.728 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:25:59.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.728+0000 7fe7b1a88700 1 -- 172.21.15.92:0/27860338 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fe78c035640 msgr2=0x7fe78c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:59.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.728+0000 7fe7b1a88700 1 --2- 172.21.15.92:0/27860338 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fe78c035640 0x7fe78c037af0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe79c007fd0 tx=0x7fe79c007b90 comp rx=0 tx=0).stop 2023-09-29T23:25:59.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.728+0000 7fe7b1a88700 1 -- 172.21.15.92:0/27860338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7ac09c600 msgr2=0x7fe7ac1198e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:25:59.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.728+0000 7fe7b1a88700 1 --2- 172.21.15.92:0/27860338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7ac09c600 0x7fe7ac1198e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe794000c00 tx=0x7fe794016000 comp rx=0 tx=0).stop 2023-09-29T23:25:59.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.728+0000 7fe7b1a88700 1 -- 172.21.15.92:0/27860338 shutdown_connections 2023-09-29T23:25:59.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.728+0000 7fe7b1a88700 1 --2- 172.21.15.92:0/27860338 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fe78c035640 0x7fe78c037af0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:59.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.728+0000 7fe7b1a88700 1 --2- 172.21.15.92:0/27860338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7ac09c600 0x7fe7ac1198e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:25:59.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.728+0000 7fe7b1a88700 1 -- 172.21.15.92:0/27860338 >> 172.21.15.92:0/27860338 conn(0x7fe7ac068080 msgr2=0x7fe7ac096340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:25:59.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.728+0000 7fe7b1a88700 1 -- 172.21.15.92:0/27860338 shutdown_connections 2023-09-29T23:25:59.730 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:25:59.728+0000 7fe7b1a88700 1 -- 172.21.15.92:0/27860338 wait complete. 2023-09-29T23:26:02.742 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:26:02.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.863+0000 7f12c2cde700 1 Processor -- start 2023-09-29T23:26:02.865 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.863+0000 7f12c2cde700 1 -- start start 2023-09-29T23:26:02.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.864+0000 7f12c2cde700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f12bc0a3030 0x7f12bc12f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:02.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.864+0000 7f12c2cde700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12bc0997f0 con 0x7f12bc12fae0 2023-09-29T23:26:02.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.864+0000 7f12c2cde700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12bc0a3400 con 0x7f12bc0a3030 2023-09-29T23:26:02.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.864+0000 7f12c0a7a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f12bc0a3030 0x7f12bc12f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:02.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.864+0000 7f12bbfff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f12bc12fae0 0x7f12bc095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:42364/0 (socket says 172.21.15.92:42364) 2023-09-29T23:26:02.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.864+0000 7f12bbfff700 1 -- 172.21.15.92:0/1665612425 learned_addr learned my addr 172.21.15.92:0/1665612425 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:26:02.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.864+0000 7f12c0a7a700 1 -- 172.21.15.92:0/1665612425 >> v1:172.21.15.92:6789/0 conn(0x7f12bc12fae0 legacy=0x7f12bc095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:02.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.864+0000 7f12c0a7a700 1 -- 172.21.15.92:0/1665612425 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc0977a0 con 0x7f12bc0a3030 2023-09-29T23:26:02.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.864+0000 7f12bb7fe700 1 -- 172.21.15.92:0/1665612425 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919183166 0 0) 0x7f12bc0997f0 con 0x7f12bc12fae0 2023-09-29T23:26:02.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.864+0000 7f12c0a7a700 1 --2- 172.21.15.92:0/1665612425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12bc0a3030 0x7f12bc12f5a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009860 tx=0x7f12ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a1e8a832dcf55d server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:02.866 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.864+0000 7f12bb7fe700 1 -- 172.21.15.92:0/1665612425 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12ac00b710 con 0x7f12bc0a3030 2023-09-29T23:26:02.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.864+0000 7f12bb7fe700 1 -- 172.21.15.92:0/1665612425 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac00b870 con 0x7f12bc0a3030 2023-09-29T23:26:02.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.864+0000 7f12bb7fe700 1 -- 172.21.15.92:0/1665612425 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12ac00ba20 con 0x7f12bc0a3030 2023-09-29T23:26:02.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.865+0000 7f12c2cde700 1 -- 172.21.15.92:0/1665612425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12bc0a3030 msgr2=0x7f12bc12f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:02.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.865+0000 7f12c2cde700 1 --2- 172.21.15.92:0/1665612425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12bc0a3030 0x7f12bc12f5a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009860 tx=0x7f12ac0091a0 comp rx=0 tx=0).stop 2023-09-29T23:26:02.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.865+0000 7f12c2cde700 1 -- 172.21.15.92:0/1665612425 shutdown_connections 2023-09-29T23:26:02.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.865+0000 7f12c2cde700 1 --2- 172.21.15.92:0/1665612425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12bc0a3030 0x7f12bc12f5a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:02.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.865+0000 7f12c2cde700 1 -- 172.21.15.92:0/1665612425 >> 172.21.15.92:0/1665612425 conn(0x7f12bc067fc0 msgr2=0x7f12bc0a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:02.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.865+0000 7f12c2cde700 1 -- 172.21.15.92:0/1665612425 shutdown_connections 2023-09-29T23:26:02.867 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.865+0000 7f12c2cde700 1 -- 172.21.15.92:0/1665612425 wait complete. 2023-09-29T23:26:02.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.866+0000 7f12c2cde700 1 Processor -- start 2023-09-29T23:26:02.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.866+0000 7f12c2cde700 1 -- start start 2023-09-29T23:26:02.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.866+0000 7f12c2cde700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12bc0a3030 0x7f12bc13e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:02.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.866+0000 7f12c2cde700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc11d1f0 con 0x7f12bc0a3030 2023-09-29T23:26:02.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.866+0000 7f12c0a7a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12bc0a3030 0x7f12bc13e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:02.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.866+0000 7f12c0a7a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12bc0a3030 0x7f12bc13e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60288/0 (socket says 172.21.15.92:60288) 2023-09-29T23:26:02.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.866+0000 7f12c0a7a700 1 -- 172.21.15.92:0/1000085519 learned_addr learned my addr 172.21.15.92:0/1000085519 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:02.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.867+0000 7f12c0a7a700 1 -- 172.21.15.92:0/1000085519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac009420 con 0x7f12bc0a3030 2023-09-29T23:26:02.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.867+0000 7f12c0a7a700 1 --2- 172.21.15.92:0/1000085519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12bc0a3030 0x7f12bc13e4d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0093f0 tx=0x7f12ac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:02.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.867+0000 7f12b8ff9700 1 -- 172.21.15.92:0/1000085519 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12ac01c450 con 0x7f12bc0a3030 2023-09-29T23:26:02.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.867+0000 7f12b8ff9700 1 -- 172.21.15.92:0/1000085519 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac01c5b0 con 0x7f12bc0a3030 2023-09-29T23:26:02.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.867+0000 7f12c2cde700 1 -- 172.21.15.92:0/1000085519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12bc12ce00 con 0x7f12bc0a3030 2023-09-29T23:26:02.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.867+0000 7f12b8ff9700 1 -- 172.21.15.92:0/1000085519 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12ac01c8a0 con 0x7f12bc0a3030 2023-09-29T23:26:02.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.867+0000 7f12c2cde700 1 -- 172.21.15.92:0/1000085519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12bc11e630 con 0x7f12bc0a3030 2023-09-29T23:26:02.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.868+0000 7f12b8ff9700 1 -- 172.21.15.92:0/1000085519 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f12ac01cb10 con 0x7f12bc0a3030 2023-09-29T23:26:02.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.868+0000 7f12c2cde700 1 -- 172.21.15.92:0/1000085519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12bc11d060 con 0x7f12bc0a3030 2023-09-29T23:26:02.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.868+0000 7f12b8ff9700 1 --2- 172.21.15.92:0/1000085519 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f129c035640 0x7f129c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:02.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.868+0000 7f12b8ff9700 1 -- 172.21.15.92:0/1000085519 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f12ac049620 con 0x7f12bc0a3030 2023-09-29T23:26:02.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.868+0000 7f12bbfff700 1 --2- 172.21.15.92:0/1000085519 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f129c035640 0x7f129c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:02.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.868+0000 7f12bbfff700 1 --2- 172.21.15.92:0/1000085519 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f129c035640 0x7f129c037af0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f12a40011e0 tx=0x7f12a40079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:02.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:02.872+0000 7f12b8ff9700 1 -- 172.21.15.92:0/1000085519 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12ac02d350 con 0x7f12bc0a3030 2023-09-29T23:26:03.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:03.096+0000 7f12c2cde700 1 -- 172.21.15.92:0/1000085519 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f12bc097d10 con 0x7f12bc0a3030 2023-09-29T23:26:03.096 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:03.096+0000 7f12b8ff9700 1 -- 172.21.15.92:0/1000085519 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f12ac01abc0 con 0x7f12bc0a3030 2023-09-29T23:26:03.096 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:26:03.097 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:26:03.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:03.098+0000 7f12c2cde700 1 -- 172.21.15.92:0/1000085519 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f129c035640 msgr2=0x7f129c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:03.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:03.098+0000 7f12c2cde700 1 --2- 172.21.15.92:0/1000085519 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f129c035640 0x7f129c037af0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f12a40011e0 tx=0x7f12a40079d0 comp rx=0 tx=0).stop 2023-09-29T23:26:03.098 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:03.098+0000 7f12c2cde700 1 -- 172.21.15.92:0/1000085519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12bc0a3030 msgr2=0x7f12bc13e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:03.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:03.098+0000 7f12c2cde700 1 --2- 172.21.15.92:0/1000085519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12bc0a3030 0x7f12bc13e4d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0093f0 tx=0x7f12ac016000 comp rx=0 tx=0).stop 2023-09-29T23:26:03.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:03.098+0000 7f12c2cde700 1 -- 172.21.15.92:0/1000085519 shutdown_connections 2023-09-29T23:26:03.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:03.098+0000 7f12c2cde700 1 --2- 172.21.15.92:0/1000085519 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f129c035640 0x7f129c037af0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:03.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:03.098+0000 7f12c2cde700 1 --2- 172.21.15.92:0/1000085519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12bc0a3030 0x7f12bc13e4d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:03.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:03.098+0000 7f12c2cde700 1 -- 172.21.15.92:0/1000085519 >> 172.21.15.92:0/1000085519 conn(0x7f12bc067fc0 msgr2=0x7f12bc12d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:03.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:03.098+0000 7f12c2cde700 1 -- 172.21.15.92:0/1000085519 shutdown_connections 2023-09-29T23:26:03.099 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:03.098+0000 7f12c2cde700 1 -- 172.21.15.92:0/1000085519 wait complete. 2023-09-29T23:26:06.110 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:26:06.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.230+0000 7fa45359e700 1 Processor -- start 2023-09-29T23:26:06.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.230+0000 7fa45359e700 1 -- start start 2023-09-29T23:26:06.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.230+0000 7fa45359e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa45412c8b0 0x7fa454134400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:06.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.230+0000 7fa45359e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4540685e0 con 0x7fa454067eb0 2023-09-29T23:26:06.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.230+0000 7fa45359e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa454068280 con 0x7fa45412c8b0 2023-09-29T23:26:06.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.231+0000 7fa44bfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa45412c8b0 0x7fa454134400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:06.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.231+0000 7fa45259c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fa454067eb0 0x7fa45412c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:42374/0 (socket says 172.21.15.92:42374) 2023-09-29T23:26:06.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.231+0000 7fa45259c700 1 -- 172.21.15.92:0/3372075579 learned_addr learned my addr 172.21.15.92:0/3372075579 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:26:06.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.231+0000 7fa44bfff700 1 -- 172.21.15.92:0/3372075579 >> v1:172.21.15.92:6789/0 conn(0x7fa454067eb0 legacy=0x7fa45412c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:06.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.231+0000 7fa451d9b700 1 -- 172.21.15.92:0/3372075579 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846417810 0 0) 0x7fa4540685e0 con 0x7fa454067eb0 2023-09-29T23:26:06.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.231+0000 7fa44bfff700 1 -- 172.21.15.92:0/3372075579 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45412cce0 con 0x7fa45412c8b0 2023-09-29T23:26:06.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.231+0000 7fa44bfff700 1 --2- 172.21.15.92:0/3372075579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa45412c8b0 0x7fa454134400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009860 tx=0x7fa43c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e619457971efeca server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:06.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.231+0000 7fa451d9b700 1 -- 172.21.15.92:0/3372075579 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa43c00b680 con 0x7fa45412c8b0 2023-09-29T23:26:06.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.231+0000 7fa451d9b700 1 -- 172.21.15.92:0/3372075579 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c00b7e0 con 0x7fa45412c8b0 2023-09-29T23:26:06.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.231+0000 7fa451d9b700 1 -- 172.21.15.92:0/3372075579 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa43c00bad0 con 0x7fa45412c8b0 2023-09-29T23:26:06.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.232+0000 7fa45359e700 1 -- 172.21.15.92:0/3372075579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa45412c8b0 msgr2=0x7fa454134400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:06.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.232+0000 7fa45359e700 1 --2- 172.21.15.92:0/3372075579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa45412c8b0 0x7fa454134400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009860 tx=0x7fa43c0091a0 comp rx=0 tx=0).stop 2023-09-29T23:26:06.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.232+0000 7fa45359e700 1 -- 172.21.15.92:0/3372075579 shutdown_connections 2023-09-29T23:26:06.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.232+0000 7fa45359e700 1 --2- 172.21.15.92:0/3372075579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa45412c8b0 0x7fa454134400 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:06.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.232+0000 7fa45359e700 1 -- 172.21.15.92:0/3372075579 >> 172.21.15.92:0/3372075579 conn(0x7fa454094df0 msgr2=0x7fa45406d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:06.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.232+0000 7fa45359e700 1 -- 172.21.15.92:0/3372075579 shutdown_connections 2023-09-29T23:26:06.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.232+0000 7fa45359e700 1 -- 172.21.15.92:0/3372075579 wait complete. 2023-09-29T23:26:06.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.233+0000 7fa45359e700 1 Processor -- start 2023-09-29T23:26:06.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.233+0000 7fa45359e700 1 -- start start 2023-09-29T23:26:06.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.233+0000 7fa45359e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa454067eb0 0x7fa454117b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:06.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.233+0000 7fa45359e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45411b600 con 0x7fa454067eb0 2023-09-29T23:26:06.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.233+0000 7fa45259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa454067eb0 0x7fa454117b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:06.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.233+0000 7fa45259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa454067eb0 0x7fa454117b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60300/0 (socket says 172.21.15.92:60300) 2023-09-29T23:26:06.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.233+0000 7fa45259c700 1 -- 172.21.15.92:0/2832879352 learned_addr learned my addr 172.21.15.92:0/2832879352 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:06.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.233+0000 7fa45259c700 1 -- 172.21.15.92:0/2832879352 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c009420 con 0x7fa454067eb0 2023-09-29T23:26:06.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.233+0000 7fa45259c700 1 --2- 172.21.15.92:0/2832879352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa454067eb0 0x7fa454117b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa44400c460 tx=0x7fa444000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:06.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.234+0000 7fa44a7fc700 1 -- 172.21.15.92:0/2832879352 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa444005b30 con 0x7fa454067eb0 2023-09-29T23:26:06.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.234+0000 7fa44a7fc700 1 -- 172.21.15.92:0/2832879352 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa444005c90 con 0x7fa454067eb0 2023-09-29T23:26:06.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.234+0000 7fa45359e700 1 -- 172.21.15.92:0/2832879352 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa454129ab0 con 0x7fa454067eb0 2023-09-29T23:26:06.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.234+0000 7fa44a7fc700 1 -- 172.21.15.92:0/2832879352 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4440070d0 con 0x7fa454067eb0 2023-09-29T23:26:06.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.234+0000 7fa45359e700 1 -- 172.21.15.92:0/2832879352 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4541196d0 con 0x7fa454067eb0 2023-09-29T23:26:06.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.235+0000 7fa44a7fc700 1 -- 172.21.15.92:0/2832879352 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fa444007230 con 0x7fa454067eb0 2023-09-29T23:26:06.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.235+0000 7fa45359e700 1 -- 172.21.15.92:0/2832879352 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45409cee0 con 0x7fa454067eb0 2023-09-29T23:26:06.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.235+0000 7fa44a7fc700 1 --2- 172.21.15.92:0/2832879352 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa434035630 0x7fa434037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:06.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.235+0000 7fa44a7fc700 1 -- 172.21.15.92:0/2832879352 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fa444046a00 con 0x7fa454067eb0 2023-09-29T23:26:06.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.235+0000 7fa44bfff700 1 --2- 172.21.15.92:0/2832879352 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa434035630 0x7fa434037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:06.237 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.235+0000 7fa44bfff700 1 --2- 172.21.15.92:0/2832879352 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa434035630 0x7fa434037ae0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa43c006eb0 tx=0x7fa43c016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:06.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.239+0000 7fa44a7fc700 1 -- 172.21.15.92:0/2832879352 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa444018ac0 con 0x7fa454067eb0 2023-09-29T23:26:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.461+0000 7fa45359e700 1 -- 172.21.15.92:0/2832879352 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa45405f230 con 0x7fa454067eb0 2023-09-29T23:26:06.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.462+0000 7fa44a7fc700 1 -- 172.21.15.92:0/2832879352 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fa444017020 con 0x7fa454067eb0 2023-09-29T23:26:06.462 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:26:06.463 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:26:06.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.464+0000 7fa45359e700 1 -- 172.21.15.92:0/2832879352 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa434035630 msgr2=0x7fa434037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:06.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.464+0000 7fa45359e700 1 --2- 172.21.15.92:0/2832879352 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa434035630 0x7fa434037ae0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa43c006eb0 tx=0x7fa43c016000 comp rx=0 tx=0).stop 2023-09-29T23:26:06.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.464+0000 7fa45359e700 1 -- 172.21.15.92:0/2832879352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa454067eb0 msgr2=0x7fa454117b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:06.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.464+0000 7fa45359e700 1 --2- 172.21.15.92:0/2832879352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa454067eb0 0x7fa454117b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa44400c460 tx=0x7fa444000fe0 comp rx=0 tx=0).stop 2023-09-29T23:26:06.464 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.464+0000 7fa45359e700 1 -- 172.21.15.92:0/2832879352 shutdown_connections 2023-09-29T23:26:06.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.464+0000 7fa45359e700 1 --2- 172.21.15.92:0/2832879352 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa434035630 0x7fa434037ae0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:06.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.464+0000 7fa45359e700 1 --2- 172.21.15.92:0/2832879352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa454067eb0 0x7fa454117b90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:06.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.464+0000 7fa45359e700 1 -- 172.21.15.92:0/2832879352 >> 172.21.15.92:0/2832879352 conn(0x7fa454094df0 msgr2=0x7fa45412aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:06.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.464+0000 7fa45359e700 1 -- 172.21.15.92:0/2832879352 shutdown_connections 2023-09-29T23:26:06.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:06.464+0000 7fa45359e700 1 -- 172.21.15.92:0/2832879352 wait complete. 2023-09-29T23:26:09.476 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:26:09.596 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.596+0000 7f0556eb5700 1 Processor -- start 2023-09-29T23:26:09.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.596+0000 7f0556eb5700 1 -- start start 2023-09-29T23:26:09.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.596+0000 7f0556eb5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f055012fcb0 0x7f0550134620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:09.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.596+0000 7f0556eb5700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05500997f0 con 0x7f05500a3030 2023-09-29T23:26:09.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.596+0000 7f0556eb5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05500a3400 con 0x7f055012fcb0 2023-09-29T23:26:09.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.596+0000 7f054ffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f055012fcb0 0x7f0550134620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:09.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.596+0000 7f0554c51700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f05500a3030 0x7f055012f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:42384/0 (socket says 172.21.15.92:42384) 2023-09-29T23:26:09.597 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.596+0000 7f0554c51700 1 -- 172.21.15.92:0/4286075022 learned_addr learned my addr 172.21.15.92:0/4286075022 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:26:09.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.597+0000 7f054ffff700 1 -- 172.21.15.92:0/4286075022 >> v1:172.21.15.92:6789/0 conn(0x7f05500a3030 legacy=0x7f055012f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:09.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.597+0000 7f054ffff700 1 -- 172.21.15.92:0/4286075022 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05500977a0 con 0x7f055012fcb0 2023-09-29T23:26:09.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.597+0000 7f054ffff700 1 --2- 172.21.15.92:0/4286075022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f055012fcb0 0x7f0550134620 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f053c009860 tx=0x7f053c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8284e151bb3433 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:09.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.597+0000 7f054f7fe700 1 -- 172.21.15.92:0/4286075022 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f053c00b710 con 0x7f055012fcb0 2023-09-29T23:26:09.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.597+0000 7f054f7fe700 1 -- 172.21.15.92:0/4286075022 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c00b870 con 0x7f055012fcb0 2023-09-29T23:26:09.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.597+0000 7f054f7fe700 1 -- 172.21.15.92:0/4286075022 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f053c00ba20 con 0x7f055012fcb0 2023-09-29T23:26:09.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.597+0000 7f0556eb5700 1 -- 172.21.15.92:0/4286075022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f055012fcb0 msgr2=0x7f0550134620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:09.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.597+0000 7f0556eb5700 1 --2- 172.21.15.92:0/4286075022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f055012fcb0 0x7f0550134620 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f053c009860 tx=0x7f053c0091a0 comp rx=0 tx=0).stop 2023-09-29T23:26:09.600 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.597+0000 7f0556eb5700 1 -- 172.21.15.92:0/4286075022 shutdown_connections 2023-09-29T23:26:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.597+0000 7f0556eb5700 1 --2- 172.21.15.92:0/4286075022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f055012fcb0 0x7f0550134620 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.597+0000 7f0556eb5700 1 -- 172.21.15.92:0/4286075022 >> 172.21.15.92:0/4286075022 conn(0x7f0550067fc0 msgr2=0x7f05500a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.597+0000 7f0556eb5700 1 -- 172.21.15.92:0/4286075022 shutdown_connections 2023-09-29T23:26:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.597+0000 7f0556eb5700 1 -- 172.21.15.92:0/4286075022 wait complete. 2023-09-29T23:26:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.598+0000 7f0556eb5700 1 Processor -- start 2023-09-29T23:26:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.598+0000 7f0556eb5700 1 -- start start 2023-09-29T23:26:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.599+0000 7f0556eb5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05500a3030 0x7f055011a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.599+0000 7f0556eb5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055011a700 con 0x7f05500a3030 2023-09-29T23:26:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.599+0000 7f0554c51700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05500a3030 0x7f055011a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.599+0000 7f0554c51700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05500a3030 0x7f055011a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60306/0 (socket says 172.21.15.92:60306) 2023-09-29T23:26:09.601 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.599+0000 7f0554c51700 1 -- 172.21.15.92:0/4191464619 learned_addr learned my addr 172.21.15.92:0/4191464619 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:09.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.599+0000 7f0554c51700 1 -- 172.21.15.92:0/4191464619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c009420 con 0x7f05500a3030 2023-09-29T23:26:09.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.599+0000 7f0554c51700 1 --2- 172.21.15.92:0/4191464619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05500a3030 0x7f055011a960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f054400c6c0 tx=0x7f0544007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:09.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.599+0000 7f054cff9700 1 -- 172.21.15.92:0/4191464619 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0544005b30 con 0x7f05500a3030 2023-09-29T23:26:09.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.599+0000 7f054cff9700 1 -- 172.21.15.92:0/4191464619 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0544005c90 con 0x7f05500a3030 2023-09-29T23:26:09.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.599+0000 7f0556eb5700 1 -- 172.21.15.92:0/4191464619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055012ceb0 con 0x7f05500a3030 2023-09-29T23:26:09.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.599+0000 7f054cff9700 1 -- 172.21.15.92:0/4191464619 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0544004830 con 0x7f05500a3030 2023-09-29T23:26:09.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.599+0000 7f0556eb5700 1 -- 172.21.15.92:0/4191464619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055011cb60 con 0x7f05500a3030 2023-09-29T23:26:09.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.600+0000 7f054cff9700 1 -- 172.21.15.92:0/4191464619 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f0544004a60 con 0x7f05500a3030 2023-09-29T23:26:09.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.600+0000 7f0556eb5700 1 -- 172.21.15.92:0/4191464619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05501300f0 con 0x7f05500a3030 2023-09-29T23:26:09.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.600+0000 7f054cff9700 1 --2- 172.21.15.92:0/4191464619 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0534035640 0x7f0534037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:09.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.600+0000 7f054cff9700 1 -- 172.21.15.92:0/4191464619 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f0544046910 con 0x7f05500a3030 2023-09-29T23:26:09.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.600+0000 7f054ffff700 1 --2- 172.21.15.92:0/4191464619 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0534035640 0x7f0534037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:09.603 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.601+0000 7f054ffff700 1 --2- 172.21.15.92:0/4191464619 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0534035640 0x7f0534037af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f053c0091e0 tx=0x7f053c016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:09.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.605+0000 7f054cff9700 1 -- 172.21.15.92:0/4191464619 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05440075f0 con 0x7f05500a3030 2023-09-29T23:26:09.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.828+0000 7f0556eb5700 1 -- 172.21.15.92:0/4191464619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0550096640 con 0x7f05500a3030 2023-09-29T23:26:09.829 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.829+0000 7f054cff9700 1 -- 172.21.15.92:0/4191464619 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f054401b360 con 0x7f05500a3030 2023-09-29T23:26:09.829 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:26:09.829 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:26:09.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.831+0000 7f0556eb5700 1 -- 172.21.15.92:0/4191464619 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0534035640 msgr2=0x7f0534037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:09.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.831+0000 7f0556eb5700 1 --2- 172.21.15.92:0/4191464619 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0534035640 0x7f0534037af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f053c0091e0 tx=0x7f053c016000 comp rx=0 tx=0).stop 2023-09-29T23:26:09.831 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.831+0000 7f0556eb5700 1 -- 172.21.15.92:0/4191464619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05500a3030 msgr2=0x7f055011a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:09.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.831+0000 7f0556eb5700 1 --2- 172.21.15.92:0/4191464619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05500a3030 0x7f055011a960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f054400c6c0 tx=0x7f0544007f70 comp rx=0 tx=0).stop 2023-09-29T23:26:09.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.831+0000 7f0556eb5700 1 -- 172.21.15.92:0/4191464619 shutdown_connections 2023-09-29T23:26:09.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.831+0000 7f0556eb5700 1 --2- 172.21.15.92:0/4191464619 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0534035640 0x7f0534037af0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:09.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.831+0000 7f0556eb5700 1 --2- 172.21.15.92:0/4191464619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05500a3030 0x7f055011a960 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:09.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.831+0000 7f0556eb5700 1 -- 172.21.15.92:0/4191464619 >> 172.21.15.92:0/4191464619 conn(0x7f0550067fc0 msgr2=0x7f055012d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:09.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.831+0000 7f0556eb5700 1 -- 172.21.15.92:0/4191464619 shutdown_connections 2023-09-29T23:26:09.832 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:09.831+0000 7f0556eb5700 1 -- 172.21.15.92:0/4191464619 wait complete. 2023-09-29T23:26:12.843 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:26:12.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.964+0000 7f5965ee4700 1 Processor -- start 2023-09-29T23:26:12.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.964+0000 7f5965ee4700 1 -- start start 2023-09-29T23:26:12.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.964+0000 7f5965ee4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f596012ffc0 0x7f59600a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:12.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.964+0000 7f5965ee4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5960098710 con 0x7f596009fd80 2023-09-29T23:26:12.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.964+0000 7f5965ee4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596012f340 con 0x7f596012ffc0 2023-09-29T23:26:12.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.964+0000 7f595f7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f596009fd80 0x7f596012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:44436/0 (socket says 172.21.15.92:44436) 2023-09-29T23:26:12.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.964+0000 7f595f7fe700 1 -- 172.21.15.92:0/3962101340 learned_addr learned my addr 172.21.15.92:0/3962101340 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:26:12.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.964+0000 7f595effd700 1 --2- 172.21.15.92:0/3962101340 >> v2:172.21.15.92:3300/0 conn(0x7f596012ffc0 0x7f59600a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:12.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.965+0000 7f595e7fc700 1 -- 172.21.15.92:0/3962101340 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414684325 0 0) 0x7f5960098710 con 0x7f596009fd80 2023-09-29T23:26:12.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.965+0000 7f595e7fc700 1 -- 172.21.15.92:0/3962101340 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f594c003570 con 0x7f596009fd80 2023-09-29T23:26:12.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.965+0000 7f595effd700 1 -- 172.21.15.92:0/3962101340 >> v1:172.21.15.92:6789/0 conn(0x7f596009fd80 legacy=0x7f596012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:12.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.965+0000 7f595effd700 1 -- 172.21.15.92:0/3962101340 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600997e0 con 0x7f596012ffc0 2023-09-29T23:26:12.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.965+0000 7f595effd700 1 --2- 172.21.15.92:0/3962101340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f596012ffc0 0x7f59600a3090 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5948009860 tx=0x7f59480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eacfcc40b599cf23 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:12.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.965+0000 7f595e7fc700 1 -- 172.21.15.92:0/3962101340 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5948011630 con 0x7f596012ffc0 2023-09-29T23:26:12.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.965+0000 7f595e7fc700 1 -- 172.21.15.92:0/3962101340 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5948011790 con 0x7f596012ffc0 2023-09-29T23:26:12.967 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.965+0000 7f595e7fc700 1 -- 172.21.15.92:0/3962101340 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5948011920 con 0x7f596012ffc0 2023-09-29T23:26:12.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.965+0000 7f5965ee4700 1 -- 172.21.15.92:0/3962101340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f596012ffc0 msgr2=0x7f59600a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:12.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.965+0000 7f5965ee4700 1 --2- 172.21.15.92:0/3962101340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f596012ffc0 0x7f59600a3090 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5948009860 tx=0x7f59480091a0 comp rx=0 tx=0).stop 2023-09-29T23:26:12.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.965+0000 7f5965ee4700 1 -- 172.21.15.92:0/3962101340 shutdown_connections 2023-09-29T23:26:12.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.965+0000 7f5965ee4700 1 --2- 172.21.15.92:0/3962101340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f596012ffc0 0x7f59600a3090 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:12.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.966+0000 7f5965ee4700 1 -- 172.21.15.92:0/3962101340 >> 172.21.15.92:0/3962101340 conn(0x7f5960068000 msgr2=0x7f59600a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:12.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.966+0000 7f5965ee4700 1 -- 172.21.15.92:0/3962101340 shutdown_connections 2023-09-29T23:26:12.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.966+0000 7f5965ee4700 1 -- 172.21.15.92:0/3962101340 wait complete. 2023-09-29T23:26:12.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.966+0000 7f5965ee4700 1 Processor -- start 2023-09-29T23:26:12.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.967+0000 7f5965ee4700 1 -- start start 2023-09-29T23:26:12.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.967+0000 7f5965ee4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f596009fd80 0x7f596013e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:12.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.967+0000 7f5965ee4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596011e3b0 con 0x7f596009fd80 2023-09-29T23:26:12.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.967+0000 7f595f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f596009fd80 0x7f596013e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:12.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.967+0000 7f595f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f596009fd80 0x7f596013e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42360/0 (socket says 172.21.15.92:42360) 2023-09-29T23:26:12.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.967+0000 7f595f7fe700 1 -- 172.21.15.92:0/2772048425 learned_addr learned my addr 172.21.15.92:0/2772048425 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:12.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.967+0000 7f595f7fe700 1 -- 172.21.15.92:0/2772048425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5948009420 con 0x7f596009fd80 2023-09-29T23:26:12.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.967+0000 7f595f7fe700 1 --2- 172.21.15.92:0/2772048425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f596009fd80 0x7f596013e4f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f595800cb40 tx=0x7f5958001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:12.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.967+0000 7f59577fe700 1 -- 172.21.15.92:0/2772048425 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f595800aae0 con 0x7f596009fd80 2023-09-29T23:26:12.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.967+0000 7f59577fe700 1 -- 172.21.15.92:0/2772048425 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595800ac60 con 0x7f596009fd80 2023-09-29T23:26:12.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.967+0000 7f59577fe700 1 -- 172.21.15.92:0/2772048425 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59580070f0 con 0x7f596009fd80 2023-09-29T23:26:12.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.967+0000 7f5965ee4700 1 -- 172.21.15.92:0/2772048425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596011c680 con 0x7f596009fd80 2023-09-29T23:26:12.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.968+0000 7f5965ee4700 1 -- 172.21.15.92:0/2772048425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596011d2b0 con 0x7f596009fd80 2023-09-29T23:26:12.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.968+0000 7f59577fe700 1 -- 172.21.15.92:0/2772048425 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f5958007360 con 0x7f596009fd80 2023-09-29T23:26:12.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.968+0000 7f59577fe700 1 --2- 172.21.15.92:0/2772048425 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5940035640 0x7f5940037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:12.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.968+0000 7f5965ee4700 1 -- 172.21.15.92:0/2772048425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59600a1a10 con 0x7f596009fd80 2023-09-29T23:26:12.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.968+0000 7f59577fe700 1 -- 172.21.15.92:0/2772048425 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f5958047a70 con 0x7f596009fd80 2023-09-29T23:26:12.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.969+0000 7f595effd700 1 --2- 172.21.15.92:0/2772048425 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5940035640 0x7f5940037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:12.971 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.969+0000 7f595effd700 1 --2- 172.21.15.92:0/2772048425 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5940035640 0x7f5940037af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5948009860 tx=0x7f5948016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:12.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:12.973+0000 7f59577fe700 1 -- 172.21.15.92:0/2772048425 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5958007610 con 0x7f596009fd80 2023-09-29T23:26:13.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:13.193+0000 7f5965ee4700 1 -- 172.21.15.92:0/2772048425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f596011e500 con 0x7f596009fd80 2023-09-29T23:26:13.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:13.194+0000 7f59577fe700 1 -- 172.21.15.92:0/2772048425 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f5958010300 con 0x7f596009fd80 2023-09-29T23:26:13.194 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:26:13.194 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:26:13.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:13.196+0000 7f5965ee4700 1 -- 172.21.15.92:0/2772048425 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5940035640 msgr2=0x7f5940037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:13.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:13.196+0000 7f5965ee4700 1 --2- 172.21.15.92:0/2772048425 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5940035640 0x7f5940037af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5948009860 tx=0x7f5948016000 comp rx=0 tx=0).stop 2023-09-29T23:26:13.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:13.196+0000 7f5965ee4700 1 -- 172.21.15.92:0/2772048425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f596009fd80 msgr2=0x7f596013e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:13.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:13.196+0000 7f5965ee4700 1 --2- 172.21.15.92:0/2772048425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f596009fd80 0x7f596013e4f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f595800cb40 tx=0x7f5958001a70 comp rx=0 tx=0).stop 2023-09-29T23:26:13.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:13.196+0000 7f5965ee4700 1 -- 172.21.15.92:0/2772048425 shutdown_connections 2023-09-29T23:26:13.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:13.196+0000 7f5965ee4700 1 --2- 172.21.15.92:0/2772048425 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5940035640 0x7f5940037af0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:13.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:13.196+0000 7f5965ee4700 1 --2- 172.21.15.92:0/2772048425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f596009fd80 0x7f596013e4f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:13.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:13.196+0000 7f5965ee4700 1 -- 172.21.15.92:0/2772048425 >> 172.21.15.92:0/2772048425 conn(0x7f5960068000 msgr2=0x7f5960094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:13.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:13.196+0000 7f5965ee4700 1 -- 172.21.15.92:0/2772048425 shutdown_connections 2023-09-29T23:26:13.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:13.196+0000 7f5965ee4700 1 -- 172.21.15.92:0/2772048425 wait complete. 2023-09-29T23:26:16.210 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:26:16.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.332+0000 7fc0abd0d700 1 Processor -- start 2023-09-29T23:26:16.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.332+0000 7fc0abd0d700 1 -- start start 2023-09-29T23:26:16.334 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.333+0000 7fc0abd0d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc0a409fd80 0x7fc0a40a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.333+0000 7fc0abd0d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a4098710 con 0x7fc0a412f8b0 2023-09-29T23:26:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.333+0000 7fc0abd0d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a412f340 con 0x7fc0a409fd80 2023-09-29T23:26:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.333+0000 7fc0a9aa9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc0a409fd80 0x7fc0a40a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.333+0000 7fc0a92a8700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fc0a412f8b0 0x7fc0a4095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:44438/0 (socket says 172.21.15.92:44438) 2023-09-29T23:26:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.333+0000 7fc0a92a8700 1 -- 172.21.15.92:0/1804276689 learned_addr learned my addr 172.21.15.92:0/1804276689 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:26:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.333+0000 7fc0a9aa9700 1 -- 172.21.15.92:0/1804276689 >> v1:172.21.15.92:6789/0 conn(0x7fc0a412f8b0 legacy=0x7fc0a4095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.333+0000 7fc0a9aa9700 1 -- 172.21.15.92:0/1804276689 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a40997e0 con 0x7fc0a409fd80 2023-09-29T23:26:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.333+0000 7fc0a9aa9700 1 --2- 172.21.15.92:0/1804276689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0a409fd80 0x7fc0a40a3090 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009860 tx=0x7fc0a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cecc8016706a3f server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.333+0000 7fc0a8aa7700 1 -- 172.21.15.92:0/1804276689 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a000b680 con 0x7fc0a409fd80 2023-09-29T23:26:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.334+0000 7fc0a8aa7700 1 -- 172.21.15.92:0/1804276689 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a000b7e0 con 0x7fc0a409fd80 2023-09-29T23:26:16.335 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.334+0000 7fc0a8aa7700 1 -- 172.21.15.92:0/1804276689 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a000b990 con 0x7fc0a409fd80 2023-09-29T23:26:16.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.334+0000 7fc0abd0d700 1 -- 172.21.15.92:0/1804276689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0a409fd80 msgr2=0x7fc0a40a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:16.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.334+0000 7fc0abd0d700 1 --2- 172.21.15.92:0/1804276689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0a409fd80 0x7fc0a40a3090 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009860 tx=0x7fc0a00091a0 comp rx=0 tx=0).stop 2023-09-29T23:26:16.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.334+0000 7fc0abd0d700 1 -- 172.21.15.92:0/1804276689 shutdown_connections 2023-09-29T23:26:16.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.334+0000 7fc0abd0d700 1 --2- 172.21.15.92:0/1804276689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0a409fd80 0x7fc0a40a3090 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:16.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.334+0000 7fc0abd0d700 1 -- 172.21.15.92:0/1804276689 >> 172.21.15.92:0/1804276689 conn(0x7fc0a4068000 msgr2=0x7fc0a40a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:16.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.334+0000 7fc0abd0d700 1 -- 172.21.15.92:0/1804276689 shutdown_connections 2023-09-29T23:26:16.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.334+0000 7fc0abd0d700 1 -- 172.21.15.92:0/1804276689 wait complete. 2023-09-29T23:26:16.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.335+0000 7fc0abd0d700 1 Processor -- start 2023-09-29T23:26:16.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.335+0000 7fc0abd0d700 1 -- start start 2023-09-29T23:26:16.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.335+0000 7fc0abd0d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0a409fd80 0x7fc0a4119fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:16.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.335+0000 7fc0abd0d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a411e610 con 0x7fc0a409fd80 2023-09-29T23:26:16.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.335+0000 7fc0a9aa9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0a409fd80 0x7fc0a4119fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:16.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.335+0000 7fc0a9aa9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0a409fd80 0x7fc0a4119fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42378/0 (socket says 172.21.15.92:42378) 2023-09-29T23:26:16.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.335+0000 7fc0a9aa9700 1 -- 172.21.15.92:0/3693938417 learned_addr learned my addr 172.21.15.92:0/3693938417 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:16.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.336+0000 7fc0a9aa9700 1 -- 172.21.15.92:0/3693938417 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a0009420 con 0x7fc0a409fd80 2023-09-29T23:26:16.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.336+0000 7fc0a9aa9700 1 --2- 172.21.15.92:0/3693938417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0a409fd80 0x7fc0a4119fa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0000c00 tx=0x7fc0a0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:16.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.336+0000 7fc099ffb700 1 -- 172.21.15.92:0/3693938417 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a0025470 con 0x7fc0a409fd80 2023-09-29T23:26:16.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.336+0000 7fc099ffb700 1 -- 172.21.15.92:0/3693938417 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a00255d0 con 0x7fc0a409fd80 2023-09-29T23:26:16.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.336+0000 7fc0abd0d700 1 -- 172.21.15.92:0/3693938417 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a411ba50 con 0x7fc0a409fd80 2023-09-29T23:26:16.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.336+0000 7fc099ffb700 1 -- 172.21.15.92:0/3693938417 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a0025880 con 0x7fc0a409fd80 2023-09-29T23:26:16.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.336+0000 7fc0abd0d700 1 -- 172.21.15.92:0/3693938417 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a411d460 con 0x7fc0a409fd80 2023-09-29T23:26:16.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.337+0000 7fc099ffb700 1 -- 172.21.15.92:0/3693938417 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fc0a0022070 con 0x7fc0a409fd80 2023-09-29T23:26:16.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.337+0000 7fc0abd0d700 1 -- 172.21.15.92:0/3693938417 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a405f230 con 0x7fc0a409fd80 2023-09-29T23:26:16.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.337+0000 7fc099ffb700 1 --2- 172.21.15.92:0/3693938417 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc088035640 0x7fc088037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:16.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.337+0000 7fc099ffb700 1 -- 172.21.15.92:0/3693938417 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fc0a00495a0 con 0x7fc0a409fd80 2023-09-29T23:26:16.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.337+0000 7fc0a92a8700 1 --2- 172.21.15.92:0/3693938417 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc088035640 0x7fc088037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:16.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.337+0000 7fc0a92a8700 1 --2- 172.21.15.92:0/3693938417 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc088035640 0x7fc088037af0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc0940016a0 tx=0x7fc094007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:16.342 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.342+0000 7fc099ffb700 1 -- 172.21.15.92:0/3693938417 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0a0010740 con 0x7fc0a409fd80 2023-09-29T23:26:16.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.565+0000 7fc0abd0d700 1 -- 172.21.15.92:0/3693938417 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc0a404bb40 con 0x7fc0a409fd80 2023-09-29T23:26:16.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.565+0000 7fc099ffb700 1 -- 172.21.15.92:0/3693938417 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fc0a00193b0 con 0x7fc0a409fd80 2023-09-29T23:26:16.566 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:26:16.566 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:26:16.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.567+0000 7fc0abd0d700 1 -- 172.21.15.92:0/3693938417 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc088035640 msgr2=0x7fc088037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:16.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.567+0000 7fc0abd0d700 1 --2- 172.21.15.92:0/3693938417 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc088035640 0x7fc088037af0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc0940016a0 tx=0x7fc094007b30 comp rx=0 tx=0).stop 2023-09-29T23:26:16.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.567+0000 7fc0abd0d700 1 -- 172.21.15.92:0/3693938417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0a409fd80 msgr2=0x7fc0a4119fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:16.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.567+0000 7fc0abd0d700 1 --2- 172.21.15.92:0/3693938417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0a409fd80 0x7fc0a4119fa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0000c00 tx=0x7fc0a0016000 comp rx=0 tx=0).stop 2023-09-29T23:26:16.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.567+0000 7fc0abd0d700 1 -- 172.21.15.92:0/3693938417 shutdown_connections 2023-09-29T23:26:16.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.567+0000 7fc0abd0d700 1 --2- 172.21.15.92:0/3693938417 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc088035640 0x7fc088037af0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:16.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.567+0000 7fc0abd0d700 1 --2- 172.21.15.92:0/3693938417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0a409fd80 0x7fc0a4119fa0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:16.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.567+0000 7fc0abd0d700 1 -- 172.21.15.92:0/3693938417 >> 172.21.15.92:0/3693938417 conn(0x7fc0a4068000 msgr2=0x7fc0a4094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:16.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.568+0000 7fc0abd0d700 1 -- 172.21.15.92:0/3693938417 shutdown_connections 2023-09-29T23:26:16.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:16.568+0000 7fc0abd0d700 1 -- 172.21.15.92:0/3693938417 wait complete. 2023-09-29T23:26:19.580 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:26:19.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.702+0000 7ff4f9f61700 1 Processor -- start 2023-09-29T23:26:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.702+0000 7ff4f9f61700 1 -- start start 2023-09-29T23:26:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.703+0000 7ff4f9f61700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff4f4099fa0 0x7ff4f41347a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.703+0000 7ff4f9f61700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f406c640 con 0x7ff4f40994c0 2023-09-29T23:26:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.703+0000 7ff4f9f61700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f406c370 con 0x7ff4f4099fa0 2023-09-29T23:26:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.703+0000 7ff4f2ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff4f4099fa0 0x7ff4f41347a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.703+0000 7ff4f37fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ff4f40994c0 0x7ff4f4099890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:44444/0 (socket says 172.21.15.92:44444) 2023-09-29T23:26:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.703+0000 7ff4f37fe700 1 -- 172.21.15.92:0/2121739146 learned_addr learned my addr 172.21.15.92:0/2121739146 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:26:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.703+0000 7ff4f2ffd700 1 -- 172.21.15.92:0/2121739146 >> v1:172.21.15.92:6789/0 conn(0x7ff4f40994c0 legacy=0x7ff4f4099890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.703+0000 7ff4f27fc700 1 -- 172.21.15.92:0/2121739146 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513316330 0 0) 0x7ff4f406c640 con 0x7ff4f40994c0 2023-09-29T23:26:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.703+0000 7ff4f2ffd700 1 -- 172.21.15.92:0/2121739146 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f406c910 con 0x7ff4f4099fa0 2023-09-29T23:26:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.703+0000 7ff4f2ffd700 1 --2- 172.21.15.92:0/2121739146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4f4099fa0 0x7ff4f41347a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009860 tx=0x7ff4e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ad9f769ccb1a3c server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.703+0000 7ff4f27fc700 1 -- 172.21.15.92:0/2121739146 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e800b680 con 0x7ff4f4099fa0 2023-09-29T23:26:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.703+0000 7ff4f27fc700 1 -- 172.21.15.92:0/2121739146 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e800b7e0 con 0x7ff4f4099fa0 2023-09-29T23:26:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.703+0000 7ff4f27fc700 1 -- 172.21.15.92:0/2121739146 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e800bad0 con 0x7ff4f4099fa0 2023-09-29T23:26:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.704+0000 7ff4f9f61700 1 -- 172.21.15.92:0/2121739146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4f4099fa0 msgr2=0x7ff4f41347a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.704+0000 7ff4f9f61700 1 --2- 172.21.15.92:0/2121739146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4f4099fa0 0x7ff4f41347a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009860 tx=0x7ff4e80091a0 comp rx=0 tx=0).stop 2023-09-29T23:26:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.704+0000 7ff4f9f61700 1 -- 172.21.15.92:0/2121739146 shutdown_connections 2023-09-29T23:26:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.704+0000 7ff4f9f61700 1 --2- 172.21.15.92:0/2121739146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4f4099fa0 0x7ff4f41347a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.704+0000 7ff4f9f61700 1 -- 172.21.15.92:0/2121739146 >> 172.21.15.92:0/2121739146 conn(0x7ff4f4068930 msgr2=0x7ff4f409ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:19.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.704+0000 7ff4f9f61700 1 -- 172.21.15.92:0/2121739146 shutdown_connections 2023-09-29T23:26:19.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.704+0000 7ff4f9f61700 1 -- 172.21.15.92:0/2121739146 wait complete. 2023-09-29T23:26:19.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.705+0000 7ff4f9f61700 1 Processor -- start 2023-09-29T23:26:19.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.705+0000 7ff4f9f61700 1 -- start start 2023-09-29T23:26:19.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.705+0000 7ff4f9f61700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4f40994c0 0x7ff4f413e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:19.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.705+0000 7ff4f9f61700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f411f210 con 0x7ff4f40994c0 2023-09-29T23:26:19.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.705+0000 7ff4f37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4f40994c0 0x7ff4f413e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:19.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.705+0000 7ff4f37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4f40994c0 0x7ff4f413e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42394/0 (socket says 172.21.15.92:42394) 2023-09-29T23:26:19.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.705+0000 7ff4f37fe700 1 -- 172.21.15.92:0/3224466528 learned_addr learned my addr 172.21.15.92:0/3224466528 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:19.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.706+0000 7ff4f37fe700 1 -- 172.21.15.92:0/3224466528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e8009420 con 0x7ff4f40994c0 2023-09-29T23:26:19.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.706+0000 7ff4f37fe700 1 --2- 172.21.15.92:0/3224466528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4f40994c0 0x7ff4f413e440 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400cbc0 tx=0x7ff4e40019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:19.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.706+0000 7ff4db7fe700 1 -- 172.21.15.92:0/3224466528 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e400aa20 con 0x7ff4f40994c0 2023-09-29T23:26:19.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.706+0000 7ff4db7fe700 1 -- 172.21.15.92:0/3224466528 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e400aba0 con 0x7ff4f40994c0 2023-09-29T23:26:19.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.706+0000 7ff4f9f61700 1 -- 172.21.15.92:0/3224466528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f4120ed0 con 0x7ff4f40994c0 2023-09-29T23:26:19.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.706+0000 7ff4db7fe700 1 -- 172.21.15.92:0/3224466528 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4e400ae90 con 0x7ff4f40994c0 2023-09-29T23:26:19.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.706+0000 7ff4f9f61700 1 -- 172.21.15.92:0/3224466528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f4121280 con 0x7ff4f40994c0 2023-09-29T23:26:19.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.707+0000 7ff4db7fe700 1 -- 172.21.15.92:0/3224466528 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7ff4e40070f0 con 0x7ff4f40994c0 2023-09-29T23:26:19.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.707+0000 7ff4f9f61700 1 -- 172.21.15.92:0/3224466528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f411f080 con 0x7ff4f40994c0 2023-09-29T23:26:19.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.707+0000 7ff4db7fe700 1 --2- 172.21.15.92:0/3224466528 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff4e0035630 0x7ff4e0037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:19.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.707+0000 7ff4db7fe700 1 -- 172.21.15.92:0/3224466528 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7ff4e4047a10 con 0x7ff4f40994c0 2023-09-29T23:26:19.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.707+0000 7ff4f2ffd700 1 --2- 172.21.15.92:0/3224466528 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff4e0035630 0x7ff4e0037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:19.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.707+0000 7ff4f2ffd700 1 --2- 172.21.15.92:0/3224466528 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff4e0035630 0x7ff4e0037ae0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8003080 tx=0x7ff4e8016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:19.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.711+0000 7ff4db7fe700 1 -- 172.21.15.92:0/3224466528 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4e40108f0 con 0x7ff4f40994c0 2023-09-29T23:26:19.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.934+0000 7ff4f9f61700 1 -- 172.21.15.92:0/3224466528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff4f405f230 con 0x7ff4f40994c0 2023-09-29T23:26:19.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.934+0000 7ff4db7fe700 1 -- 172.21.15.92:0/3224466528 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7ff4e40113a0 con 0x7ff4f40994c0 2023-09-29T23:26:19.935 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:26:19.935 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:26:19.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.937+0000 7ff4f9f61700 1 -- 172.21.15.92:0/3224466528 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff4e0035630 msgr2=0x7ff4e0037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:19.937 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.937+0000 7ff4f9f61700 1 --2- 172.21.15.92:0/3224466528 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff4e0035630 0x7ff4e0037ae0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8003080 tx=0x7ff4e8016000 comp rx=0 tx=0).stop 2023-09-29T23:26:19.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.937+0000 7ff4f9f61700 1 -- 172.21.15.92:0/3224466528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4f40994c0 msgr2=0x7ff4f413e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:19.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.937+0000 7ff4f9f61700 1 --2- 172.21.15.92:0/3224466528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4f40994c0 0x7ff4f413e440 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400cbc0 tx=0x7ff4e40019e0 comp rx=0 tx=0).stop 2023-09-29T23:26:19.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.937+0000 7ff4f9f61700 1 -- 172.21.15.92:0/3224466528 shutdown_connections 2023-09-29T23:26:19.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.937+0000 7ff4f9f61700 1 --2- 172.21.15.92:0/3224466528 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff4e0035630 0x7ff4e0037ae0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:19.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.937+0000 7ff4f9f61700 1 --2- 172.21.15.92:0/3224466528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4f40994c0 0x7ff4f413e440 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:19.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.937+0000 7ff4f9f61700 1 -- 172.21.15.92:0/3224466528 >> 172.21.15.92:0/3224466528 conn(0x7ff4f4068930 msgr2=0x7ff4f406d930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:19.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.937+0000 7ff4f9f61700 1 -- 172.21.15.92:0/3224466528 shutdown_connections 2023-09-29T23:26:19.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:19.937+0000 7ff4f9f61700 1 -- 172.21.15.92:0/3224466528 wait complete. 2023-09-29T23:26:22.949 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:26:23.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.070+0000 7f67aeb27700 1 Processor -- start 2023-09-29T23:26:23.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.070+0000 7f67aeb27700 1 -- start start 2023-09-29T23:26:23.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.070+0000 7f67aeb27700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f67a81325d0 0x7f67a81349b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:23.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.070+0000 7f67aeb27700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a806c840 con 0x7f67a806df20 2023-09-29T23:26:23.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.070+0000 7f67aeb27700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a806cae0 con 0x7f67a81325d0 2023-09-29T23:26:23.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.070+0000 7f67ac8c3700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f67a806df20 0x7f67a806e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58286/0 (socket says 172.21.15.92:58286) 2023-09-29T23:26:23.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.070+0000 7f679ffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f67a81325d0 0x7f67a81349b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:23.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.070+0000 7f67ac8c3700 1 -- 172.21.15.92:0/2739892254 learned_addr learned my addr 172.21.15.92:0/2739892254 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:26:23.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.070+0000 7f679ffff700 1 -- 172.21.15.92:0/2739892254 >> v1:172.21.15.92:6789/0 conn(0x7f67a806df20 legacy=0x7f67a806e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:23.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.070+0000 7f679ffff700 1 -- 172.21.15.92:0/2739892254 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a806ea00 con 0x7f67a81325d0 2023-09-29T23:26:23.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.071+0000 7f679ffff700 1 --2- 172.21.15.92:0/2739892254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a81325d0 0x7f67a81349b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6798009860 tx=0x7f67980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277a616a093a126f server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:23.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.071+0000 7f679f7fe700 1 -- 172.21.15.92:0/2739892254 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f679800b680 con 0x7f67a81325d0 2023-09-29T23:26:23.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.071+0000 7f679f7fe700 1 -- 172.21.15.92:0/2739892254 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679800b7e0 con 0x7f67a81325d0 2023-09-29T23:26:23.072 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.071+0000 7f679f7fe700 1 -- 172.21.15.92:0/2739892254 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f679800b990 con 0x7f67a81325d0 2023-09-29T23:26:23.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.071+0000 7f67aeb27700 1 -- 172.21.15.92:0/2739892254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a81325d0 msgr2=0x7f67a81349b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:23.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.071+0000 7f67aeb27700 1 --2- 172.21.15.92:0/2739892254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a81325d0 0x7f67a81349b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6798009860 tx=0x7f67980091a0 comp rx=0 tx=0).stop 2023-09-29T23:26:23.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.071+0000 7f67aeb27700 1 -- 172.21.15.92:0/2739892254 shutdown_connections 2023-09-29T23:26:23.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.071+0000 7f67aeb27700 1 --2- 172.21.15.92:0/2739892254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a81325d0 0x7f67a81349b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:23.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.071+0000 7f67aeb27700 1 -- 172.21.15.92:0/2739892254 >> 172.21.15.92:0/2739892254 conn(0x7f67a8068930 msgr2=0x7f67a809ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:23.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.071+0000 7f67aeb27700 1 -- 172.21.15.92:0/2739892254 shutdown_connections 2023-09-29T23:26:23.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.071+0000 7f67aeb27700 1 -- 172.21.15.92:0/2739892254 wait complete. 2023-09-29T23:26:23.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.072+0000 7f67aeb27700 1 Processor -- start 2023-09-29T23:26:23.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.072+0000 7f67aeb27700 1 -- start start 2023-09-29T23:26:23.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.073+0000 7f67aeb27700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a806df20 0x7f67a812f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:23.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.073+0000 7f67aeb27700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a8123ee0 con 0x7f67a806df20 2023-09-29T23:26:23.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.073+0000 7f67ac8c3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a806df20 0x7f67a812f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:23.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.073+0000 7f67ac8c3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a806df20 0x7f67a812f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36798/0 (socket says 172.21.15.92:36798) 2023-09-29T23:26:23.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.073+0000 7f67ac8c3700 1 -- 172.21.15.92:0/207296288 learned_addr learned my addr 172.21.15.92:0/207296288 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:23.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.073+0000 7f67ac8c3700 1 -- 172.21.15.92:0/207296288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6798009420 con 0x7f67a806df20 2023-09-29T23:26:23.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.073+0000 7f67ac8c3700 1 --2- 172.21.15.92:0/207296288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a806df20 0x7f67a812f640 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f67a400cc30 tx=0x7f67a4001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:23.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.073+0000 7f679cff9700 1 -- 172.21.15.92:0/207296288 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f67a4004c10 con 0x7f67a806df20 2023-09-29T23:26:23.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.073+0000 7f679cff9700 1 -- 172.21.15.92:0/207296288 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a4004d70 con 0x7f67a806df20 2023-09-29T23:26:23.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.073+0000 7f67aeb27700 1 -- 172.21.15.92:0/207296288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a80970d0 con 0x7f67a806df20 2023-09-29T23:26:23.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.073+0000 7f679cff9700 1 -- 172.21.15.92:0/207296288 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f67a400ab30 con 0x7f67a806df20 2023-09-29T23:26:23.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.073+0000 7f67aeb27700 1 -- 172.21.15.92:0/207296288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a8098b60 con 0x7f67a806df20 2023-09-29T23:26:23.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.074+0000 7f679cff9700 1 -- 172.21.15.92:0/207296288 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f67a400ac90 con 0x7f67a806df20 2023-09-29T23:26:23.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.074+0000 7f679cff9700 1 --2- 172.21.15.92:0/207296288 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f67940355f0 0x7f6794037aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:23.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.074+0000 7f679cff9700 1 -- 172.21.15.92:0/207296288 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f67a4047390 con 0x7f67a806df20 2023-09-29T23:26:23.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.074+0000 7f679ffff700 1 --2- 172.21.15.92:0/207296288 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f67940355f0 0x7f6794037aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:23.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.074+0000 7f67aeb27700 1 -- 172.21.15.92:0/207296288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a805f230 con 0x7f67a806df20 2023-09-29T23:26:23.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.075+0000 7f679ffff700 1 --2- 172.21.15.92:0/207296288 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f67940355f0 0x7f6794037aa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f67980091e0 tx=0x7f6798016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:23.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.079+0000 7f679cff9700 1 -- 172.21.15.92:0/207296288 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67a4018030 con 0x7f67a806df20 2023-09-29T23:26:23.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.300+0000 7f67aeb27700 1 -- 172.21.15.92:0/207296288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f67a809b080 con 0x7f67a806df20 2023-09-29T23:26:23.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.300+0000 7f679cff9700 1 -- 172.21.15.92:0/207296288 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f67a4025070 con 0x7f67a806df20 2023-09-29T23:26:23.301 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:26:23.301 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:26:23.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.302+0000 7f67aeb27700 1 -- 172.21.15.92:0/207296288 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f67940355f0 msgr2=0x7f6794037aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:23.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.302+0000 7f67aeb27700 1 --2- 172.21.15.92:0/207296288 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f67940355f0 0x7f6794037aa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f67980091e0 tx=0x7f6798016000 comp rx=0 tx=0).stop 2023-09-29T23:26:23.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.302+0000 7f67aeb27700 1 -- 172.21.15.92:0/207296288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a806df20 msgr2=0x7f67a812f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:23.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.302+0000 7f67aeb27700 1 --2- 172.21.15.92:0/207296288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a806df20 0x7f67a812f640 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f67a400cc30 tx=0x7f67a4001ad0 comp rx=0 tx=0).stop 2023-09-29T23:26:23.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.302+0000 7f67aeb27700 1 -- 172.21.15.92:0/207296288 shutdown_connections 2023-09-29T23:26:23.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.302+0000 7f67aeb27700 1 --2- 172.21.15.92:0/207296288 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f67940355f0 0x7f6794037aa0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:23.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.302+0000 7f67aeb27700 1 --2- 172.21.15.92:0/207296288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67a806df20 0x7f67a812f640 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:23.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.302+0000 7f67aeb27700 1 -- 172.21.15.92:0/207296288 >> 172.21.15.92:0/207296288 conn(0x7f67a8068930 msgr2=0x7f67a8115130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:23.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.302+0000 7f67aeb27700 1 -- 172.21.15.92:0/207296288 shutdown_connections 2023-09-29T23:26:23.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:23.302+0000 7f67aeb27700 1 -- 172.21.15.92:0/207296288 wait complete. 2023-09-29T23:26:26.314 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:26:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.436+0000 7f5b521ea700 1 Processor -- start 2023-09-29T23:26:26.437 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.436+0000 7f5b521ea700 1 -- start start 2023-09-29T23:26:26.438 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.437+0000 7f5b521ea700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5b4c12fcb0 0x7f5b4c134620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:26.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.437+0000 7f5b521ea700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4c0997f0 con 0x7f5b4c0a3030 2023-09-29T23:26:26.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.437+0000 7f5b521ea700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b4c0a3400 con 0x7f5b4c12fcb0 2023-09-29T23:26:26.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.437+0000 7f5b43fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5b4c12fcb0 0x7f5b4c134620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:26.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.437+0000 7f5b4b7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f5b4c0a3030 0x7f5b4c12f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58288/0 (socket says 172.21.15.92:58288) 2023-09-29T23:26:26.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.437+0000 7f5b4b7fe700 1 -- 172.21.15.92:0/4152825946 learned_addr learned my addr 172.21.15.92:0/4152825946 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:26:26.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.437+0000 7f5b43fff700 1 -- 172.21.15.92:0/4152825946 >> v1:172.21.15.92:6789/0 conn(0x7f5b4c0a3030 legacy=0x7f5b4c12f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:26.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.437+0000 7f5b43fff700 1 -- 172.21.15.92:0/4152825946 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c0977a0 con 0x7f5b4c12fcb0 2023-09-29T23:26:26.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.437+0000 7f5b43fff700 1 --2- 172.21.15.92:0/4152825946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b4c12fcb0 0x7f5b4c134620 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009860 tx=0x7f5b340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811491a0d67989d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:26.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.438+0000 7f5b4affd700 1 -- 172.21.15.92:0/4152825946 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b34011630 con 0x7f5b4c12fcb0 2023-09-29T23:26:26.439 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.438+0000 7f5b4affd700 1 -- 172.21.15.92:0/4152825946 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b34011790 con 0x7f5b4c12fcb0 2023-09-29T23:26:26.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.438+0000 7f5b4affd700 1 -- 172.21.15.92:0/4152825946 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b34011940 con 0x7f5b4c12fcb0 2023-09-29T23:26:26.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.438+0000 7f5b521ea700 1 -- 172.21.15.92:0/4152825946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b4c12fcb0 msgr2=0x7f5b4c134620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:26.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.438+0000 7f5b521ea700 1 --2- 172.21.15.92:0/4152825946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b4c12fcb0 0x7f5b4c134620 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009860 tx=0x7f5b340091a0 comp rx=0 tx=0).stop 2023-09-29T23:26:26.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.438+0000 7f5b521ea700 1 -- 172.21.15.92:0/4152825946 shutdown_connections 2023-09-29T23:26:26.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.438+0000 7f5b521ea700 1 --2- 172.21.15.92:0/4152825946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b4c12fcb0 0x7f5b4c134620 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:26.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.438+0000 7f5b521ea700 1 -- 172.21.15.92:0/4152825946 >> 172.21.15.92:0/4152825946 conn(0x7f5b4c067fc0 msgr2=0x7f5b4c0a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:26.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.438+0000 7f5b521ea700 1 -- 172.21.15.92:0/4152825946 shutdown_connections 2023-09-29T23:26:26.440 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.438+0000 7f5b521ea700 1 -- 172.21.15.92:0/4152825946 wait complete. 2023-09-29T23:26:26.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.439+0000 7f5b521ea700 1 Processor -- start 2023-09-29T23:26:26.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.439+0000 7f5b521ea700 1 -- start start 2023-09-29T23:26:26.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.439+0000 7f5b521ea700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b4c0a3030 0x7f5b4c12c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:26.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.439+0000 7f5b521ea700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c11c6c0 con 0x7f5b4c0a3030 2023-09-29T23:26:26.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.440+0000 7f5b4b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b4c0a3030 0x7f5b4c12c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:26.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.440+0000 7f5b4b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b4c0a3030 0x7f5b4c12c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36808/0 (socket says 172.21.15.92:36808) 2023-09-29T23:26:26.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.440+0000 7f5b4b7fe700 1 -- 172.21.15.92:0/1985997975 learned_addr learned my addr 172.21.15.92:0/1985997975 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:26.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.440+0000 7f5b4b7fe700 1 -- 172.21.15.92:0/1985997975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b34009420 con 0x7f5b4c0a3030 2023-09-29T23:26:26.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.440+0000 7f5b4b7fe700 1 --2- 172.21.15.92:0/1985997975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b4c0a3030 0x7f5b4c12c340 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00c710 tx=0x7f5b3c007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:26.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.440+0000 7f5b437fe700 1 -- 172.21.15.92:0/1985997975 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b3c005b90 con 0x7f5b4c0a3030 2023-09-29T23:26:26.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.440+0000 7f5b437fe700 1 -- 172.21.15.92:0/1985997975 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c005cf0 con 0x7f5b4c0a3030 2023-09-29T23:26:26.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.440+0000 7f5b521ea700 1 -- 172.21.15.92:0/1985997975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4c11da10 con 0x7f5b4c0a3030 2023-09-29T23:26:26.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.440+0000 7f5b437fe700 1 -- 172.21.15.92:0/1985997975 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b3c0070f0 con 0x7f5b4c0a3030 2023-09-29T23:26:26.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.440+0000 7f5b521ea700 1 -- 172.21.15.92:0/1985997975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4c11bdb0 con 0x7f5b4c0a3030 2023-09-29T23:26:26.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.441+0000 7f5b437fe700 1 -- 172.21.15.92:0/1985997975 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f5b3c007270 con 0x7f5b4c0a3030 2023-09-29T23:26:26.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.441+0000 7f5b437fe700 1 --2- 172.21.15.92:0/1985997975 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5b2c035640 0x7f5b2c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:26.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.441+0000 7f5b437fe700 1 -- 172.21.15.92:0/1985997975 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f5b3c047140 con 0x7f5b4c0a3030 2023-09-29T23:26:26.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.441+0000 7f5b43fff700 1 --2- 172.21.15.92:0/1985997975 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5b2c035640 0x7f5b2c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:26.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.441+0000 7f5b521ea700 1 -- 172.21.15.92:0/1985997975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b4c096040 con 0x7f5b4c0a3030 2023-09-29T23:26:26.444 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.441+0000 7f5b43fff700 1 --2- 172.21.15.92:0/1985997975 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5b2c035640 0x7f5b2c037af0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b340091e0 tx=0x7f5b34016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:26.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.446+0000 7f5b437fe700 1 -- 172.21.15.92:0/1985997975 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b3c01ab90 con 0x7f5b4c0a3030 2023-09-29T23:26:26.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.668+0000 7f5b521ea700 1 -- 172.21.15.92:0/1985997975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5b4c05f230 con 0x7f5b4c0a3030 2023-09-29T23:26:26.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.668+0000 7f5b437fe700 1 -- 172.21.15.92:0/1985997975 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f5b3c029100 con 0x7f5b4c0a3030 2023-09-29T23:26:26.669 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:26:26.669 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:26:26.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.670+0000 7f5b521ea700 1 -- 172.21.15.92:0/1985997975 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5b2c035640 msgr2=0x7f5b2c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:26.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.670+0000 7f5b521ea700 1 --2- 172.21.15.92:0/1985997975 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5b2c035640 0x7f5b2c037af0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b340091e0 tx=0x7f5b34016000 comp rx=0 tx=0).stop 2023-09-29T23:26:26.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.670+0000 7f5b521ea700 1 -- 172.21.15.92:0/1985997975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b4c0a3030 msgr2=0x7f5b4c12c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:26.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.670+0000 7f5b521ea700 1 --2- 172.21.15.92:0/1985997975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b4c0a3030 0x7f5b4c12c340 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00c710 tx=0x7f5b3c007f30 comp rx=0 tx=0).stop 2023-09-29T23:26:26.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.670+0000 7f5b521ea700 1 -- 172.21.15.92:0/1985997975 shutdown_connections 2023-09-29T23:26:26.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.670+0000 7f5b521ea700 1 --2- 172.21.15.92:0/1985997975 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5b2c035640 0x7f5b2c037af0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:26.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.670+0000 7f5b521ea700 1 --2- 172.21.15.92:0/1985997975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b4c0a3030 0x7f5b4c12c340 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:26.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.670+0000 7f5b521ea700 1 -- 172.21.15.92:0/1985997975 >> 172.21.15.92:0/1985997975 conn(0x7f5b4c067fc0 msgr2=0x7f5b4c12d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:26.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.670+0000 7f5b521ea700 1 -- 172.21.15.92:0/1985997975 shutdown_connections 2023-09-29T23:26:26.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:26.670+0000 7f5b521ea700 1 -- 172.21.15.92:0/1985997975 wait complete. 2023-09-29T23:26:29.683 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:26:29.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.804+0000 7f812eac7700 1 Processor -- start 2023-09-29T23:26:29.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.804+0000 7f812eac7700 1 -- start start 2023-09-29T23:26:29.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.804+0000 7f812eac7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f812806a040 0x7f8128134560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:29.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.804+0000 7f812eac7700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81280a1580 con 0x7f812806f210 2023-09-29T23:26:29.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.804+0000 7f812eac7700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812806f5e0 con 0x7f812806a040 2023-09-29T23:26:29.806 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.804+0000 7f8127fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f812806a040 0x7f8128134560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:29.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.805+0000 7f8127fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f812806a040 0x7f8128134560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36814/0 (socket says 172.21.15.92:36814) 2023-09-29T23:26:29.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.805+0000 7f8127fff700 1 -- 172.21.15.92:0/2262496351 learned_addr learned my addr 172.21.15.92:0/2262496351 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:29.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.805+0000 7f812c863700 1 --1- 172.21.15.92:0/2262496351 >> v1:172.21.15.92:6789/0 conn(0x7f812806f210 0x7f8128069930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58298/0 (socket says 172.21.15.92:58298) 2023-09-29T23:26:29.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.805+0000 7f8127fff700 1 -- 172.21.15.92:0/2262496351 >> v1:172.21.15.92:6789/0 conn(0x7f812806f210 legacy=0x7f8128069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:29.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.805+0000 7f81277fe700 1 -- 172.21.15.92:0/2262496351 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936341280 0 0) 0x7f81280a1580 con 0x7f812806f210 2023-09-29T23:26:29.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.805+0000 7f8127fff700 1 -- 172.21.15.92:0/2262496351 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812809cc70 con 0x7f812806a040 2023-09-29T23:26:29.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.805+0000 7f8127fff700 1 --2- 172.21.15.92:0/2262496351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f812806a040 0x7f8128134560 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8114009930 tx=0x7f8114009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e210c313ecb4bc7 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:29.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.805+0000 7f81277fe700 1 -- 172.21.15.92:0/2262496351 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f811400b860 con 0x7f812806a040 2023-09-29T23:26:29.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.805+0000 7f81277fe700 1 -- 172.21.15.92:0/2262496351 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811400b9c0 con 0x7f812806a040 2023-09-29T23:26:29.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.805+0000 7f81277fe700 1 -- 172.21.15.92:0/2262496351 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f811400bc90 con 0x7f812806a040 2023-09-29T23:26:29.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.806+0000 7f812eac7700 1 -- 172.21.15.92:0/2262496351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f812806a040 msgr2=0x7f8128134560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:29.807 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.806+0000 7f812eac7700 1 --2- 172.21.15.92:0/2262496351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f812806a040 0x7f8128134560 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8114009930 tx=0x7f8114009250 comp rx=0 tx=0).stop 2023-09-29T23:26:29.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.806+0000 7f812eac7700 1 -- 172.21.15.92:0/2262496351 shutdown_connections 2023-09-29T23:26:29.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.806+0000 7f812eac7700 1 --2- 172.21.15.92:0/2262496351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f812806a040 0x7f8128134560 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:29.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.806+0000 7f812eac7700 1 -- 172.21.15.92:0/2262496351 >> 172.21.15.92:0/2262496351 conn(0x7f8128094a70 msgr2=0x7f812806eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:29.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.806+0000 7f812eac7700 1 -- 172.21.15.92:0/2262496351 shutdown_connections 2023-09-29T23:26:29.808 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.806+0000 7f812eac7700 1 -- 172.21.15.92:0/2262496351 wait complete. 2023-09-29T23:26:29.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.806+0000 7f812eac7700 1 Processor -- start 2023-09-29T23:26:29.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.807+0000 7f812eac7700 1 -- start start 2023-09-29T23:26:29.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.807+0000 7f812eac7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f812806a040 0x7f8128116f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:29.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.807+0000 7f812eac7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812811b130 con 0x7f812806a040 2023-09-29T23:26:29.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.807+0000 7f812c863700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f812806a040 0x7f8128116f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:29.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.807+0000 7f812c863700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f812806a040 0x7f8128116f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36826/0 (socket says 172.21.15.92:36826) 2023-09-29T23:26:29.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.807+0000 7f812c863700 1 -- 172.21.15.92:0/3405640600 learned_addr learned my addr 172.21.15.92:0/3405640600 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:29.810 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.807+0000 7f812c863700 1 -- 172.21.15.92:0/3405640600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81140094f0 con 0x7f812806a040 2023-09-29T23:26:29.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.807+0000 7f812c863700 1 --2- 172.21.15.92:0/3405640600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f812806a040 0x7f8128116f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f811c00c710 tx=0x7f811c007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:29.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.808+0000 7f8124ff9700 1 -- 172.21.15.92:0/3405640600 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f811c0074c0 con 0x7f812806a040 2023-09-29T23:26:29.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.808+0000 7f8124ff9700 1 -- 172.21.15.92:0/3405640600 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c007620 con 0x7f812806a040 2023-09-29T23:26:29.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.808+0000 7f812eac7700 1 -- 172.21.15.92:0/3405640600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8128118320 con 0x7f812806a040 2023-09-29T23:26:29.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.808+0000 7f8124ff9700 1 -- 172.21.15.92:0/3405640600 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f811c005950 con 0x7f812806a040 2023-09-29T23:26:29.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.808+0000 7f812eac7700 1 -- 172.21.15.92:0/3405640600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812811b440 con 0x7f812806a040 2023-09-29T23:26:29.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.808+0000 7f8124ff9700 1 -- 172.21.15.92:0/3405640600 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f811c005ab0 con 0x7f812806a040 2023-09-29T23:26:29.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.809+0000 7f812eac7700 1 -- 172.21.15.92:0/3405640600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812812cde0 con 0x7f812806a040 2023-09-29T23:26:29.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.809+0000 7f8124ff9700 1 --2- 172.21.15.92:0/3405640600 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f810c035640 0x7f810c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:29.811 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.809+0000 7f8124ff9700 1 -- 172.21.15.92:0/3405640600 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f811c047370 con 0x7f812806a040 2023-09-29T23:26:29.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.809+0000 7f8127fff700 1 --2- 172.21.15.92:0/3405640600 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f810c035640 0x7f810c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:29.812 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.809+0000 7f8127fff700 1 --2- 172.21.15.92:0/3405640600 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f810c035640 0x7f810c037af0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8114000c00 tx=0x7f8114016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:29.813 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:29.813+0000 7f8124ff9700 1 -- 172.21.15.92:0/3405640600 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f811c0102c0 con 0x7f812806a040 2023-09-29T23:26:30.039 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:30.039+0000 7f812eac7700 1 -- 172.21.15.92:0/3405640600 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f812811b280 con 0x7f812806a040 2023-09-29T23:26:30.040 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:30.039+0000 7f8124ff9700 1 -- 172.21.15.92:0/3405640600 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f811c011e80 con 0x7f812806a040 2023-09-29T23:26:30.040 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:26:30.040 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:26:30.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:30.042+0000 7f812eac7700 1 -- 172.21.15.92:0/3405640600 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f810c035640 msgr2=0x7f810c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:30.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:30.042+0000 7f812eac7700 1 --2- 172.21.15.92:0/3405640600 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f810c035640 0x7f810c037af0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8114000c00 tx=0x7f8114016000 comp rx=0 tx=0).stop 2023-09-29T23:26:30.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:30.042+0000 7f812eac7700 1 -- 172.21.15.92:0/3405640600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f812806a040 msgr2=0x7f8128116f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:30.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:30.042+0000 7f812eac7700 1 --2- 172.21.15.92:0/3405640600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f812806a040 0x7f8128116f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f811c00c710 tx=0x7f811c007cc0 comp rx=0 tx=0).stop 2023-09-29T23:26:30.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:30.042+0000 7f812eac7700 1 -- 172.21.15.92:0/3405640600 shutdown_connections 2023-09-29T23:26:30.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:30.042+0000 7f812eac7700 1 --2- 172.21.15.92:0/3405640600 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f810c035640 0x7f810c037af0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:30.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:30.042+0000 7f812eac7700 1 --2- 172.21.15.92:0/3405640600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f812806a040 0x7f8128116f20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:30.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:30.042+0000 7f812eac7700 1 -- 172.21.15.92:0/3405640600 >> 172.21.15.92:0/3405640600 conn(0x7f8128094a70 msgr2=0x7f812812ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:30.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:30.042+0000 7f812eac7700 1 -- 172.21.15.92:0/3405640600 shutdown_connections 2023-09-29T23:26:30.043 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:30.042+0000 7f812eac7700 1 -- 172.21.15.92:0/3405640600 wait complete. 2023-09-29T23:26:33.054 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:26:33.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.177+0000 7f6466416700 1 Processor -- start 2023-09-29T23:26:33.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.177+0000 7f6466416700 1 -- start start 2023-09-29T23:26:33.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.177+0000 7f6466416700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f646012ffc0 0x7f64600a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:33.179 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.177+0000 7f6466416700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6460098710 con 0x7f646009fd80 2023-09-29T23:26:33.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.177+0000 7f6466416700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646012f340 con 0x7f646012ffc0 2023-09-29T23:26:33.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.177+0000 7f645ffff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f646009fd80 0x7f646012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:46240/0 (socket says 172.21.15.92:46240) 2023-09-29T23:26:33.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.177+0000 7f645f7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f646012ffc0 0x7f64600a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:33.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.177+0000 7f645ffff700 1 -- 172.21.15.92:0/1098666868 learned_addr learned my addr 172.21.15.92:0/1098666868 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:26:33.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.178+0000 7f645f7fe700 1 -- 172.21.15.92:0/1098666868 >> v1:172.21.15.92:6789/0 conn(0x7f646009fd80 legacy=0x7f646012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:33.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.178+0000 7f645f7fe700 1 -- 172.21.15.92:0/1098666868 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64600997e0 con 0x7f646012ffc0 2023-09-29T23:26:33.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.178+0000 7f645effd700 1 -- 172.21.15.92:0/1098666868 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130107546 0 0) 0x7f6460098710 con 0x7f646009fd80 2023-09-29T23:26:33.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.178+0000 7f645f7fe700 1 --2- 172.21.15.92:0/1098666868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f646012ffc0 0x7f64600a3090 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6454009860 tx=0x7f64540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12621b63849aa1a server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:33.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.178+0000 7f645effd700 1 -- 172.21.15.92:0/1098666868 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f645400b680 con 0x7f646012ffc0 2023-09-29T23:26:33.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.178+0000 7f645effd700 1 -- 172.21.15.92:0/1098666868 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645400b7e0 con 0x7f646012ffc0 2023-09-29T23:26:33.180 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.178+0000 7f645effd700 1 -- 172.21.15.92:0/1098666868 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f645400b990 con 0x7f646012ffc0 2023-09-29T23:26:33.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.178+0000 7f6466416700 1 -- 172.21.15.92:0/1098666868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f646012ffc0 msgr2=0x7f64600a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:33.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.178+0000 7f6466416700 1 --2- 172.21.15.92:0/1098666868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f646012ffc0 0x7f64600a3090 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6454009860 tx=0x7f64540091a0 comp rx=0 tx=0).stop 2023-09-29T23:26:33.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.179+0000 7f6466416700 1 -- 172.21.15.92:0/1098666868 shutdown_connections 2023-09-29T23:26:33.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.179+0000 7f6466416700 1 --2- 172.21.15.92:0/1098666868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f646012ffc0 0x7f64600a3090 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:33.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.179+0000 7f6466416700 1 -- 172.21.15.92:0/1098666868 >> 172.21.15.92:0/1098666868 conn(0x7f6460068000 msgr2=0x7f64600a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:33.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.179+0000 7f6466416700 1 -- 172.21.15.92:0/1098666868 shutdown_connections 2023-09-29T23:26:33.181 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.179+0000 7f6466416700 1 -- 172.21.15.92:0/1098666868 wait complete. 2023-09-29T23:26:33.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.179+0000 7f6466416700 1 Processor -- start 2023-09-29T23:26:33.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.180+0000 7f6466416700 1 -- start start 2023-09-29T23:26:33.183 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.180+0000 7f6466416700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f646009fd80 0x7f646013e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:33.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.180+0000 7f6466416700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646011e2f0 con 0x7f646009fd80 2023-09-29T23:26:33.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.180+0000 7f645ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f646009fd80 0x7f646013e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:33.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.180+0000 7f645ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f646009fd80 0x7f646013e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48040/0 (socket says 172.21.15.92:48040) 2023-09-29T23:26:33.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.180+0000 7f645ffff700 1 -- 172.21.15.92:0/3366981956 learned_addr learned my addr 172.21.15.92:0/3366981956 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:33.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.180+0000 7f645ffff700 1 -- 172.21.15.92:0/3366981956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6454009420 con 0x7f646009fd80 2023-09-29T23:26:33.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.180+0000 7f645ffff700 1 --2- 172.21.15.92:0/3366981956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f646009fd80 0x7f646013e520 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f645000c460 tx=0x7f6450000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:33.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.181+0000 7f6447fff700 1 -- 172.21.15.92:0/3366981956 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6450005c70 con 0x7f646009fd80 2023-09-29T23:26:33.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.181+0000 7f6447fff700 1 -- 172.21.15.92:0/3366981956 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6450005dd0 con 0x7f646009fd80 2023-09-29T23:26:33.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.181+0000 7f6466416700 1 -- 172.21.15.92:0/3366981956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646011c4a0 con 0x7f646009fd80 2023-09-29T23:26:33.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.181+0000 7f6447fff700 1 -- 172.21.15.92:0/3366981956 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6450007230 con 0x7f646009fd80 2023-09-29T23:26:33.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.181+0000 7f6466416700 1 -- 172.21.15.92:0/3366981956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646011cff0 con 0x7f646009fd80 2023-09-29T23:26:33.184 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.182+0000 7f6447fff700 1 -- 172.21.15.92:0/3366981956 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f6450007390 con 0x7f646009fd80 2023-09-29T23:26:33.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.182+0000 7f6466416700 1 -- 172.21.15.92:0/3366981956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64600a1fc0 con 0x7f646009fd80 2023-09-29T23:26:33.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.182+0000 7f6447fff700 1 --2- 172.21.15.92:0/3366981956 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f644c035630 0x7f644c037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:33.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.182+0000 7f6447fff700 1 -- 172.21.15.92:0/3366981956 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f6450046ab0 con 0x7f646009fd80 2023-09-29T23:26:33.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.182+0000 7f645f7fe700 1 --2- 172.21.15.92:0/3366981956 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f644c035630 0x7f644c037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:33.185 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.182+0000 7f645f7fe700 1 --2- 172.21.15.92:0/3366981956 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f644c035630 0x7f644c037ae0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6454009860 tx=0x7f6454016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:33.186 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.186+0000 7f6447fff700 1 -- 172.21.15.92:0/3366981956 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64500188b0 con 0x7f646009fd80 2023-09-29T23:26:33.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.410+0000 7f6466416700 1 -- 172.21.15.92:0/3366981956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f646005f230 con 0x7f646009fd80 2023-09-29T23:26:33.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.410+0000 7f6447fff700 1 -- 172.21.15.92:0/3366981956 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f6450017020 con 0x7f646009fd80 2023-09-29T23:26:33.411 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:26:33.411 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:26:33.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.412+0000 7f6466416700 1 -- 172.21.15.92:0/3366981956 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f644c035630 msgr2=0x7f644c037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:33.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.412+0000 7f6466416700 1 --2- 172.21.15.92:0/3366981956 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f644c035630 0x7f644c037ae0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6454009860 tx=0x7f6454016000 comp rx=0 tx=0).stop 2023-09-29T23:26:33.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.412+0000 7f6466416700 1 -- 172.21.15.92:0/3366981956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f646009fd80 msgr2=0x7f646013e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:33.413 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.412+0000 7f6466416700 1 --2- 172.21.15.92:0/3366981956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f646009fd80 0x7f646013e520 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f645000c460 tx=0x7f6450000fe0 comp rx=0 tx=0).stop 2023-09-29T23:26:33.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.413+0000 7f6466416700 1 -- 172.21.15.92:0/3366981956 shutdown_connections 2023-09-29T23:26:33.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.413+0000 7f6466416700 1 --2- 172.21.15.92:0/3366981956 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f644c035630 0x7f644c037ae0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:33.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.413+0000 7f6466416700 1 --2- 172.21.15.92:0/3366981956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f646009fd80 0x7f646013e520 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:33.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.413+0000 7f6466416700 1 -- 172.21.15.92:0/3366981956 >> 172.21.15.92:0/3366981956 conn(0x7f6460068000 msgr2=0x7f6460094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:33.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.413+0000 7f6466416700 1 -- 172.21.15.92:0/3366981956 shutdown_connections 2023-09-29T23:26:33.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:33.413+0000 7f6466416700 1 -- 172.21.15.92:0/3366981956 wait complete. 2023-09-29T23:26:36.425 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:26:36.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.545+0000 7fd16b158700 1 Processor -- start 2023-09-29T23:26:36.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.545+0000 7fd16b158700 1 -- start start 2023-09-29T23:26:36.545 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.545+0000 7fd16b158700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd16412eb00 0x7fd164130ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:36.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.545+0000 7fd16b158700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd164096220 con 0x7fd1640963e0 2023-09-29T23:26:36.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.545+0000 7fd16b158700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd164098ad0 con 0x7fd16412eb00 2023-09-29T23:26:36.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.545+0000 7fd168ef4700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fd1640963e0 0x7fd1640967b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:46256/0 (socket says 172.21.15.92:46256) 2023-09-29T23:26:36.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.545+0000 7fd15bfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd16412eb00 0x7fd164130ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:36.546 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.545+0000 7fd168ef4700 1 -- 172.21.15.92:0/1559786399 learned_addr learned my addr 172.21.15.92:0/1559786399 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:26:36.548 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.546+0000 7fd15bfff700 1 -- 172.21.15.92:0/1559786399 >> v1:172.21.15.92:6789/0 conn(0x7fd1640963e0 legacy=0x7fd1640967b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.546+0000 7fd15bfff700 1 -- 172.21.15.92:0/1559786399 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1640972d0 con 0x7fd16412eb00 2023-09-29T23:26:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.546+0000 7fd15bfff700 1 --2- 172.21.15.92:0/1559786399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd16412eb00 0x7fd164130ee0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd154009860 tx=0x7fd1540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2393c7a767e2d310 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.546+0000 7fd15b7fe700 1 -- 172.21.15.92:0/1559786399 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd15400b680 con 0x7fd16412eb00 2023-09-29T23:26:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.546+0000 7fd15b7fe700 1 -- 172.21.15.92:0/1559786399 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15400b7e0 con 0x7fd16412eb00 2023-09-29T23:26:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.546+0000 7fd15b7fe700 1 -- 172.21.15.92:0/1559786399 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd15400b990 con 0x7fd16412eb00 2023-09-29T23:26:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.546+0000 7fd16b158700 1 -- 172.21.15.92:0/1559786399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd16412eb00 msgr2=0x7fd164130ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.546+0000 7fd16b158700 1 --2- 172.21.15.92:0/1559786399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd16412eb00 0x7fd164130ee0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd154009860 tx=0x7fd1540091a0 comp rx=0 tx=0).stop 2023-09-29T23:26:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.546+0000 7fd16b158700 1 -- 172.21.15.92:0/1559786399 shutdown_connections 2023-09-29T23:26:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.546+0000 7fd16b158700 1 --2- 172.21.15.92:0/1559786399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd16412eb00 0x7fd164130ee0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.546+0000 7fd16b158700 1 -- 172.21.15.92:0/1559786399 >> 172.21.15.92:0/1559786399 conn(0x7fd16406bd70 msgr2=0x7fd16406e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.546+0000 7fd16b158700 1 -- 172.21.15.92:0/1559786399 shutdown_connections 2023-09-29T23:26:36.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.546+0000 7fd16b158700 1 -- 172.21.15.92:0/1559786399 wait complete. 2023-09-29T23:26:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.547+0000 7fd16b158700 1 Processor -- start 2023-09-29T23:26:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.547+0000 7fd16b158700 1 -- start start 2023-09-29T23:26:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.548+0000 7fd16b158700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1640963e0 0x7fd164123960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.548+0000 7fd16b158700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd164123f70 con 0x7fd1640963e0 2023-09-29T23:26:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.548+0000 7fd168ef4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1640963e0 0x7fd164123960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.548+0000 7fd168ef4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1640963e0 0x7fd164123960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48050/0 (socket says 172.21.15.92:48050) 2023-09-29T23:26:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.548+0000 7fd168ef4700 1 -- 172.21.15.92:0/82020390 learned_addr learned my addr 172.21.15.92:0/82020390 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.548+0000 7fd168ef4700 1 -- 172.21.15.92:0/82020390 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd154009420 con 0x7fd1640963e0 2023-09-29T23:26:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.548+0000 7fd168ef4700 1 --2- 172.21.15.92:0/82020390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1640963e0 0x7fd164123960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd16000c690 tx=0x7fd160007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.548+0000 7fd158ff9700 1 -- 172.21.15.92:0/82020390 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd160001ea0 con 0x7fd1640963e0 2023-09-29T23:26:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.548+0000 7fd158ff9700 1 -- 172.21.15.92:0/82020390 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd160007580 con 0x7fd1640963e0 2023-09-29T23:26:36.550 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.548+0000 7fd16b158700 1 -- 172.21.15.92:0/82020390 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd164126070 con 0x7fd1640963e0 2023-09-29T23:26:36.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.548+0000 7fd158ff9700 1 -- 172.21.15.92:0/82020390 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd160005950 con 0x7fd1640963e0 2023-09-29T23:26:36.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.548+0000 7fd16b158700 1 -- 172.21.15.92:0/82020390 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16409d9c0 con 0x7fd1640963e0 2023-09-29T23:26:36.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.549+0000 7fd158ff9700 1 -- 172.21.15.92:0/82020390 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fd160005b80 con 0x7fd1640963e0 2023-09-29T23:26:36.551 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.549+0000 7fd16b158700 1 -- 172.21.15.92:0/82020390 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd16405f230 con 0x7fd1640963e0 2023-09-29T23:26:36.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.549+0000 7fd158ff9700 1 --2- 172.21.15.92:0/82020390 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd150035640 0x7fd150037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:36.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.549+0000 7fd158ff9700 1 -- 172.21.15.92:0/82020390 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fd1600472c0 con 0x7fd1640963e0 2023-09-29T23:26:36.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.549+0000 7fd15bfff700 1 --2- 172.21.15.92:0/82020390 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd150035640 0x7fd150037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:36.552 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.550+0000 7fd15bfff700 1 --2- 172.21.15.92:0/82020390 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd150035640 0x7fd150037af0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd1540091e0 tx=0x7fd154017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:36.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.554+0000 7fd158ff9700 1 -- 172.21.15.92:0/82020390 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1600106d0 con 0x7fd1640963e0 2023-09-29T23:26:36.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.779+0000 7fd16b158700 1 -- 172.21.15.92:0/82020390 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd16412c180 con 0x7fd1640963e0 2023-09-29T23:26:36.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.779+0000 7fd158ff9700 1 -- 172.21.15.92:0/82020390 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fd160011360 con 0x7fd1640963e0 2023-09-29T23:26:36.779 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:26:36.779 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:26:36.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.781+0000 7fd16b158700 1 -- 172.21.15.92:0/82020390 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd150035640 msgr2=0x7fd150037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:36.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.781+0000 7fd16b158700 1 --2- 172.21.15.92:0/82020390 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd150035640 0x7fd150037af0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd1540091e0 tx=0x7fd154017000 comp rx=0 tx=0).stop 2023-09-29T23:26:36.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.781+0000 7fd16b158700 1 -- 172.21.15.92:0/82020390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1640963e0 msgr2=0x7fd164123960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:36.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.781+0000 7fd16b158700 1 --2- 172.21.15.92:0/82020390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1640963e0 0x7fd164123960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd16000c690 tx=0x7fd160007da0 comp rx=0 tx=0).stop 2023-09-29T23:26:36.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.781+0000 7fd16b158700 1 -- 172.21.15.92:0/82020390 shutdown_connections 2023-09-29T23:26:36.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.781+0000 7fd16b158700 1 --2- 172.21.15.92:0/82020390 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd150035640 0x7fd150037af0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:36.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.781+0000 7fd16b158700 1 --2- 172.21.15.92:0/82020390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1640963e0 0x7fd164123960 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:36.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.781+0000 7fd16b158700 1 -- 172.21.15.92:0/82020390 >> 172.21.15.92:0/82020390 conn(0x7fd16406bd70 msgr2=0x7fd16412a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:36.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.781+0000 7fd16b158700 1 -- 172.21.15.92:0/82020390 shutdown_connections 2023-09-29T23:26:36.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:36.781+0000 7fd16b158700 1 -- 172.21.15.92:0/82020390 wait complete. 2023-09-29T23:26:39.793 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:26:39.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.914+0000 7f7f0d545700 1 Processor -- start 2023-09-29T23:26:39.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.914+0000 7f7f0d545700 1 -- start start 2023-09-29T23:26:39.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.914+0000 7f7f0d545700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7f0806f210 0x7f7f080977c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:39.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.915+0000 7f7f0d545700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f08098410 con 0x7f7f080a1020 2023-09-29T23:26:39.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.915+0000 7f7f0d545700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0809a7c0 con 0x7f7f0806f210 2023-09-29T23:26:39.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.915+0000 7f7f06ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7f0806f210 0x7f7f080977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:39.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.915+0000 7f7efffff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f7f080a1020 0x7f7f08097d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:46266/0 (socket says 172.21.15.92:46266) 2023-09-29T23:26:39.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.915+0000 7f7efffff700 1 -- 172.21.15.92:0/891409840 learned_addr learned my addr 172.21.15.92:0/891409840 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:26:39.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.915+0000 7f7f06ffd700 1 -- 172.21.15.92:0/891409840 >> v1:172.21.15.92:6789/0 conn(0x7f7f080a1020 legacy=0x7f7f08097d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:39.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.915+0000 7f7f06ffd700 1 -- 172.21.15.92:0/891409840 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f080974b0 con 0x7f7f0806f210 2023-09-29T23:26:39.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.915+0000 7f7f067fc700 1 -- 172.21.15.92:0/891409840 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139790438 0 0) 0x7f7f08098410 con 0x7f7f080a1020 2023-09-29T23:26:39.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.915+0000 7f7f06ffd700 1 --2- 172.21.15.92:0/891409840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f0806f210 0x7f7f080977c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009850 tx=0x7f7ef8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2b438c0812eb7c server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:39.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.915+0000 7f7f067fc700 1 -- 172.21.15.92:0/891409840 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ef8005c10 con 0x7f7f0806f210 2023-09-29T23:26:39.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.915+0000 7f7f067fc700 1 -- 172.21.15.92:0/891409840 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef8005d70 con 0x7f7f0806f210 2023-09-29T23:26:39.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.915+0000 7f7f067fc700 1 -- 172.21.15.92:0/891409840 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ef8006190 con 0x7f7f0806f210 2023-09-29T23:26:39.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.916+0000 7f7f0d545700 1 -- 172.21.15.92:0/891409840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f0806f210 msgr2=0x7f7f080977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:39.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.916+0000 7f7f0d545700 1 --2- 172.21.15.92:0/891409840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f0806f210 0x7f7f080977c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009850 tx=0x7f7ef8009120 comp rx=0 tx=0).stop 2023-09-29T23:26:39.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.916+0000 7f7f0d545700 1 -- 172.21.15.92:0/891409840 shutdown_connections 2023-09-29T23:26:39.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.916+0000 7f7f0d545700 1 --2- 172.21.15.92:0/891409840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f0806f210 0x7f7f080977c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:39.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.916+0000 7f7f0d545700 1 -- 172.21.15.92:0/891409840 >> 172.21.15.92:0/891409840 conn(0x7f7f08094a70 msgr2=0x7f7f0806eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:39.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.916+0000 7f7f0d545700 1 -- 172.21.15.92:0/891409840 shutdown_connections 2023-09-29T23:26:39.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.916+0000 7f7f0d545700 1 -- 172.21.15.92:0/891409840 wait complete. 2023-09-29T23:26:39.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.917+0000 7f7f0d545700 1 Processor -- start 2023-09-29T23:26:39.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.917+0000 7f7f0d545700 1 -- start start 2023-09-29T23:26:39.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.917+0000 7f7f0d545700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f0806f210 0x7f7f08129f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:39.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.917+0000 7f7f0d545700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0811d560 con 0x7f7f0806f210 2023-09-29T23:26:39.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.917+0000 7f7f06ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f0806f210 0x7f7f08129f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:39.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.917+0000 7f7f06ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f0806f210 0x7f7f08129f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48082/0 (socket says 172.21.15.92:48082) 2023-09-29T23:26:39.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.917+0000 7f7f06ffd700 1 -- 172.21.15.92:0/431722539 learned_addr learned my addr 172.21.15.92:0/431722539 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:39.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.917+0000 7f7f06ffd700 1 -- 172.21.15.92:0/431722539 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef80093c0 con 0x7f7f0806f210 2023-09-29T23:26:39.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.917+0000 7f7f06ffd700 1 --2- 172.21.15.92:0/431722539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f0806f210 0x7f7f08129f30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8000c00 tx=0x7f7ef8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:39.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.917+0000 7f7efeffd700 1 -- 172.21.15.92:0/431722539 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ef8011ad0 con 0x7f7f0806f210 2023-09-29T23:26:39.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.918+0000 7f7efeffd700 1 -- 172.21.15.92:0/431722539 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef8011c30 con 0x7f7f0806f210 2023-09-29T23:26:39.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.918+0000 7f7f0d545700 1 -- 172.21.15.92:0/431722539 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0811c660 con 0x7f7f0806f210 2023-09-29T23:26:39.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.918+0000 7f7efeffd700 1 -- 172.21.15.92:0/431722539 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ef801c430 con 0x7f7f0806f210 2023-09-29T23:26:39.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.918+0000 7f7f0d545700 1 -- 172.21.15.92:0/431722539 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0811e740 con 0x7f7f0806f210 2023-09-29T23:26:39.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.918+0000 7f7efeffd700 1 -- 172.21.15.92:0/431722539 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f7ef801c620 con 0x7f7f0806f210 2023-09-29T23:26:39.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.918+0000 7f7efeffd700 1 --2- 172.21.15.92:0/431722539 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7ee8035640 0x7f7ee8037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:39.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.918+0000 7f7f0d545700 1 -- 172.21.15.92:0/431722539 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0805f230 con 0x7f7f0806f210 2023-09-29T23:26:39.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.919+0000 7f7efeffd700 1 -- 172.21.15.92:0/431722539 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f7ef8049a30 con 0x7f7f0806f210 2023-09-29T23:26:39.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.919+0000 7f7efffff700 1 --2- 172.21.15.92:0/431722539 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7ee8035640 0x7f7ee8037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:39.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.919+0000 7f7efffff700 1 --2- 172.21.15.92:0/431722539 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7ee8035640 0x7f7ee8037af0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00011e0 tx=0x7f7ef00079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:39.923 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:39.923+0000 7f7efeffd700 1 -- 172.21.15.92:0/431722539 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ef8024780 con 0x7f7f0806f210 2023-09-29T23:26:40.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:40.146+0000 7f7f0d545700 1 -- 172.21.15.92:0/431722539 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7f0809aa20 con 0x7f7f0806f210 2023-09-29T23:26:40.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:40.146+0000 7f7efeffd700 1 -- 172.21.15.92:0/431722539 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f7ef80243c0 con 0x7f7f0806f210 2023-09-29T23:26:40.146 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:26:40.147 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:26:40.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:40.148+0000 7f7f0d545700 1 -- 172.21.15.92:0/431722539 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7ee8035640 msgr2=0x7f7ee8037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:40.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:40.148+0000 7f7f0d545700 1 --2- 172.21.15.92:0/431722539 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7ee8035640 0x7f7ee8037af0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00011e0 tx=0x7f7ef00079d0 comp rx=0 tx=0).stop 2023-09-29T23:26:40.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:40.148+0000 7f7f0d545700 1 -- 172.21.15.92:0/431722539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f0806f210 msgr2=0x7f7f08129f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:40.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:40.148+0000 7f7f0d545700 1 --2- 172.21.15.92:0/431722539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f0806f210 0x7f7f08129f30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8000c00 tx=0x7f7ef8015000 comp rx=0 tx=0).stop 2023-09-29T23:26:40.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:40.148+0000 7f7f0d545700 1 -- 172.21.15.92:0/431722539 shutdown_connections 2023-09-29T23:26:40.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:40.148+0000 7f7f0d545700 1 --2- 172.21.15.92:0/431722539 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7ee8035640 0x7f7ee8037af0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:40.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:40.148+0000 7f7f0d545700 1 --2- 172.21.15.92:0/431722539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f0806f210 0x7f7f08129f30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:40.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:40.148+0000 7f7f0d545700 1 -- 172.21.15.92:0/431722539 >> 172.21.15.92:0/431722539 conn(0x7f7f08094a70 msgr2=0x7f7f0812c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:40.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:40.148+0000 7f7f0d545700 1 -- 172.21.15.92:0/431722539 shutdown_connections 2023-09-29T23:26:40.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:40.148+0000 7f7f0d545700 1 -- 172.21.15.92:0/431722539 wait complete. 2023-09-29T23:26:43.161 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:26:43.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.280+0000 7fa61ac7c700 1 Processor -- start 2023-09-29T23:26:43.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.280+0000 7fa61ac7c700 1 -- start start 2023-09-29T23:26:43.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.281+0000 7fa61ac7c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa61412fcb0 0x7fa614134620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:43.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.281+0000 7fa61ac7c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6140997f0 con 0x7fa6140a3030 2023-09-29T23:26:43.282 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.281+0000 7fa61ac7c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6140a3400 con 0x7fa61412fcb0 2023-09-29T23:26:43.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.281+0000 7fa60bfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa61412fcb0 0x7fa614134620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:43.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.281+0000 7fa60bfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa61412fcb0 0x7fa614134620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54618/0 (socket says 172.21.15.92:54618) 2023-09-29T23:26:43.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.281+0000 7fa618a18700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fa6140a3030 0x7fa61412f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:41290/0 (socket says 172.21.15.92:41290) 2023-09-29T23:26:43.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.281+0000 7fa60bfff700 1 -- 172.21.15.92:0/3623312162 learned_addr learned my addr 172.21.15.92:0/3623312162 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:43.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.281+0000 7fa60bfff700 1 -- 172.21.15.92:0/3623312162 >> v1:172.21.15.92:6789/0 conn(0x7fa6140a3030 legacy=0x7fa61412f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:43.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.281+0000 7fa60bfff700 1 -- 172.21.15.92:0/3623312162 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6140977a0 con 0x7fa61412fcb0 2023-09-29T23:26:43.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.281+0000 7fa60b7fe700 1 -- 172.21.15.92:0/3623312162 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59886165 0 0) 0x7fa6140997f0 con 0x7fa6140a3030 2023-09-29T23:26:43.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.281+0000 7fa60bfff700 1 --2- 172.21.15.92:0/3623312162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa61412fcb0 0x7fa614134620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa604009930 tx=0x7fa604009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e535f0acdd0298 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:43.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.281+0000 7fa60b7fe700 1 -- 172.21.15.92:0/3623312162 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa60400b8f0 con 0x7fa61412fcb0 2023-09-29T23:26:43.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.281+0000 7fa60b7fe700 1 -- 172.21.15.92:0/3623312162 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60400ba50 con 0x7fa61412fcb0 2023-09-29T23:26:43.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.281+0000 7fa60b7fe700 1 -- 172.21.15.92:0/3623312162 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa60400bbe0 con 0x7fa61412fcb0 2023-09-29T23:26:43.283 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.282+0000 7fa61ac7c700 1 -- 172.21.15.92:0/3623312162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa61412fcb0 msgr2=0x7fa614134620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:43.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.282+0000 7fa61ac7c700 1 --2- 172.21.15.92:0/3623312162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa61412fcb0 0x7fa614134620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa604009930 tx=0x7fa604009250 comp rx=0 tx=0).stop 2023-09-29T23:26:43.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.282+0000 7fa61ac7c700 1 -- 172.21.15.92:0/3623312162 shutdown_connections 2023-09-29T23:26:43.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.282+0000 7fa61ac7c700 1 --2- 172.21.15.92:0/3623312162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa61412fcb0 0x7fa614134620 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:43.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.282+0000 7fa61ac7c700 1 -- 172.21.15.92:0/3623312162 >> 172.21.15.92:0/3623312162 conn(0x7fa614067fc0 msgr2=0x7fa6140a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:43.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.282+0000 7fa61ac7c700 1 -- 172.21.15.92:0/3623312162 shutdown_connections 2023-09-29T23:26:43.284 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.282+0000 7fa61ac7c700 1 -- 172.21.15.92:0/3623312162 wait complete. 2023-09-29T23:26:43.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.283+0000 7fa61ac7c700 1 Processor -- start 2023-09-29T23:26:43.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.283+0000 7fa61ac7c700 1 -- start start 2023-09-29T23:26:43.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.283+0000 7fa61ac7c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6140a3030 0x7fa61412c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:43.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.283+0000 7fa61ac7c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61411e710 con 0x7fa6140a3030 2023-09-29T23:26:43.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.283+0000 7fa618a18700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6140a3030 0x7fa61412c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:43.286 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.283+0000 7fa618a18700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6140a3030 0x7fa61412c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54620/0 (socket says 172.21.15.92:54620) 2023-09-29T23:26:43.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.283+0000 7fa618a18700 1 -- 172.21.15.92:0/626968965 learned_addr learned my addr 172.21.15.92:0/626968965 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:43.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.283+0000 7fa618a18700 1 -- 172.21.15.92:0/626968965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6040094f0 con 0x7fa6140a3030 2023-09-29T23:26:43.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.284+0000 7fa618a18700 1 --2- 172.21.15.92:0/626968965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6140a3030 0x7fa61412c150 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa61000c710 tx=0x7fa610007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:43.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.284+0000 7fa608ff9700 1 -- 172.21.15.92:0/626968965 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa610005b90 con 0x7fa6140a3030 2023-09-29T23:26:43.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.284+0000 7fa608ff9700 1 -- 172.21.15.92:0/626968965 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa610005cf0 con 0x7fa6140a3030 2023-09-29T23:26:43.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.284+0000 7fa61ac7c700 1 -- 172.21.15.92:0/626968965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61411ec50 con 0x7fa6140a3030 2023-09-29T23:26:43.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.284+0000 7fa608ff9700 1 -- 172.21.15.92:0/626968965 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa6100070d0 con 0x7fa6140a3030 2023-09-29T23:26:43.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.284+0000 7fa61ac7c700 1 -- 172.21.15.92:0/626968965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61411e940 con 0x7fa6140a3030 2023-09-29T23:26:43.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.285+0000 7fa608ff9700 1 -- 172.21.15.92:0/626968965 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fa610007230 con 0x7fa6140a3030 2023-09-29T23:26:43.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.285+0000 7fa61ac7c700 1 -- 172.21.15.92:0/626968965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61411b490 con 0x7fa6140a3030 2023-09-29T23:26:43.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.285+0000 7fa608ff9700 1 --2- 172.21.15.92:0/626968965 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa600035640 0x7fa600037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:43.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.285+0000 7fa608ff9700 1 -- 172.21.15.92:0/626968965 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fa610046a80 con 0x7fa6140a3030 2023-09-29T23:26:43.287 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.285+0000 7fa60bfff700 1 --2- 172.21.15.92:0/626968965 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa600035640 0x7fa600037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:43.288 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.285+0000 7fa60bfff700 1 --2- 172.21.15.92:0/626968965 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa600035640 0x7fa600037af0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa604009930 tx=0x7fa604016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:43.289 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.289+0000 7fa608ff9700 1 -- 172.21.15.92:0/626968965 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa61000eb10 con 0x7fa6140a3030 2023-09-29T23:26:43.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.511+0000 7fa61ac7c700 1 -- 172.21.15.92:0/626968965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa614096410 con 0x7fa6140a3030 2023-09-29T23:26:43.512 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.512+0000 7fa608ff9700 1 -- 172.21.15.92:0/626968965 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fa610017020 con 0x7fa6140a3030 2023-09-29T23:26:43.512 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:26:43.512 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:26:43.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.514+0000 7fa61ac7c700 1 -- 172.21.15.92:0/626968965 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa600035640 msgr2=0x7fa600037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:43.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.514+0000 7fa61ac7c700 1 --2- 172.21.15.92:0/626968965 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa600035640 0x7fa600037af0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa604009930 tx=0x7fa604016000 comp rx=0 tx=0).stop 2023-09-29T23:26:43.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.514+0000 7fa61ac7c700 1 -- 172.21.15.92:0/626968965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6140a3030 msgr2=0x7fa61412c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:43.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.514+0000 7fa61ac7c700 1 --2- 172.21.15.92:0/626968965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6140a3030 0x7fa61412c150 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa61000c710 tx=0x7fa610007d90 comp rx=0 tx=0).stop 2023-09-29T23:26:43.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.514+0000 7fa61ac7c700 1 -- 172.21.15.92:0/626968965 shutdown_connections 2023-09-29T23:26:43.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.514+0000 7fa61ac7c700 1 --2- 172.21.15.92:0/626968965 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa600035640 0x7fa600037af0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:43.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.514+0000 7fa61ac7c700 1 --2- 172.21.15.92:0/626968965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6140a3030 0x7fa61412c150 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:43.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.514+0000 7fa61ac7c700 1 -- 172.21.15.92:0/626968965 >> 172.21.15.92:0/626968965 conn(0x7fa614067fc0 msgr2=0x7fa61412d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:43.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.514+0000 7fa61ac7c700 1 -- 172.21.15.92:0/626968965 shutdown_connections 2023-09-29T23:26:43.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:43.514+0000 7fa61ac7c700 1 -- 172.21.15.92:0/626968965 wait complete. 2023-09-29T23:26:46.526 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:26:46.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.655+0000 7fe92ca57700 1 Processor -- start 2023-09-29T23:26:46.655 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.655+0000 7fe92ca57700 1 -- start start 2023-09-29T23:26:46.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.655+0000 7fe92ca57700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe928096ca0 0x7fe928097070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:46.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.655+0000 7fe92ca57700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe928098700 con 0x7fe9280975b0 2023-09-29T23:26:46.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.655+0000 7fe92ca57700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe92809f430 con 0x7fe928096ca0 2023-09-29T23:26:46.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.655+0000 7fe92659c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe928096ca0 0x7fe928097070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:46.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.656+0000 7fe925d9b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fe9280975b0 0x7fe928130630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:41302/0 (socket says 172.21.15.92:41302) 2023-09-29T23:26:46.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.656+0000 7fe925d9b700 1 -- 172.21.15.92:0/948612673 learned_addr learned my addr 172.21.15.92:0/948612673 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:26:46.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.656+0000 7fe92659c700 1 -- 172.21.15.92:0/948612673 >> v1:172.21.15.92:6789/0 conn(0x7fe9280975b0 legacy=0x7fe928130630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:46.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.656+0000 7fe92659c700 1 -- 172.21.15.92:0/948612673 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92806fab0 con 0x7fe928096ca0 2023-09-29T23:26:46.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.656+0000 7fe92559a700 1 -- 172.21.15.92:0/948612673 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244578020 0 0) 0x7fe928098700 con 0x7fe9280975b0 2023-09-29T23:26:46.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.656+0000 7fe92659c700 1 --2- 172.21.15.92:0/948612673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe928096ca0 0x7fe928097070 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe920009e30 tx=0x7fe920009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1b43b11386cae3 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:46.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.656+0000 7fe92559a700 1 -- 172.21.15.92:0/948612673 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe92000e070 con 0x7fe928096ca0 2023-09-29T23:26:46.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.656+0000 7fe92559a700 1 -- 172.21.15.92:0/948612673 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92000bd70 con 0x7fe928096ca0 2023-09-29T23:26:46.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.656+0000 7fe92559a700 1 -- 172.21.15.92:0/948612673 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9200125b0 con 0x7fe928096ca0 2023-09-29T23:26:46.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.657+0000 7fe92ca57700 1 -- 172.21.15.92:0/948612673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe928096ca0 msgr2=0x7fe928097070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:46.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.657+0000 7fe92ca57700 1 --2- 172.21.15.92:0/948612673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe928096ca0 0x7fe928097070 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe920009e30 tx=0x7fe920009780 comp rx=0 tx=0).stop 2023-09-29T23:26:46.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.657+0000 7fe92ca57700 1 -- 172.21.15.92:0/948612673 shutdown_connections 2023-09-29T23:26:46.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.657+0000 7fe92ca57700 1 --2- 172.21.15.92:0/948612673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe928096ca0 0x7fe928097070 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:46.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.657+0000 7fe92ca57700 1 -- 172.21.15.92:0/948612673 >> 172.21.15.92:0/948612673 conn(0x7fe92806bd70 msgr2=0x7fe92806e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:46.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.657+0000 7fe92ca57700 1 -- 172.21.15.92:0/948612673 shutdown_connections 2023-09-29T23:26:46.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.657+0000 7fe92ca57700 1 -- 172.21.15.92:0/948612673 wait complete. 2023-09-29T23:26:46.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.658+0000 7fe92ca57700 1 Processor -- start 2023-09-29T23:26:46.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.658+0000 7fe92ca57700 1 -- start start 2023-09-29T23:26:46.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.658+0000 7fe92ca57700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe928096ca0 0x7fe92808afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:46.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.658+0000 7fe92ca57700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92808e250 con 0x7fe928096ca0 2023-09-29T23:26:46.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.658+0000 7fe92659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe928096ca0 0x7fe92808afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:46.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.658+0000 7fe92659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe928096ca0 0x7fe92808afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54640/0 (socket says 172.21.15.92:54640) 2023-09-29T23:26:46.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.658+0000 7fe92659c700 1 -- 172.21.15.92:0/1283309409 learned_addr learned my addr 172.21.15.92:0/1283309409 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:46.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.658+0000 7fe92659c700 1 -- 172.21.15.92:0/1283309409 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe920009a20 con 0x7fe928096ca0 2023-09-29T23:26:46.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.658+0000 7fe92659c700 1 --2- 172.21.15.92:0/1283309409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe928096ca0 0x7fe92808afc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe9200099f0 tx=0x7fe920018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:46.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.659+0000 7fe91e7fc700 1 -- 172.21.15.92:0/1283309409 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe920027470 con 0x7fe928096ca0 2023-09-29T23:26:46.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.659+0000 7fe91e7fc700 1 -- 172.21.15.92:0/1283309409 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9200275d0 con 0x7fe928096ca0 2023-09-29T23:26:46.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.659+0000 7fe91e7fc700 1 -- 172.21.15.92:0/1283309409 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9200278c0 con 0x7fe928096ca0 2023-09-29T23:26:46.661 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.659+0000 7fe92ca57700 1 -- 172.21.15.92:0/1283309409 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92808dfb0 con 0x7fe928096ca0 2023-09-29T23:26:46.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.659+0000 7fe92ca57700 1 -- 172.21.15.92:0/1283309409 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92808e800 con 0x7fe928096ca0 2023-09-29T23:26:46.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.659+0000 7fe91e7fc700 1 -- 172.21.15.92:0/1283309409 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fe920024070 con 0x7fe928096ca0 2023-09-29T23:26:46.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.660+0000 7fe92ca57700 1 -- 172.21.15.92:0/1283309409 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9280994e0 con 0x7fe928096ca0 2023-09-29T23:26:46.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.660+0000 7fe91e7fc700 1 --2- 172.21.15.92:0/1283309409 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fe908035630 0x7fe908037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:46.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.660+0000 7fe91e7fc700 1 -- 172.21.15.92:0/1283309409 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fe920049e00 con 0x7fe928096ca0 2023-09-29T23:26:46.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.660+0000 7fe925d9b700 1 --2- 172.21.15.92:0/1283309409 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fe908035630 0x7fe908037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:46.662 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.660+0000 7fe925d9b700 1 --2- 172.21.15.92:0/1283309409 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fe908035630 0x7fe908037ae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe9100011e0 tx=0x7fe9100079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:46.664 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.664+0000 7fe91e7fc700 1 -- 172.21.15.92:0/1283309409 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe920011390 con 0x7fe928096ca0 2023-09-29T23:26:46.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.885+0000 7fe92ca57700 1 -- 172.21.15.92:0/1283309409 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe92805f230 con 0x7fe928096ca0 2023-09-29T23:26:46.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.886+0000 7fe91e7fc700 1 -- 172.21.15.92:0/1283309409 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fe92001cba0 con 0x7fe928096ca0 2023-09-29T23:26:46.886 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:26:46.886 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:26:46.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.887+0000 7fe92ca57700 1 -- 172.21.15.92:0/1283309409 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fe908035630 msgr2=0x7fe908037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:46.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.887+0000 7fe92ca57700 1 --2- 172.21.15.92:0/1283309409 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fe908035630 0x7fe908037ae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe9100011e0 tx=0x7fe9100079d0 comp rx=0 tx=0).stop 2023-09-29T23:26:46.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.887+0000 7fe92ca57700 1 -- 172.21.15.92:0/1283309409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe928096ca0 msgr2=0x7fe92808afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:46.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.887+0000 7fe92ca57700 1 --2- 172.21.15.92:0/1283309409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe928096ca0 0x7fe92808afc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe9200099f0 tx=0x7fe920018000 comp rx=0 tx=0).stop 2023-09-29T23:26:46.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.887+0000 7fe92ca57700 1 -- 172.21.15.92:0/1283309409 shutdown_connections 2023-09-29T23:26:46.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.887+0000 7fe92ca57700 1 --2- 172.21.15.92:0/1283309409 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fe908035630 0x7fe908037ae0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:46.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.887+0000 7fe92ca57700 1 --2- 172.21.15.92:0/1283309409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe928096ca0 0x7fe92808afc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:46.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.887+0000 7fe92ca57700 1 -- 172.21.15.92:0/1283309409 >> 172.21.15.92:0/1283309409 conn(0x7fe92806bd70 msgr2=0x7fe92806d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:46.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.888+0000 7fe92ca57700 1 -- 172.21.15.92:0/1283309409 shutdown_connections 2023-09-29T23:26:46.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:46.888+0000 7fe92ca57700 1 -- 172.21.15.92:0/1283309409 wait complete. 2023-09-29T23:26:49.900 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:26:50.028 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.028+0000 7fec03fff700 1 Processor -- start 2023-09-29T23:26:50.029 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.028+0000 7fec03fff700 1 -- start start 2023-09-29T23:26:50.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.029+0000 7fec03fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fec0412c8b0 0x7fec04134400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:50.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.029+0000 7fec03fff700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec040685e0 con 0x7fec04067eb0 2023-09-29T23:26:50.030 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.029+0000 7fec03fff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec04068280 con 0x7fec0412c8b0 2023-09-29T23:26:50.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.029+0000 7fec027fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fec0412c8b0 0x7fec04134400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:50.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.029+0000 7fec02ffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fec04067eb0 0x7fec0412c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:41316/0 (socket says 172.21.15.92:41316) 2023-09-29T23:26:50.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.029+0000 7fec02ffd700 1 -- 172.21.15.92:0/2334885794 learned_addr learned my addr 172.21.15.92:0/2334885794 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:26:50.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.029+0000 7fec027fc700 1 -- 172.21.15.92:0/2334885794 >> v1:172.21.15.92:6789/0 conn(0x7fec04067eb0 legacy=0x7fec0412c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:50.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.029+0000 7fec01ffb700 1 -- 172.21.15.92:0/2334885794 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305602845 0 0) 0x7fec040685e0 con 0x7fec04067eb0 2023-09-29T23:26:50.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.029+0000 7fec027fc700 1 -- 172.21.15.92:0/2334885794 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0412cce0 con 0x7fec0412c8b0 2023-09-29T23:26:50.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.029+0000 7fec027fc700 1 --2- 172.21.15.92:0/2334885794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec0412c8b0 0x7fec04134400 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7febec009860 tx=0x7febec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdfc6e2ab75afb90 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:50.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.029+0000 7fec01ffb700 1 -- 172.21.15.92:0/2334885794 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febec00b680 con 0x7fec0412c8b0 2023-09-29T23:26:50.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.029+0000 7fec01ffb700 1 -- 172.21.15.92:0/2334885794 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec00b7e0 con 0x7fec0412c8b0 2023-09-29T23:26:50.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.029+0000 7fec01ffb700 1 -- 172.21.15.92:0/2334885794 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febec00bad0 con 0x7fec0412c8b0 2023-09-29T23:26:50.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.030+0000 7fec03fff700 1 -- 172.21.15.92:0/2334885794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec0412c8b0 msgr2=0x7fec04134400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:50.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.030+0000 7fec03fff700 1 --2- 172.21.15.92:0/2334885794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec0412c8b0 0x7fec04134400 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7febec009860 tx=0x7febec0091a0 comp rx=0 tx=0).stop 2023-09-29T23:26:50.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.030+0000 7fec03fff700 1 -- 172.21.15.92:0/2334885794 shutdown_connections 2023-09-29T23:26:50.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.030+0000 7fec03fff700 1 --2- 172.21.15.92:0/2334885794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec0412c8b0 0x7fec04134400 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:50.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.030+0000 7fec03fff700 1 -- 172.21.15.92:0/2334885794 >> 172.21.15.92:0/2334885794 conn(0x7fec04094df0 msgr2=0x7fec0406d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:50.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.030+0000 7fec03fff700 1 -- 172.21.15.92:0/2334885794 shutdown_connections 2023-09-29T23:26:50.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.030+0000 7fec03fff700 1 -- 172.21.15.92:0/2334885794 wait complete. 2023-09-29T23:26:50.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.031+0000 7fec03fff700 1 Processor -- start 2023-09-29T23:26:50.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.031+0000 7fec03fff700 1 -- start start 2023-09-29T23:26:50.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.031+0000 7fec03fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec04067eb0 0x7fec04117b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:50.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.031+0000 7fec03fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0411b600 con 0x7fec04067eb0 2023-09-29T23:26:50.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.032+0000 7fec02ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec04067eb0 0x7fec04117b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:50.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.032+0000 7fec02ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec04067eb0 0x7fec04117b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54652/0 (socket says 172.21.15.92:54652) 2023-09-29T23:26:50.034 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.032+0000 7fec02ffd700 1 -- 172.21.15.92:0/279911717 learned_addr learned my addr 172.21.15.92:0/279911717 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:50.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.032+0000 7fec02ffd700 1 -- 172.21.15.92:0/279911717 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec009420 con 0x7fec04067eb0 2023-09-29T23:26:50.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.032+0000 7fec02ffd700 1 --2- 172.21.15.92:0/279911717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec04067eb0 0x7fec04117b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7febfc00cbc0 tx=0x7febfc0019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:50.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.032+0000 7febfaffd700 1 -- 172.21.15.92:0/279911717 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febfc00a970 con 0x7fec04067eb0 2023-09-29T23:26:50.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.032+0000 7febfaffd700 1 -- 172.21.15.92:0/279911717 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc00aaf0 con 0x7fec04067eb0 2023-09-29T23:26:50.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.032+0000 7fec03fff700 1 -- 172.21.15.92:0/279911717 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec04129ab0 con 0x7fec04067eb0 2023-09-29T23:26:50.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.032+0000 7febfaffd700 1 -- 172.21.15.92:0/279911717 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febfc00ade0 con 0x7fec04067eb0 2023-09-29T23:26:50.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.032+0000 7fec03fff700 1 -- 172.21.15.92:0/279911717 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec041196d0 con 0x7fec04067eb0 2023-09-29T23:26:50.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.033+0000 7febfaffd700 1 -- 172.21.15.92:0/279911717 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7febfc0070f0 con 0x7fec04067eb0 2023-09-29T23:26:50.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.033+0000 7fec03fff700 1 -- 172.21.15.92:0/279911717 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0409cee0 con 0x7fec04067eb0 2023-09-29T23:26:50.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.033+0000 7febfaffd700 1 --2- 172.21.15.92:0/279911717 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7febe4035630 0x7febe4037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:50.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.033+0000 7febfaffd700 1 -- 172.21.15.92:0/279911717 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7febfc047a20 con 0x7fec04067eb0 2023-09-29T23:26:50.035 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.033+0000 7fec027fc700 1 --2- 172.21.15.92:0/279911717 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7febe4035630 0x7febe4037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:50.036 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.034+0000 7fec027fc700 1 --2- 172.21.15.92:0/279911717 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7febe4035630 0x7febe4037ae0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7febec006eb0 tx=0x7febec016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:50.038 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.038+0000 7febfaffd700 1 -- 172.21.15.92:0/279911717 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febfc0108f0 con 0x7fec04067eb0 2023-09-29T23:26:50.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.263+0000 7fec03fff700 1 -- 172.21.15.92:0/279911717 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fec0405f230 con 0x7fec04067eb0 2023-09-29T23:26:50.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.263+0000 7febfaffd700 1 -- 172.21.15.92:0/279911717 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7febfc0113a0 con 0x7fec04067eb0 2023-09-29T23:26:50.263 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:26:50.264 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:26:50.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.265+0000 7fec03fff700 1 -- 172.21.15.92:0/279911717 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7febe4035630 msgr2=0x7febe4037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:50.265 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.265+0000 7fec03fff700 1 --2- 172.21.15.92:0/279911717 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7febe4035630 0x7febe4037ae0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7febec006eb0 tx=0x7febec016000 comp rx=0 tx=0).stop 2023-09-29T23:26:50.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.265+0000 7fec03fff700 1 -- 172.21.15.92:0/279911717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec04067eb0 msgr2=0x7fec04117b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:50.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.265+0000 7fec03fff700 1 --2- 172.21.15.92:0/279911717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec04067eb0 0x7fec04117b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7febfc00cbc0 tx=0x7febfc0019e0 comp rx=0 tx=0).stop 2023-09-29T23:26:50.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.265+0000 7fec03fff700 1 -- 172.21.15.92:0/279911717 shutdown_connections 2023-09-29T23:26:50.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.265+0000 7fec03fff700 1 --2- 172.21.15.92:0/279911717 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7febe4035630 0x7febe4037ae0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:50.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.265+0000 7fec03fff700 1 --2- 172.21.15.92:0/279911717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec04067eb0 0x7fec04117b90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:50.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.265+0000 7fec03fff700 1 -- 172.21.15.92:0/279911717 >> 172.21.15.92:0/279911717 conn(0x7fec04094df0 msgr2=0x7fec0412aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:50.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.265+0000 7fec03fff700 1 -- 172.21.15.92:0/279911717 shutdown_connections 2023-09-29T23:26:50.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:50.265+0000 7fec03fff700 1 -- 172.21.15.92:0/279911717 wait complete. 2023-09-29T23:26:53.278 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:26:53.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.399+0000 7fe0500d6700 1 Processor -- start 2023-09-29T23:26:53.399 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.399+0000 7fe0500d6700 1 -- start start 2023-09-29T23:26:53.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.400+0000 7fe0500d6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe04809fd80 0x7fe0480a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:53.401 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.400+0000 7fe0500d6700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe048098710 con 0x7fe04812f8b0 2023-09-29T23:26:53.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.400+0000 7fe0500d6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04812f340 con 0x7fe04809fd80 2023-09-29T23:26:53.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.400+0000 7fe04de72700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe04809fd80 0x7fe0480a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:53.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.400+0000 7fe04d671700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fe04812f8b0 0x7fe048095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:60842/0 (socket says 172.21.15.92:60842) 2023-09-29T23:26:53.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.400+0000 7fe04d671700 1 -- 172.21.15.92:0/2416429590 learned_addr learned my addr 172.21.15.92:0/2416429590 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:26:53.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.400+0000 7fe04de72700 1 -- 172.21.15.92:0/2416429590 >> v1:172.21.15.92:6789/0 conn(0x7fe04812f8b0 legacy=0x7fe048095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:53.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.400+0000 7fe04de72700 1 -- 172.21.15.92:0/2416429590 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0480997e0 con 0x7fe04809fd80 2023-09-29T23:26:53.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.400+0000 7fe04ce70700 1 -- 172.21.15.92:0/2416429590 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297884 0 0) 0x7fe048098710 con 0x7fe04812f8b0 2023-09-29T23:26:53.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.400+0000 7fe04de72700 1 --2- 172.21.15.92:0/2416429590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe04809fd80 0x7fe0480a3090 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe044009de0 tx=0x7fe044009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2f3545b7e8a83c server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:53.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.401+0000 7fe04ce70700 1 -- 172.21.15.92:0/2416429590 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe04400e070 con 0x7fe04809fd80 2023-09-29T23:26:53.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.401+0000 7fe04ce70700 1 -- 172.21.15.92:0/2416429590 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04400bc80 con 0x7fe04809fd80 2023-09-29T23:26:53.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.401+0000 7fe04ce70700 1 -- 172.21.15.92:0/2416429590 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe044012430 con 0x7fe04809fd80 2023-09-29T23:26:53.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.401+0000 7fe0500d6700 1 -- 172.21.15.92:0/2416429590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe04809fd80 msgr2=0x7fe0480a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:53.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.401+0000 7fe0500d6700 1 --2- 172.21.15.92:0/2416429590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe04809fd80 0x7fe0480a3090 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe044009de0 tx=0x7fe044009780 comp rx=0 tx=0).stop 2023-09-29T23:26:53.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.401+0000 7fe0500d6700 1 -- 172.21.15.92:0/2416429590 shutdown_connections 2023-09-29T23:26:53.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.401+0000 7fe0500d6700 1 --2- 172.21.15.92:0/2416429590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe04809fd80 0x7fe0480a3090 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:53.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.401+0000 7fe0500d6700 1 -- 172.21.15.92:0/2416429590 >> 172.21.15.92:0/2416429590 conn(0x7fe048068000 msgr2=0x7fe0480a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:53.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.401+0000 7fe0500d6700 1 -- 172.21.15.92:0/2416429590 shutdown_connections 2023-09-29T23:26:53.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.401+0000 7fe0500d6700 1 -- 172.21.15.92:0/2416429590 wait complete. 2023-09-29T23:26:53.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.402+0000 7fe0500d6700 1 Processor -- start 2023-09-29T23:26:53.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.402+0000 7fe0500d6700 1 -- start start 2023-09-29T23:26:53.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.402+0000 7fe0500d6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe04809fd80 0x7fe04813e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:53.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.402+0000 7fe0500d6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04811e2c0 con 0x7fe04809fd80 2023-09-29T23:26:53.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.402+0000 7fe04de72700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe04809fd80 0x7fe04813e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:53.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.402+0000 7fe04de72700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe04809fd80 0x7fe04813e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59232/0 (socket says 172.21.15.92:59232) 2023-09-29T23:26:53.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.402+0000 7fe04de72700 1 -- 172.21.15.92:0/3488210918 learned_addr learned my addr 172.21.15.92:0/3488210918 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:53.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.403+0000 7fe04de72700 1 -- 172.21.15.92:0/3488210918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe044009a20 con 0x7fe04809fd80 2023-09-29T23:26:53.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.403+0000 7fe04de72700 1 --2- 172.21.15.92:0/3488210918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe04809fd80 0x7fe04813e520 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe0440097c0 tx=0x7fe044018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:53.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.403+0000 7fe03dffb700 1 -- 172.21.15.92:0/3488210918 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0440275b0 con 0x7fe04809fd80 2023-09-29T23:26:53.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.403+0000 7fe03dffb700 1 -- 172.21.15.92:0/3488210918 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe044027710 con 0x7fe04809fd80 2023-09-29T23:26:53.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.403+0000 7fe0500d6700 1 -- 172.21.15.92:0/3488210918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04811c590 con 0x7fe04809fd80 2023-09-29T23:26:53.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.403+0000 7fe03dffb700 1 -- 172.21.15.92:0/3488210918 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe044027a00 con 0x7fe04809fd80 2023-09-29T23:26:53.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.403+0000 7fe0500d6700 1 -- 172.21.15.92:0/3488210918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04811d1c0 con 0x7fe04809fd80 2023-09-29T23:26:53.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.404+0000 7fe03dffb700 1 -- 172.21.15.92:0/3488210918 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fe044024070 con 0x7fe04809fd80 2023-09-29T23:26:53.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.404+0000 7fe0500d6700 1 -- 172.21.15.92:0/3488210918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04811e410 con 0x7fe04809fd80 2023-09-29T23:26:53.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.404+0000 7fe03dffb700 1 --2- 172.21.15.92:0/3488210918 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fe02c035640 0x7fe02c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:53.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.404+0000 7fe03dffb700 1 -- 172.21.15.92:0/3488210918 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fe04404a2e0 con 0x7fe04809fd80 2023-09-29T23:26:53.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.404+0000 7fe04d671700 1 --2- 172.21.15.92:0/3488210918 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fe02c035640 0x7fe02c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:53.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.405+0000 7fe04d671700 1 --2- 172.21.15.92:0/3488210918 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fe02c035640 0x7fe02c037af0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe0380011e0 tx=0x7fe0380079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:53.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.409+0000 7fe03dffb700 1 -- 172.21.15.92:0/3488210918 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe04401cd80 con 0x7fe04809fd80 2023-09-29T23:26:53.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.633+0000 7fe0500d6700 1 -- 172.21.15.92:0/3488210918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe04805f230 con 0x7fe04809fd80 2023-09-29T23:26:53.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.634+0000 7fe03dffb700 1 -- 172.21.15.92:0/3488210918 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fe04401cba0 con 0x7fe04809fd80 2023-09-29T23:26:53.634 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:26:53.635 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:26:53.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.636+0000 7fe0500d6700 1 -- 172.21.15.92:0/3488210918 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fe02c035640 msgr2=0x7fe02c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:53.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.636+0000 7fe0500d6700 1 --2- 172.21.15.92:0/3488210918 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fe02c035640 0x7fe02c037af0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe0380011e0 tx=0x7fe0380079d0 comp rx=0 tx=0).stop 2023-09-29T23:26:53.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.636+0000 7fe0500d6700 1 -- 172.21.15.92:0/3488210918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe04809fd80 msgr2=0x7fe04813e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:53.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.636+0000 7fe0500d6700 1 --2- 172.21.15.92:0/3488210918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe04809fd80 0x7fe04813e520 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe0440097c0 tx=0x7fe044018000 comp rx=0 tx=0).stop 2023-09-29T23:26:53.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.636+0000 7fe0500d6700 1 -- 172.21.15.92:0/3488210918 shutdown_connections 2023-09-29T23:26:53.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.636+0000 7fe0500d6700 1 --2- 172.21.15.92:0/3488210918 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fe02c035640 0x7fe02c037af0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:53.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.636+0000 7fe0500d6700 1 --2- 172.21.15.92:0/3488210918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe04809fd80 0x7fe04813e520 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:53.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.636+0000 7fe0500d6700 1 -- 172.21.15.92:0/3488210918 >> 172.21.15.92:0/3488210918 conn(0x7fe048068000 msgr2=0x7fe048094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:53.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.636+0000 7fe0500d6700 1 -- 172.21.15.92:0/3488210918 shutdown_connections 2023-09-29T23:26:53.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:53.636+0000 7fe0500d6700 1 -- 172.21.15.92:0/3488210918 wait complete. 2023-09-29T23:26:56.649 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:26:56.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.779+0000 7f693f3f4700 1 Processor -- start 2023-09-29T23:26:56.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.779+0000 7f693f3f4700 1 -- start start 2023-09-29T23:26:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.780+0000 7f693f3f4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f693806b0c0 0x7f693812f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.780+0000 7f693f3f4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693809ca80 con 0x7f693812fb70 2023-09-29T23:26:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.780+0000 7f693f3f4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693806b490 con 0x7f693806b0c0 2023-09-29T23:26:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.780+0000 7f693e3f2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f693806b0c0 0x7f693812f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.780+0000 7f693dbf1700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f693812fb70 0x7f6938099530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:60844/0 (socket says 172.21.15.92:60844) 2023-09-29T23:26:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.780+0000 7f693dbf1700 1 -- 172.21.15.92:0/475160789 learned_addr learned my addr 172.21.15.92:0/475160789 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:26:56.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.780+0000 7f693e3f2700 1 --2- 172.21.15.92:0/475160789 >> v2:172.21.15.92:3300/0 conn(0x7f693806b0c0 0x7f693812f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59236/0 (socket says 172.21.15.92:59236) 2023-09-29T23:26:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.780+0000 7f693e3f2700 1 -- 172.21.15.92:0/475160789 >> v1:172.21.15.92:6789/0 conn(0x7f693812fb70 legacy=0x7f6938099530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.780+0000 7f693d3f0700 1 -- 172.21.15.92:0/475160789 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289946962 0 0) 0x7f6928001110 con 0x7f693812fb70 2023-09-29T23:26:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.780+0000 7f693e3f2700 1 -- 172.21.15.92:0/475160789 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693809be20 con 0x7f693806b0c0 2023-09-29T23:26:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.781+0000 7f693e3f2700 1 --2- 172.21.15.92:0/475160789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f693806b0c0 0x7f693812f630 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6934009860 tx=0x7f69340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2342f7e3f635fb60 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.781+0000 7f693d3f0700 1 -- 172.21.15.92:0/475160789 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f693400b680 con 0x7f693806b0c0 2023-09-29T23:26:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.781+0000 7f693d3f0700 1 -- 172.21.15.92:0/475160789 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693400b7e0 con 0x7f693806b0c0 2023-09-29T23:26:56.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.781+0000 7f693d3f0700 1 -- 172.21.15.92:0/475160789 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f693400bad0 con 0x7f693806b0c0 2023-09-29T23:26:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.781+0000 7f693f3f4700 1 -- 172.21.15.92:0/475160789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f693806b0c0 msgr2=0x7f693812f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.781+0000 7f693f3f4700 1 --2- 172.21.15.92:0/475160789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f693806b0c0 0x7f693812f630 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6934009860 tx=0x7f69340091a0 comp rx=0 tx=0).stop 2023-09-29T23:26:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.781+0000 7f693f3f4700 1 -- 172.21.15.92:0/475160789 shutdown_connections 2023-09-29T23:26:56.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.781+0000 7f693f3f4700 1 --2- 172.21.15.92:0/475160789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f693806b0c0 0x7f693812f630 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.781+0000 7f693f3f4700 1 -- 172.21.15.92:0/475160789 >> 172.21.15.92:0/475160789 conn(0x7f693806a5b0 msgr2=0x7f693806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.781+0000 7f693f3f4700 1 -- 172.21.15.92:0/475160789 shutdown_connections 2023-09-29T23:26:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.781+0000 7f693f3f4700 1 -- 172.21.15.92:0/475160789 wait complete. 2023-09-29T23:26:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.782+0000 7f693f3f4700 1 Processor -- start 2023-09-29T23:26:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.782+0000 7f693f3f4700 1 -- start start 2023-09-29T23:26:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.783+0000 7f693f3f4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f693806b0c0 0x7f693811dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.783+0000 7f693f3f4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693811a7b0 con 0x7f693806b0c0 2023-09-29T23:26:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.783+0000 7f693e3f2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f693806b0c0 0x7f693811dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.783+0000 7f693e3f2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f693806b0c0 0x7f693811dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59244/0 (socket says 172.21.15.92:59244) 2023-09-29T23:26:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.783+0000 7f693e3f2700 1 -- 172.21.15.92:0/2719451531 learned_addr learned my addr 172.21.15.92:0/2719451531 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:26:56.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.783+0000 7f693e3f2700 1 -- 172.21.15.92:0/2719451531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6934009420 con 0x7f693806b0c0 2023-09-29T23:26:56.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.783+0000 7f693e3f2700 1 --2- 172.21.15.92:0/2719451531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f693806b0c0 0x7f693811dfe0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6934006eb0 tx=0x7f6934016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:56.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.783+0000 7f692e7fc700 1 -- 172.21.15.92:0/2719451531 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6934025470 con 0x7f693806b0c0 2023-09-29T23:26:56.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.783+0000 7f692e7fc700 1 -- 172.21.15.92:0/2719451531 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69340255d0 con 0x7f693806b0c0 2023-09-29T23:26:56.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.783+0000 7f693f3f4700 1 -- 172.21.15.92:0/2719451531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693812cea0 con 0x7f693806b0c0 2023-09-29T23:26:56.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.783+0000 7f692e7fc700 1 -- 172.21.15.92:0/2719451531 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6934025880 con 0x7f693806b0c0 2023-09-29T23:26:56.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.783+0000 7f693f3f4700 1 -- 172.21.15.92:0/2719451531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693811e6c0 con 0x7f693806b0c0 2023-09-29T23:26:56.786 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.784+0000 7f692e7fc700 1 -- 172.21.15.92:0/2719451531 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f6934022070 con 0x7f693806b0c0 2023-09-29T23:26:56.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.784+0000 7f692e7fc700 1 --2- 172.21.15.92:0/2719451531 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f691c035640 0x7f691c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:26:56.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.784+0000 7f693f3f4700 1 -- 172.21.15.92:0/2719451531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693805f230 con 0x7f693806b0c0 2023-09-29T23:26:56.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.785+0000 7f692e7fc700 1 -- 172.21.15.92:0/2719451531 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f6934049530 con 0x7f693806b0c0 2023-09-29T23:26:56.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.785+0000 7f693dbf1700 1 --2- 172.21.15.92:0/2719451531 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f691c035640 0x7f691c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:26:56.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.785+0000 7f693dbf1700 1 --2- 172.21.15.92:0/2719451531 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f691c035640 0x7f691c037af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6928007fd0 tx=0x7f6928001250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:26:56.789 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:56.789+0000 7f692e7fc700 1 -- 172.21.15.92:0/2719451531 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6934010380 con 0x7f693806b0c0 2023-09-29T23:26:57.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:57.010+0000 7f693f3f4700 1 -- 172.21.15.92:0/2719451531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f693812f320 con 0x7f693806b0c0 2023-09-29T23:26:57.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:57.010+0000 7f692e7fc700 1 -- 172.21.15.92:0/2719451531 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f693401abc0 con 0x7f693806b0c0 2023-09-29T23:26:57.011 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:26:57.011 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:26:57.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:57.012+0000 7f693f3f4700 1 -- 172.21.15.92:0/2719451531 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f691c035640 msgr2=0x7f691c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:57.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:57.012+0000 7f693f3f4700 1 --2- 172.21.15.92:0/2719451531 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f691c035640 0x7f691c037af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6928007fd0 tx=0x7f6928001250 comp rx=0 tx=0).stop 2023-09-29T23:26:57.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:57.012+0000 7f693f3f4700 1 -- 172.21.15.92:0/2719451531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f693806b0c0 msgr2=0x7f693811dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:26:57.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:57.012+0000 7f693f3f4700 1 --2- 172.21.15.92:0/2719451531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f693806b0c0 0x7f693811dfe0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6934006eb0 tx=0x7f6934016000 comp rx=0 tx=0).stop 2023-09-29T23:26:57.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:57.012+0000 7f693f3f4700 1 -- 172.21.15.92:0/2719451531 shutdown_connections 2023-09-29T23:26:57.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:57.012+0000 7f693f3f4700 1 --2- 172.21.15.92:0/2719451531 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f691c035640 0x7f691c037af0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:57.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:57.012+0000 7f693f3f4700 1 --2- 172.21.15.92:0/2719451531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f693806b0c0 0x7f693811dfe0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:26:57.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:57.012+0000 7f693f3f4700 1 -- 172.21.15.92:0/2719451531 >> 172.21.15.92:0/2719451531 conn(0x7f693806a5b0 msgr2=0x7f693812dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:26:57.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:57.013+0000 7f693f3f4700 1 -- 172.21.15.92:0/2719451531 shutdown_connections 2023-09-29T23:26:57.014 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:26:57.013+0000 7f693f3f4700 1 -- 172.21.15.92:0/2719451531 wait complete. 2023-09-29T23:27:00.025 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:27:00.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.146+0000 7f151c1e6700 1 Processor -- start 2023-09-29T23:27:00.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.146+0000 7f151c1e6700 1 -- start start 2023-09-29T23:27:00.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.147+0000 7f151c1e6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1514097780 0x7f1514131640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:00.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.147+0000 7f151c1e6700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1514098700 con 0x7f1514096ca0 2023-09-29T23:27:00.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.147+0000 7f151c1e6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f151409f430 con 0x7f1514097780 2023-09-29T23:27:00.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.147+0000 7f1519781700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1514097780 0x7f1514131640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:00.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.147+0000 7f1519f82700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f1514096ca0 0x7f1514097070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:60858/0 (socket says 172.21.15.92:60858) 2023-09-29T23:27:00.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.147+0000 7f1519f82700 1 -- 172.21.15.92:0/3324108059 learned_addr learned my addr 172.21.15.92:0/3324108059 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:27:00.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.147+0000 7f1519781700 1 -- 172.21.15.92:0/3324108059 >> v1:172.21.15.92:6789/0 conn(0x7f1514096ca0 legacy=0x7f1514097070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:00.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.147+0000 7f1519781700 1 -- 172.21.15.92:0/3324108059 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151406fab0 con 0x7f1514097780 2023-09-29T23:27:00.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.147+0000 7f1519781700 1 --2- 172.21.15.92:0/3324108059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1514097780 0x7f1514131640 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1504009860 tx=0x7f15040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69498b3711b5a92 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:00.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.148+0000 7f1518f80700 1 -- 172.21.15.92:0/3324108059 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f150400b680 con 0x7f1514097780 2023-09-29T23:27:00.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.148+0000 7f1518f80700 1 -- 172.21.15.92:0/3324108059 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150400b7e0 con 0x7f1514097780 2023-09-29T23:27:00.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.148+0000 7f1518f80700 1 -- 172.21.15.92:0/3324108059 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f150400bad0 con 0x7f1514097780 2023-09-29T23:27:00.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.148+0000 7f151c1e6700 1 -- 172.21.15.92:0/3324108059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1514097780 msgr2=0x7f1514131640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:00.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.148+0000 7f151c1e6700 1 --2- 172.21.15.92:0/3324108059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1514097780 0x7f1514131640 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1504009860 tx=0x7f15040091a0 comp rx=0 tx=0).stop 2023-09-29T23:27:00.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.148+0000 7f151c1e6700 1 -- 172.21.15.92:0/3324108059 shutdown_connections 2023-09-29T23:27:00.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.148+0000 7f151c1e6700 1 --2- 172.21.15.92:0/3324108059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1514097780 0x7f1514131640 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:00.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.148+0000 7f151c1e6700 1 -- 172.21.15.92:0/3324108059 >> 172.21.15.92:0/3324108059 conn(0x7f151406bd70 msgr2=0x7f151406e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:00.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.148+0000 7f151c1e6700 1 -- 172.21.15.92:0/3324108059 shutdown_connections 2023-09-29T23:27:00.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.148+0000 7f151c1e6700 1 -- 172.21.15.92:0/3324108059 wait complete. 2023-09-29T23:27:00.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.149+0000 7f151c1e6700 1 Processor -- start 2023-09-29T23:27:00.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.149+0000 7f151c1e6700 1 -- start start 2023-09-29T23:27:00.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.149+0000 7f151c1e6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1514096ca0 0x7f151408b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:00.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.149+0000 7f151c1e6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151408f3d0 con 0x7f1514096ca0 2023-09-29T23:27:00.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.149+0000 7f1519f82700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1514096ca0 0x7f151408b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:00.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.149+0000 7f1519f82700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1514096ca0 0x7f151408b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59262/0 (socket says 172.21.15.92:59262) 2023-09-29T23:27:00.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.149+0000 7f1519f82700 1 -- 172.21.15.92:0/3527379902 learned_addr learned my addr 172.21.15.92:0/3527379902 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:00.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.150+0000 7f1519f82700 1 -- 172.21.15.92:0/3527379902 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1504009420 con 0x7f1514096ca0 2023-09-29T23:27:00.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.150+0000 7f1519f82700 1 --2- 172.21.15.92:0/3527379902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1514096ca0 0x7f151408b070 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f151000c6c0 tx=0x7f1510007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:00.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.150+0000 7f1509ffb700 1 -- 172.21.15.92:0/3527379902 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1510007580 con 0x7f1514096ca0 2023-09-29T23:27:00.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.150+0000 7f1509ffb700 1 -- 172.21.15.92:0/3527379902 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15100057f0 con 0x7f1514096ca0 2023-09-29T23:27:00.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.150+0000 7f151c1e6700 1 -- 172.21.15.92:0/3527379902 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151408f5c0 con 0x7f1514096ca0 2023-09-29T23:27:00.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.150+0000 7f1509ffb700 1 -- 172.21.15.92:0/3527379902 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1510005ae0 con 0x7f1514096ca0 2023-09-29T23:27:00.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.150+0000 7f151c1e6700 1 -- 172.21.15.92:0/3527379902 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151408ced0 con 0x7f1514096ca0 2023-09-29T23:27:00.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.151+0000 7f1509ffb700 1 -- 172.21.15.92:0/3527379902 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f1510005d10 con 0x7f1514096ca0 2023-09-29T23:27:00.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.151+0000 7f151c1e6700 1 -- 172.21.15.92:0/3527379902 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151408d060 con 0x7f1514096ca0 2023-09-29T23:27:00.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.151+0000 7f1509ffb700 1 --2- 172.21.15.92:0/3527379902 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f14f8035640 0x7f14f8037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:00.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.151+0000 7f1509ffb700 1 -- 172.21.15.92:0/3527379902 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f1510047570 con 0x7f1514096ca0 2023-09-29T23:27:00.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.151+0000 7f1519781700 1 --2- 172.21.15.92:0/3527379902 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f14f8035640 0x7f14f8037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:00.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.151+0000 7f1519781700 1 --2- 172.21.15.92:0/3527379902 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f14f8035640 0x7f14f8037af0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f15040091e0 tx=0x7f1504016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:00.155 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.156+0000 7f1509ffb700 1 -- 172.21.15.92:0/3527379902 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1510014e60 con 0x7f1514096ca0 2023-09-29T23:27:00.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.380+0000 7f151c1e6700 1 -- 172.21.15.92:0/3527379902 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f151405f230 con 0x7f1514096ca0 2023-09-29T23:27:00.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.381+0000 7f1509ffb700 1 -- 172.21.15.92:0/3527379902 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f15100102c0 con 0x7f1514096ca0 2023-09-29T23:27:00.381 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:27:00.381 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:27:00.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.382+0000 7f151c1e6700 1 -- 172.21.15.92:0/3527379902 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f14f8035640 msgr2=0x7f14f8037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:00.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.382+0000 7f151c1e6700 1 --2- 172.21.15.92:0/3527379902 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f14f8035640 0x7f14f8037af0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f15040091e0 tx=0x7f1504016000 comp rx=0 tx=0).stop 2023-09-29T23:27:00.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.382+0000 7f151c1e6700 1 -- 172.21.15.92:0/3527379902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1514096ca0 msgr2=0x7f151408b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:00.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.382+0000 7f151c1e6700 1 --2- 172.21.15.92:0/3527379902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1514096ca0 0x7f151408b070 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f151000c6c0 tx=0x7f1510007de0 comp rx=0 tx=0).stop 2023-09-29T23:27:00.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.382+0000 7f151c1e6700 1 -- 172.21.15.92:0/3527379902 shutdown_connections 2023-09-29T23:27:00.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.382+0000 7f151c1e6700 1 --2- 172.21.15.92:0/3527379902 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f14f8035640 0x7f14f8037af0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:00.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.382+0000 7f151c1e6700 1 --2- 172.21.15.92:0/3527379902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1514096ca0 0x7f151408b070 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:00.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.382+0000 7f151c1e6700 1 -- 172.21.15.92:0/3527379902 >> 172.21.15.92:0/3527379902 conn(0x7f151406bd70 msgr2=0x7f151406d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:00.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.383+0000 7f151c1e6700 1 -- 172.21.15.92:0/3527379902 shutdown_connections 2023-09-29T23:27:00.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:00.383+0000 7f151c1e6700 1 -- 172.21.15.92:0/3527379902 wait complete. 2023-09-29T23:27:03.395 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:27:03.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.516+0000 7f55c8b76700 1 Processor -- start 2023-09-29T23:27:03.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.516+0000 7f55c8b76700 1 -- start start 2023-09-29T23:27:03.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.517+0000 7f55c8b76700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f55c409fd80 0x7f55c40a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:03.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.517+0000 7f55c8b76700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c4098710 con 0x7f55c412f8b0 2023-09-29T23:27:03.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.517+0000 7f55c8b76700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c412f340 con 0x7f55c409fd80 2023-09-29T23:27:03.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.517+0000 7f55c259c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f55c409fd80 0x7f55c40a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:03.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.517+0000 7f55c1d9b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f55c412f8b0 0x7f55c4095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54384/0 (socket says 172.21.15.92:54384) 2023-09-29T23:27:03.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.517+0000 7f55c1d9b700 1 -- 172.21.15.92:0/2341258096 learned_addr learned my addr 172.21.15.92:0/2341258096 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:27:03.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.517+0000 7f55c259c700 1 -- 172.21.15.92:0/2341258096 >> v1:172.21.15.92:6789/0 conn(0x7f55c412f8b0 legacy=0x7f55c4095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:03.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.517+0000 7f55c259c700 1 -- 172.21.15.92:0/2341258096 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c40997e0 con 0x7f55c409fd80 2023-09-29T23:27:03.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.517+0000 7f55c159a700 1 -- 172.21.15.92:0/2341258096 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903053072 0 0) 0x7f55c4098710 con 0x7f55c412f8b0 2023-09-29T23:27:03.519 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.517+0000 7f55c259c700 1 --2- 172.21.15.92:0/2341258096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55c409fd80 0x7f55c40a3090 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f55b4009860 tx=0x7f55b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200e235b802eaf21 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:03.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.517+0000 7f55c159a700 1 -- 172.21.15.92:0/2341258096 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55b400b680 con 0x7f55c409fd80 2023-09-29T23:27:03.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.517+0000 7f55c159a700 1 -- 172.21.15.92:0/2341258096 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b400b7e0 con 0x7f55c409fd80 2023-09-29T23:27:03.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.517+0000 7f55c159a700 1 -- 172.21.15.92:0/2341258096 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55b400b990 con 0x7f55c409fd80 2023-09-29T23:27:03.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.518+0000 7f55c8b76700 1 -- 172.21.15.92:0/2341258096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55c409fd80 msgr2=0x7f55c40a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:03.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.518+0000 7f55c8b76700 1 --2- 172.21.15.92:0/2341258096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55c409fd80 0x7f55c40a3090 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f55b4009860 tx=0x7f55b40091a0 comp rx=0 tx=0).stop 2023-09-29T23:27:03.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.518+0000 7f55c8b76700 1 -- 172.21.15.92:0/2341258096 shutdown_connections 2023-09-29T23:27:03.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.518+0000 7f55c8b76700 1 --2- 172.21.15.92:0/2341258096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55c409fd80 0x7f55c40a3090 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:03.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.518+0000 7f55c8b76700 1 -- 172.21.15.92:0/2341258096 >> 172.21.15.92:0/2341258096 conn(0x7f55c4068000 msgr2=0x7f55c40a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:03.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.518+0000 7f55c8b76700 1 -- 172.21.15.92:0/2341258096 shutdown_connections 2023-09-29T23:27:03.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.518+0000 7f55c8b76700 1 -- 172.21.15.92:0/2341258096 wait complete. 2023-09-29T23:27:03.522 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.519+0000 7f55c8b76700 1 Processor -- start 2023-09-29T23:27:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.519+0000 7f55c8b76700 1 -- start start 2023-09-29T23:27:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.519+0000 7f55c8b76700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55c409fd80 0x7f55c413e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.519+0000 7f55c8b76700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c411e2c0 con 0x7f55c409fd80 2023-09-29T23:27:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.519+0000 7f55c259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55c409fd80 0x7f55c413e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.519+0000 7f55c259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55c409fd80 0x7f55c413e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58714/0 (socket says 172.21.15.92:58714) 2023-09-29T23:27:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.519+0000 7f55c259c700 1 -- 172.21.15.92:0/3560853212 learned_addr learned my addr 172.21.15.92:0/3560853212 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.520+0000 7f55c259c700 1 -- 172.21.15.92:0/3560853212 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b4009420 con 0x7f55c409fd80 2023-09-29T23:27:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.520+0000 7f55c259c700 1 --2- 172.21.15.92:0/3560853212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55c409fd80 0x7f55c413e520 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f55b40093f0 tx=0x7f55b4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.520+0000 7f55ba7fc700 1 -- 172.21.15.92:0/3560853212 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55b401c450 con 0x7f55c409fd80 2023-09-29T23:27:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.520+0000 7f55ba7fc700 1 -- 172.21.15.92:0/3560853212 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b401c5b0 con 0x7f55c409fd80 2023-09-29T23:27:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.520+0000 7f55c8b76700 1 -- 172.21.15.92:0/3560853212 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c411c590 con 0x7f55c409fd80 2023-09-29T23:27:03.523 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.520+0000 7f55ba7fc700 1 -- 172.21.15.92:0/3560853212 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f55b401c760 con 0x7f55c409fd80 2023-09-29T23:27:03.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.520+0000 7f55c8b76700 1 -- 172.21.15.92:0/3560853212 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c411d1c0 con 0x7f55c409fd80 2023-09-29T23:27:03.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.521+0000 7f55ba7fc700 1 -- 172.21.15.92:0/3560853212 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f55b401c990 con 0x7f55c409fd80 2023-09-29T23:27:03.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.521+0000 7f55c8b76700 1 -- 172.21.15.92:0/3560853212 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c411e410 con 0x7f55c409fd80 2023-09-29T23:27:03.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.521+0000 7f55ba7fc700 1 --2- 172.21.15.92:0/3560853212 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f55a4035640 0x7f55a4037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:03.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.521+0000 7f55ba7fc700 1 -- 172.21.15.92:0/3560853212 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f55b40491b0 con 0x7f55c409fd80 2023-09-29T23:27:03.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.521+0000 7f55c1d9b700 1 --2- 172.21.15.92:0/3560853212 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f55a4035640 0x7f55a4037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:03.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.521+0000 7f55c1d9b700 1 --2- 172.21.15.92:0/3560853212 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f55a4035640 0x7f55a4037af0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0011e0 tx=0x7f55ac0079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:03.525 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.525+0000 7f55ba7fc700 1 -- 172.21.15.92:0/3560853212 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55b4018350 con 0x7f55c409fd80 2023-09-29T23:27:03.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.747+0000 7f55c8b76700 1 -- 172.21.15.92:0/3560853212 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f55c411e7b0 con 0x7f55c409fd80 2023-09-29T23:27:03.747 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.747+0000 7f55ba7fc700 1 -- 172.21.15.92:0/3560853212 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f55b402db40 con 0x7f55c409fd80 2023-09-29T23:27:03.748 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:27:03.748 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:27:03.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.749+0000 7f55c8b76700 1 -- 172.21.15.92:0/3560853212 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f55a4035640 msgr2=0x7f55a4037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:03.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.749+0000 7f55c8b76700 1 --2- 172.21.15.92:0/3560853212 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f55a4035640 0x7f55a4037af0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f55ac0011e0 tx=0x7f55ac0079d0 comp rx=0 tx=0).stop 2023-09-29T23:27:03.749 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.749+0000 7f55c8b76700 1 -- 172.21.15.92:0/3560853212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55c409fd80 msgr2=0x7f55c413e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:03.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.749+0000 7f55c8b76700 1 --2- 172.21.15.92:0/3560853212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55c409fd80 0x7f55c413e520 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f55b40093f0 tx=0x7f55b4016000 comp rx=0 tx=0).stop 2023-09-29T23:27:03.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.749+0000 7f55c8b76700 1 -- 172.21.15.92:0/3560853212 shutdown_connections 2023-09-29T23:27:03.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.749+0000 7f55c8b76700 1 --2- 172.21.15.92:0/3560853212 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f55a4035640 0x7f55a4037af0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:03.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.749+0000 7f55c8b76700 1 --2- 172.21.15.92:0/3560853212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55c409fd80 0x7f55c413e520 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:03.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.749+0000 7f55c8b76700 1 -- 172.21.15.92:0/3560853212 >> 172.21.15.92:0/3560853212 conn(0x7f55c4068000 msgr2=0x7f55c4094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:03.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.749+0000 7f55c8b76700 1 -- 172.21.15.92:0/3560853212 shutdown_connections 2023-09-29T23:27:03.750 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:03.749+0000 7f55c8b76700 1 -- 172.21.15.92:0/3560853212 wait complete. 2023-09-29T23:27:06.761 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:27:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.880+0000 7f308d6e2700 1 Processor -- start 2023-09-29T23:27:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.880+0000 7f308d6e2700 1 -- start start 2023-09-29T23:27:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.881+0000 7f308d6e2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f308812fcb0 0x7f3088134620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.881+0000 7f308d6e2700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30880997f0 con 0x7f30880a3030 2023-09-29T23:27:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.881+0000 7f308d6e2700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30880a3400 con 0x7f308812fcb0 2023-09-29T23:27:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.881+0000 7f3086ffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f30880a3030 0x7f308812f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54396/0 (socket says 172.21.15.92:54396) 2023-09-29T23:27:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.881+0000 7f307e7fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f308812fcb0 0x7f3088134620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:06.882 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.881+0000 7f3086ffd700 1 -- 172.21.15.92:0/156996809 learned_addr learned my addr 172.21.15.92:0/156996809 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:27:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.881+0000 7f307e7fc700 1 -- 172.21.15.92:0/156996809 >> v1:172.21.15.92:6789/0 conn(0x7f30880a3030 legacy=0x7f308812f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.881+0000 7f307e7fc700 1 -- 172.21.15.92:0/156996809 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30880977a0 con 0x7f308812fcb0 2023-09-29T23:27:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.881+0000 7f30867fc700 1 -- 172.21.15.92:0/156996809 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874196576 0 0) 0x7f30880997f0 con 0x7f30880a3030 2023-09-29T23:27:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.881+0000 7f307e7fc700 1 --2- 172.21.15.92:0/156996809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f308812fcb0 0x7f3088134620 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3070009860 tx=0x7f30700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cffe4c1a4076f500 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.882+0000 7f30867fc700 1 -- 172.21.15.92:0/156996809 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f307000b710 con 0x7f308812fcb0 2023-09-29T23:27:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.882+0000 7f30867fc700 1 -- 172.21.15.92:0/156996809 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307000b870 con 0x7f308812fcb0 2023-09-29T23:27:06.883 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.882+0000 7f30867fc700 1 -- 172.21.15.92:0/156996809 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f307000ba20 con 0x7f308812fcb0 2023-09-29T23:27:06.885 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.882+0000 7f308d6e2700 1 -- 172.21.15.92:0/156996809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f308812fcb0 msgr2=0x7f3088134620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:06.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.882+0000 7f308d6e2700 1 --2- 172.21.15.92:0/156996809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f308812fcb0 0x7f3088134620 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3070009860 tx=0x7f30700091a0 comp rx=0 tx=0).stop 2023-09-29T23:27:06.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.882+0000 7f308d6e2700 1 -- 172.21.15.92:0/156996809 shutdown_connections 2023-09-29T23:27:06.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.882+0000 7f308d6e2700 1 --2- 172.21.15.92:0/156996809 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f308812fcb0 0x7f3088134620 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:06.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.882+0000 7f308d6e2700 1 -- 172.21.15.92:0/156996809 >> 172.21.15.92:0/156996809 conn(0x7f3088067fc0 msgr2=0x7f30880a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:06.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.882+0000 7f308d6e2700 1 -- 172.21.15.92:0/156996809 shutdown_connections 2023-09-29T23:27:06.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.882+0000 7f308d6e2700 1 -- 172.21.15.92:0/156996809 wait complete. 2023-09-29T23:27:06.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.883+0000 7f308d6e2700 1 Processor -- start 2023-09-29T23:27:06.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.883+0000 7f308d6e2700 1 -- start start 2023-09-29T23:27:06.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.884+0000 7f308d6e2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30880a3030 0x7f308812c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:06.886 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.884+0000 7f308d6e2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308811e710 con 0x7f30880a3030 2023-09-29T23:27:06.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.884+0000 7f3086ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30880a3030 0x7f308812c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:06.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.884+0000 7f3086ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30880a3030 0x7f308812c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58730/0 (socket says 172.21.15.92:58730) 2023-09-29T23:27:06.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.884+0000 7f3086ffd700 1 -- 172.21.15.92:0/4159303136 learned_addr learned my addr 172.21.15.92:0/4159303136 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:06.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.884+0000 7f3086ffd700 1 -- 172.21.15.92:0/4159303136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3070009420 con 0x7f30880a3030 2023-09-29T23:27:06.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.884+0000 7f3086ffd700 1 --2- 172.21.15.92:0/4159303136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30880a3030 0x7f308812c150 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f307800c710 tx=0x7f3078007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:06.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.884+0000 7f307f7fe700 1 -- 172.21.15.92:0/4159303136 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3078005c50 con 0x7f30880a3030 2023-09-29T23:27:06.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.884+0000 7f307f7fe700 1 -- 172.21.15.92:0/4159303136 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3078005db0 con 0x7f30880a3030 2023-09-29T23:27:06.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.884+0000 7f308d6e2700 1 -- 172.21.15.92:0/4159303136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f308811ec50 con 0x7f30880a3030 2023-09-29T23:27:06.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.884+0000 7f307f7fe700 1 -- 172.21.15.92:0/4159303136 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3078007230 con 0x7f30880a3030 2023-09-29T23:27:06.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.884+0000 7f308d6e2700 1 -- 172.21.15.92:0/4159303136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f308811e940 con 0x7f30880a3030 2023-09-29T23:27:06.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.885+0000 7f307f7fe700 1 -- 172.21.15.92:0/4159303136 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f3078007390 con 0x7f30880a3030 2023-09-29T23:27:06.887 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.885+0000 7f308d6e2700 1 -- 172.21.15.92:0/4159303136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f308811b490 con 0x7f30880a3030 2023-09-29T23:27:06.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.885+0000 7f307f7fe700 1 --2- 172.21.15.92:0/4159303136 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3068035640 0x7f3068037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:06.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.885+0000 7f307f7fe700 1 -- 172.21.15.92:0/4159303136 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f3078046a50 con 0x7f30880a3030 2023-09-29T23:27:06.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.885+0000 7f307e7fc700 1 --2- 172.21.15.92:0/4159303136 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3068035640 0x7f3068037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:06.888 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.885+0000 7f307e7fc700 1 --2- 172.21.15.92:0/4159303136 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3068035640 0x7f3068037af0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3070006eb0 tx=0x7f3070016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:06.889 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:06.890+0000 7f307f7fe700 1 -- 172.21.15.92:0/4159303136 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f307800eb10 con 0x7f30880a3030 2023-09-29T23:27:07.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:07.111+0000 7f308d6e2700 1 -- 172.21.15.92:0/4159303136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3088096410 con 0x7f30880a3030 2023-09-29T23:27:07.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:07.112+0000 7f307f7fe700 1 -- 172.21.15.92:0/4159303136 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f3078017020 con 0x7f30880a3030 2023-09-29T23:27:07.114 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:27:07.114 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:27:07.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:07.114+0000 7f308d6e2700 1 -- 172.21.15.92:0/4159303136 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3068035640 msgr2=0x7f3068037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:07.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:07.114+0000 7f308d6e2700 1 --2- 172.21.15.92:0/4159303136 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3068035640 0x7f3068037af0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3070006eb0 tx=0x7f3070016000 comp rx=0 tx=0).stop 2023-09-29T23:27:07.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:07.114+0000 7f308d6e2700 1 -- 172.21.15.92:0/4159303136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30880a3030 msgr2=0x7f308812c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:07.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:07.114+0000 7f308d6e2700 1 --2- 172.21.15.92:0/4159303136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30880a3030 0x7f308812c150 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f307800c710 tx=0x7f3078007d90 comp rx=0 tx=0).stop 2023-09-29T23:27:07.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:07.114+0000 7f308d6e2700 1 -- 172.21.15.92:0/4159303136 shutdown_connections 2023-09-29T23:27:07.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:07.114+0000 7f308d6e2700 1 --2- 172.21.15.92:0/4159303136 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3068035640 0x7f3068037af0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:07.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:07.114+0000 7f308d6e2700 1 --2- 172.21.15.92:0/4159303136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30880a3030 0x7f308812c150 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:07.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:07.114+0000 7f308d6e2700 1 -- 172.21.15.92:0/4159303136 >> 172.21.15.92:0/4159303136 conn(0x7f3088067fc0 msgr2=0x7f308812d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:07.115 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:07.114+0000 7f308d6e2700 1 -- 172.21.15.92:0/4159303136 shutdown_connections 2023-09-29T23:27:07.116 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:07.114+0000 7f308d6e2700 1 -- 172.21.15.92:0/4159303136 wait complete. 2023-09-29T23:27:10.127 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:27:10.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.248+0000 7f4601ec4700 1 Processor -- start 2023-09-29T23:27:10.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.248+0000 7f4601ec4700 1 -- start start 2023-09-29T23:27:10.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.249+0000 7f4601ec4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f45fc09fd80 0x7f45fc0a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:10.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.249+0000 7f4601ec4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45fc098710 con 0x7f45fc12f8b0 2023-09-29T23:27:10.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.249+0000 7f4601ec4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45fc12f340 con 0x7f45fc09fd80 2023-09-29T23:27:10.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.249+0000 7f45fb7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f45fc09fd80 0x7f45fc0a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:10.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.249+0000 7f45faffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f45fc12f8b0 0x7f45fc095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54398/0 (socket says 172.21.15.92:54398) 2023-09-29T23:27:10.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.249+0000 7f45faffd700 1 -- 172.21.15.92:0/2146198284 learned_addr learned my addr 172.21.15.92:0/2146198284 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:27:10.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.249+0000 7f45fb7fe700 1 -- 172.21.15.92:0/2146198284 >> v1:172.21.15.92:6789/0 conn(0x7f45fc12f8b0 legacy=0x7f45fc095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:10.250 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.249+0000 7f45fa7fc700 1 -- 172.21.15.92:0/2146198284 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1125339196 0 0) 0x7f45fc098710 con 0x7f45fc12f8b0 2023-09-29T23:27:10.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.249+0000 7f45fb7fe700 1 -- 172.21.15.92:0/2146198284 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc0997e0 con 0x7f45fc09fd80 2023-09-29T23:27:10.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.249+0000 7f45fb7fe700 1 --2- 172.21.15.92:0/2146198284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45fc09fd80 0x7f45fc0a3090 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009860 tx=0x7f45ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3813806630584df3 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:10.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.249+0000 7f45fa7fc700 1 -- 172.21.15.92:0/2146198284 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45ec00b680 con 0x7f45fc09fd80 2023-09-29T23:27:10.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.249+0000 7f45fa7fc700 1 -- 172.21.15.92:0/2146198284 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec00b7e0 con 0x7f45fc09fd80 2023-09-29T23:27:10.251 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.249+0000 7f45fa7fc700 1 -- 172.21.15.92:0/2146198284 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45ec00b990 con 0x7f45fc09fd80 2023-09-29T23:27:10.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.250+0000 7f4601ec4700 1 -- 172.21.15.92:0/2146198284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45fc09fd80 msgr2=0x7f45fc0a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:10.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.250+0000 7f4601ec4700 1 --2- 172.21.15.92:0/2146198284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45fc09fd80 0x7f45fc0a3090 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009860 tx=0x7f45ec0091a0 comp rx=0 tx=0).stop 2023-09-29T23:27:10.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.250+0000 7f4601ec4700 1 -- 172.21.15.92:0/2146198284 shutdown_connections 2023-09-29T23:27:10.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.250+0000 7f4601ec4700 1 --2- 172.21.15.92:0/2146198284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45fc09fd80 0x7f45fc0a3090 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:10.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.250+0000 7f4601ec4700 1 -- 172.21.15.92:0/2146198284 >> 172.21.15.92:0/2146198284 conn(0x7f45fc068000 msgr2=0x7f45fc0a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:10.253 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.250+0000 7f4601ec4700 1 -- 172.21.15.92:0/2146198284 shutdown_connections 2023-09-29T23:27:10.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.250+0000 7f4601ec4700 1 -- 172.21.15.92:0/2146198284 wait complete. 2023-09-29T23:27:10.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.251+0000 7f4601ec4700 1 Processor -- start 2023-09-29T23:27:10.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.251+0000 7f4601ec4700 1 -- start start 2023-09-29T23:27:10.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.251+0000 7f4601ec4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45fc09fd80 0x7f45fc11da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:10.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.251+0000 7f4601ec4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc11e1b0 con 0x7f45fc09fd80 2023-09-29T23:27:10.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.252+0000 7f45fb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45fc09fd80 0x7f45fc11da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:10.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.252+0000 7f45fb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45fc09fd80 0x7f45fc11da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58738/0 (socket says 172.21.15.92:58738) 2023-09-29T23:27:10.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.252+0000 7f45fb7fe700 1 -- 172.21.15.92:0/3408078404 learned_addr learned my addr 172.21.15.92:0/3408078404 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:10.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.252+0000 7f45fb7fe700 1 -- 172.21.15.92:0/3408078404 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec009420 con 0x7f45fc09fd80 2023-09-29T23:27:10.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.252+0000 7f45fb7fe700 1 --2- 172.21.15.92:0/3408078404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45fc09fd80 0x7f45fc11da60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f45ec000c00 tx=0x7f45ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:10.254 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.252+0000 7f45e37fe700 1 -- 172.21.15.92:0/3408078404 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45ec011d30 con 0x7f45fc09fd80 2023-09-29T23:27:10.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.252+0000 7f45e37fe700 1 -- 172.21.15.92:0/3408078404 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec020070 con 0x7f45fc09fd80 2023-09-29T23:27:10.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.252+0000 7f4601ec4700 1 -- 172.21.15.92:0/3408078404 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45fc11ec00 con 0x7f45fc09fd80 2023-09-29T23:27:10.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.252+0000 7f45e37fe700 1 -- 172.21.15.92:0/3408078404 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45ec01b450 con 0x7f45fc09fd80 2023-09-29T23:27:10.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.252+0000 7f4601ec4700 1 -- 172.21.15.92:0/3408078404 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc11c2f0 con 0x7f45fc09fd80 2023-09-29T23:27:10.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.253+0000 7f45e37fe700 1 -- 172.21.15.92:0/3408078404 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f45ec022030 con 0x7f45fc09fd80 2023-09-29T23:27:10.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.253+0000 7f45e37fe700 1 --2- 172.21.15.92:0/3408078404 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f45e8035640 0x7f45e8037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:10.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.253+0000 7f45e37fe700 1 -- 172.21.15.92:0/3408078404 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f45ec0491e0 con 0x7f45fc09fd80 2023-09-29T23:27:10.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.253+0000 7f45faffd700 1 --2- 172.21.15.92:0/3408078404 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f45e8035640 0x7f45e8037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:10.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.253+0000 7f4601ec4700 1 -- 172.21.15.92:0/3408078404 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45fc05f230 con 0x7f45fc09fd80 2023-09-29T23:27:10.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.253+0000 7f45faffd700 1 --2- 172.21.15.92:0/3408078404 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f45e8035640 0x7f45e8037af0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f45f00011e0 tx=0x7f45f00079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:10.257 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.258+0000 7f45e37fe700 1 -- 172.21.15.92:0/3408078404 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45ec0249c0 con 0x7f45fc09fd80 2023-09-29T23:27:10.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.481+0000 7f4601ec4700 1 -- 172.21.15.92:0/3408078404 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f45fc04bb40 con 0x7f45fc09fd80 2023-09-29T23:27:10.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.482+0000 7f45e37fe700 1 -- 172.21.15.92:0/3408078404 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f45ec0193f0 con 0x7f45fc09fd80 2023-09-29T23:27:10.482 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:27:10.482 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:27:10.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.484+0000 7f4601ec4700 1 -- 172.21.15.92:0/3408078404 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f45e8035640 msgr2=0x7f45e8037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:10.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.484+0000 7f4601ec4700 1 --2- 172.21.15.92:0/3408078404 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f45e8035640 0x7f45e8037af0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f45f00011e0 tx=0x7f45f00079d0 comp rx=0 tx=0).stop 2023-09-29T23:27:10.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.484+0000 7f4601ec4700 1 -- 172.21.15.92:0/3408078404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45fc09fd80 msgr2=0x7f45fc11da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:10.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.484+0000 7f4601ec4700 1 --2- 172.21.15.92:0/3408078404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45fc09fd80 0x7f45fc11da60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f45ec000c00 tx=0x7f45ec016000 comp rx=0 tx=0).stop 2023-09-29T23:27:10.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.484+0000 7f4601ec4700 1 -- 172.21.15.92:0/3408078404 shutdown_connections 2023-09-29T23:27:10.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.484+0000 7f4601ec4700 1 --2- 172.21.15.92:0/3408078404 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f45e8035640 0x7f45e8037af0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:10.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.484+0000 7f4601ec4700 1 --2- 172.21.15.92:0/3408078404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45fc09fd80 0x7f45fc11da60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:10.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.484+0000 7f4601ec4700 1 -- 172.21.15.92:0/3408078404 >> 172.21.15.92:0/3408078404 conn(0x7f45fc068000 msgr2=0x7f45fc094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:10.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.484+0000 7f4601ec4700 1 -- 172.21.15.92:0/3408078404 shutdown_connections 2023-09-29T23:27:10.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:10.484+0000 7f4601ec4700 1 -- 172.21.15.92:0/3408078404 wait complete. 2023-09-29T23:27:13.496 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:27:13.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.619+0000 7fb6d7e38700 1 Processor -- start 2023-09-29T23:27:13.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.619+0000 7fb6d7e38700 1 -- start start 2023-09-29T23:27:13.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.620+0000 7fb6d7e38700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb6d012ffc0 0x7fb6d00a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:13.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.620+0000 7fb6d7e38700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d0098710 con 0x7fb6d009fd80 2023-09-29T23:27:13.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.620+0000 7fb6d7e38700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d012f340 con 0x7fb6d012ffc0 2023-09-29T23:27:13.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.620+0000 7fb6d53d3700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb6d012ffc0 0x7fb6d00a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:13.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.620+0000 7fb6d5bd4700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fb6d009fd80 0x7fb6d012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:42186/0 (socket says 172.21.15.92:42186) 2023-09-29T23:27:13.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.620+0000 7fb6d5bd4700 1 -- 172.21.15.92:0/3679881628 learned_addr learned my addr 172.21.15.92:0/3679881628 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:27:13.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.620+0000 7fb6d53d3700 1 -- 172.21.15.92:0/3679881628 >> v1:172.21.15.92:6789/0 conn(0x7fb6d009fd80 legacy=0x7fb6d012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:13.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.620+0000 7fb6d53d3700 1 -- 172.21.15.92:0/3679881628 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d00997e0 con 0x7fb6d012ffc0 2023-09-29T23:27:13.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.620+0000 7fb6d4bd2700 1 -- 172.21.15.92:0/3679881628 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2543188583 0 0) 0x7fb6d0098710 con 0x7fb6d009fd80 2023-09-29T23:27:13.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.620+0000 7fb6d53d3700 1 --2- 172.21.15.92:0/3679881628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6d012ffc0 0x7fb6d00a3090 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009860 tx=0x7fb6c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e40ea73f6bf8f67 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:13.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.620+0000 7fb6d4bd2700 1 -- 172.21.15.92:0/3679881628 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6c000b680 con 0x7fb6d012ffc0 2023-09-29T23:27:13.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.620+0000 7fb6d4bd2700 1 -- 172.21.15.92:0/3679881628 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c000b7e0 con 0x7fb6d012ffc0 2023-09-29T23:27:13.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.620+0000 7fb6d4bd2700 1 -- 172.21.15.92:0/3679881628 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6c000b990 con 0x7fb6d012ffc0 2023-09-29T23:27:13.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.621+0000 7fb6d7e38700 1 -- 172.21.15.92:0/3679881628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6d012ffc0 msgr2=0x7fb6d00a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:13.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.621+0000 7fb6d7e38700 1 --2- 172.21.15.92:0/3679881628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6d012ffc0 0x7fb6d00a3090 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009860 tx=0x7fb6c00091a0 comp rx=0 tx=0).stop 2023-09-29T23:27:13.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.621+0000 7fb6d7e38700 1 -- 172.21.15.92:0/3679881628 shutdown_connections 2023-09-29T23:27:13.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.621+0000 7fb6d7e38700 1 --2- 172.21.15.92:0/3679881628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6d012ffc0 0x7fb6d00a3090 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:13.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.621+0000 7fb6d7e38700 1 -- 172.21.15.92:0/3679881628 >> 172.21.15.92:0/3679881628 conn(0x7fb6d0068000 msgr2=0x7fb6d00a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:13.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.621+0000 7fb6d7e38700 1 -- 172.21.15.92:0/3679881628 shutdown_connections 2023-09-29T23:27:13.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.621+0000 7fb6d7e38700 1 -- 172.21.15.92:0/3679881628 wait complete. 2023-09-29T23:27:13.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.622+0000 7fb6d7e38700 1 Processor -- start 2023-09-29T23:27:13.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.622+0000 7fb6d7e38700 1 -- start start 2023-09-29T23:27:13.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.622+0000 7fb6d7e38700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6d009fd80 0x7fb6d013e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:13.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.622+0000 7fb6d7e38700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d011e2f0 con 0x7fb6d009fd80 2023-09-29T23:27:13.625 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.622+0000 7fb6d5bd4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6d009fd80 0x7fb6d013e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:13.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.622+0000 7fb6d5bd4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6d009fd80 0x7fb6d013e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42454/0 (socket says 172.21.15.92:42454) 2023-09-29T23:27:13.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.622+0000 7fb6d5bd4700 1 -- 172.21.15.92:0/1906581738 learned_addr learned my addr 172.21.15.92:0/1906581738 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:13.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.623+0000 7fb6d5bd4700 1 -- 172.21.15.92:0/1906581738 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c0009420 con 0x7fb6d009fd80 2023-09-29T23:27:13.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.623+0000 7fb6d5bd4700 1 --2- 172.21.15.92:0/1906581738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6d009fd80 0x7fb6d013e520 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc00c460 tx=0x7fb6cc000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:13.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.623+0000 7fb6c5ffb700 1 -- 172.21.15.92:0/1906581738 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6cc005c70 con 0x7fb6d009fd80 2023-09-29T23:27:13.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.623+0000 7fb6c5ffb700 1 -- 172.21.15.92:0/1906581738 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6cc005dd0 con 0x7fb6d009fd80 2023-09-29T23:27:13.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.623+0000 7fb6c5ffb700 1 -- 172.21.15.92:0/1906581738 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6cc007230 con 0x7fb6d009fd80 2023-09-29T23:27:13.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.623+0000 7fb6d7e38700 1 -- 172.21.15.92:0/1906581738 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d011c4a0 con 0x7fb6d009fd80 2023-09-29T23:27:13.626 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.623+0000 7fb6d7e38700 1 -- 172.21.15.92:0/1906581738 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d011cff0 con 0x7fb6d009fd80 2023-09-29T23:27:13.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.624+0000 7fb6c5ffb700 1 -- 172.21.15.92:0/1906581738 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fb6cc007390 con 0x7fb6d009fd80 2023-09-29T23:27:13.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.624+0000 7fb6c5ffb700 1 --2- 172.21.15.92:0/1906581738 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb6b4035630 0x7fb6b4037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:13.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.624+0000 7fb6c5ffb700 1 -- 172.21.15.92:0/1906581738 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fb6cc046ab0 con 0x7fb6d009fd80 2023-09-29T23:27:13.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.624+0000 7fb6d7e38700 1 -- 172.21.15.92:0/1906581738 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d00a1fc0 con 0x7fb6d009fd80 2023-09-29T23:27:13.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.624+0000 7fb6d53d3700 1 --2- 172.21.15.92:0/1906581738 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb6b4035630 0x7fb6b4037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:13.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.624+0000 7fb6d53d3700 1 --2- 172.21.15.92:0/1906581738 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb6b4035630 0x7fb6b4037ae0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009860 tx=0x7fb6c0016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:13.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.629+0000 7fb6c5ffb700 1 -- 172.21.15.92:0/1906581738 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6cc017020 con 0x7fb6d009fd80 2023-09-29T23:27:13.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.852+0000 7fb6d7e38700 1 -- 172.21.15.92:0/1906581738 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb6d005f230 con 0x7fb6d009fd80 2023-09-29T23:27:13.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.853+0000 7fb6c5ffb700 1 -- 172.21.15.92:0/1906581738 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fb6cc0188b0 con 0x7fb6d009fd80 2023-09-29T23:27:13.853 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:27:13.853 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:27:13.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.855+0000 7fb6d7e38700 1 -- 172.21.15.92:0/1906581738 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb6b4035630 msgr2=0x7fb6b4037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:13.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.855+0000 7fb6d7e38700 1 --2- 172.21.15.92:0/1906581738 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb6b4035630 0x7fb6b4037ae0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009860 tx=0x7fb6c0016000 comp rx=0 tx=0).stop 2023-09-29T23:27:13.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.855+0000 7fb6d7e38700 1 -- 172.21.15.92:0/1906581738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6d009fd80 msgr2=0x7fb6d013e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:13.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.855+0000 7fb6d7e38700 1 --2- 172.21.15.92:0/1906581738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6d009fd80 0x7fb6d013e520 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc00c460 tx=0x7fb6cc000fe0 comp rx=0 tx=0).stop 2023-09-29T23:27:13.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.855+0000 7fb6d7e38700 1 -- 172.21.15.92:0/1906581738 shutdown_connections 2023-09-29T23:27:13.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.855+0000 7fb6d7e38700 1 --2- 172.21.15.92:0/1906581738 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb6b4035630 0x7fb6b4037ae0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:13.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.855+0000 7fb6d7e38700 1 --2- 172.21.15.92:0/1906581738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6d009fd80 0x7fb6d013e520 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:13.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.855+0000 7fb6d7e38700 1 -- 172.21.15.92:0/1906581738 >> 172.21.15.92:0/1906581738 conn(0x7fb6d0068000 msgr2=0x7fb6d0094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:13.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.855+0000 7fb6d7e38700 1 -- 172.21.15.92:0/1906581738 shutdown_connections 2023-09-29T23:27:13.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:13.855+0000 7fb6d7e38700 1 -- 172.21.15.92:0/1906581738 wait complete. 2023-09-29T23:27:16.867 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:27:16.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.987+0000 7f2ae4068700 1 Processor -- start 2023-09-29T23:27:16.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.987+0000 7f2ae4068700 1 -- start start 2023-09-29T23:27:16.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.988+0000 7f2ae4068700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2adc0a3030 0x7f2adc12f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:16.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.988+0000 7f2ae4068700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc0997f0 con 0x7f2adc12fae0 2023-09-29T23:27:16.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.988+0000 7f2ae4068700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc0a3400 con 0x7f2adc0a3030 2023-09-29T23:27:16.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.988+0000 7f2ae1e04700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2adc0a3030 0x7f2adc12f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:16.990 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.988+0000 7f2ae1603700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f2adc12fae0 0x7f2adc095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:42188/0 (socket says 172.21.15.92:42188) 2023-09-29T23:27:16.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.988+0000 7f2ae1603700 1 -- 172.21.15.92:0/4262901435 learned_addr learned my addr 172.21.15.92:0/4262901435 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:27:16.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.988+0000 7f2ae0e02700 1 -- 172.21.15.92:0/4262901435 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670254107 0 0) 0x7f2adc0997f0 con 0x7f2adc12fae0 2023-09-29T23:27:16.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.988+0000 7f2ae0e02700 1 -- 172.21.15.92:0/4262901435 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ac8003570 con 0x7f2adc12fae0 2023-09-29T23:27:16.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.988+0000 7f2ae1e04700 1 -- 172.21.15.92:0/4262901435 >> v1:172.21.15.92:6789/0 conn(0x7f2adc12fae0 legacy=0x7f2adc095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:16.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.988+0000 7f2ae1e04700 1 -- 172.21.15.92:0/4262901435 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc0977a0 con 0x7f2adc0a3030 2023-09-29T23:27:16.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.988+0000 7f2ae1e04700 1 --2- 172.21.15.92:0/4262901435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2adc0a3030 0x7f2adc12f5a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8009860 tx=0x7f2ad80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793e437a6888f585 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:16.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.988+0000 7f2ae0e02700 1 -- 172.21.15.92:0/4262901435 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ad800b690 con 0x7f2adc0a3030 2023-09-29T23:27:16.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.989+0000 7f2ae0e02700 1 -- 172.21.15.92:0/4262901435 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad800b7f0 con 0x7f2adc0a3030 2023-09-29T23:27:16.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.989+0000 7f2ae0e02700 1 -- 172.21.15.92:0/4262901435 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ad800b980 con 0x7f2adc0a3030 2023-09-29T23:27:16.991 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.989+0000 7f2ae4068700 1 -- 172.21.15.92:0/4262901435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2adc0a3030 msgr2=0x7f2adc12f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:16.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.989+0000 7f2ae4068700 1 --2- 172.21.15.92:0/4262901435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2adc0a3030 0x7f2adc12f5a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8009860 tx=0x7f2ad80091a0 comp rx=0 tx=0).stop 2023-09-29T23:27:16.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.989+0000 7f2ae4068700 1 -- 172.21.15.92:0/4262901435 shutdown_connections 2023-09-29T23:27:16.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.989+0000 7f2ae4068700 1 --2- 172.21.15.92:0/4262901435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2adc0a3030 0x7f2adc12f5a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:16.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.989+0000 7f2ae4068700 1 -- 172.21.15.92:0/4262901435 >> 172.21.15.92:0/4262901435 conn(0x7f2adc067fc0 msgr2=0x7f2adc0a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:16.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.989+0000 7f2ae4068700 1 -- 172.21.15.92:0/4262901435 shutdown_connections 2023-09-29T23:27:16.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.989+0000 7f2ae4068700 1 -- 172.21.15.92:0/4262901435 wait complete. 2023-09-29T23:27:16.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.990+0000 7f2ae4068700 1 Processor -- start 2023-09-29T23:27:16.992 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.990+0000 7f2ae4068700 1 -- start start 2023-09-29T23:27:16.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.990+0000 7f2ae4068700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2adc0a3030 0x7f2adc13e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:16.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.990+0000 7f2ae4068700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc11e850 con 0x7f2adc0a3030 2023-09-29T23:27:16.994 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.991+0000 7f2ae1e04700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2adc0a3030 0x7f2adc13e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.991+0000 7f2ae1e04700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2adc0a3030 0x7f2adc13e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42482/0 (socket says 172.21.15.92:42482) 2023-09-29T23:27:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.991+0000 7f2ae1e04700 1 -- 172.21.15.92:0/2601849588 learned_addr learned my addr 172.21.15.92:0/2601849588 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.991+0000 7f2ae1e04700 1 -- 172.21.15.92:0/2601849588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad8009420 con 0x7f2adc0a3030 2023-09-29T23:27:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.991+0000 7f2ae1e04700 1 --2- 172.21.15.92:0/2601849588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2adc0a3030 0x7f2adc13e4d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8000c00 tx=0x7f2ad8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.991+0000 7f2ad1ffb700 1 -- 172.21.15.92:0/2601849588 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ad800b960 con 0x7f2adc0a3030 2023-09-29T23:27:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.991+0000 7f2ad1ffb700 1 -- 172.21.15.92:0/2601849588 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad801f070 con 0x7f2adc0a3030 2023-09-29T23:27:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.991+0000 7f2ae4068700 1 -- 172.21.15.92:0/2601849588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2adc11e540 con 0x7f2adc0a3030 2023-09-29T23:27:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.991+0000 7f2ad1ffb700 1 -- 172.21.15.92:0/2601849588 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ad8011cf0 con 0x7f2adc0a3030 2023-09-29T23:27:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.991+0000 7f2ae4068700 1 -- 172.21.15.92:0/2601849588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2adc11dcb0 con 0x7f2adc0a3030 2023-09-29T23:27:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.992+0000 7f2ad1ffb700 1 -- 172.21.15.92:0/2601849588 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f2ad8021030 con 0x7f2adc0a3030 2023-09-29T23:27:16.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.992+0000 7f2ad1ffb700 1 --2- 172.21.15.92:0/2601849588 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2ac0035640 0x7f2ac0037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:16.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.992+0000 7f2ae4068700 1 -- 172.21.15.92:0/2601849588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2adc11e2e0 con 0x7f2adc0a3030 2023-09-29T23:27:16.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.992+0000 7f2ad1ffb700 1 -- 172.21.15.92:0/2601849588 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f2ad8048e70 con 0x7f2adc0a3030 2023-09-29T23:27:16.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.992+0000 7f2ae1603700 1 --2- 172.21.15.92:0/2601849588 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2ac0035640 0x7f2ac0037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:16.996 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.993+0000 7f2ae1603700 1 --2- 172.21.15.92:0/2601849588 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2ac0035640 0x7f2ac0037af0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0058d0 tx=0x7f2acc0079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:16.997 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:16.997+0000 7f2ad1ffb700 1 -- 172.21.15.92:0/2601849588 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ad8010970 con 0x7f2adc0a3030 2023-09-29T23:27:17.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:17.220+0000 7f2ae4068700 1 -- 172.21.15.92:0/2601849588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2adc05f230 con 0x7f2adc0a3030 2023-09-29T23:27:17.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:17.220+0000 7f2ad1ffb700 1 -- 172.21.15.92:0/2601849588 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f2ad80193c0 con 0x7f2adc0a3030 2023-09-29T23:27:17.221 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:27:17.221 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:27:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:17.222+0000 7f2ae4068700 1 -- 172.21.15.92:0/2601849588 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2ac0035640 msgr2=0x7f2ac0037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:17.222+0000 7f2ae4068700 1 --2- 172.21.15.92:0/2601849588 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2ac0035640 0x7f2ac0037af0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0058d0 tx=0x7f2acc0079d0 comp rx=0 tx=0).stop 2023-09-29T23:27:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:17.222+0000 7f2ae4068700 1 -- 172.21.15.92:0/2601849588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2adc0a3030 msgr2=0x7f2adc13e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:17.222+0000 7f2ae4068700 1 --2- 172.21.15.92:0/2601849588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2adc0a3030 0x7f2adc13e4d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8000c00 tx=0x7f2ad8016000 comp rx=0 tx=0).stop 2023-09-29T23:27:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:17.222+0000 7f2ae4068700 1 -- 172.21.15.92:0/2601849588 shutdown_connections 2023-09-29T23:27:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:17.222+0000 7f2ae4068700 1 --2- 172.21.15.92:0/2601849588 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2ac0035640 0x7f2ac0037af0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:17.222+0000 7f2ae4068700 1 --2- 172.21.15.92:0/2601849588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2adc0a3030 0x7f2adc13e4d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:17.223 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:17.222+0000 7f2ae4068700 1 -- 172.21.15.92:0/2601849588 >> 172.21.15.92:0/2601849588 conn(0x7f2adc067fc0 msgr2=0x7f2adc12d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:17.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:17.222+0000 7f2ae4068700 1 -- 172.21.15.92:0/2601849588 shutdown_connections 2023-09-29T23:27:17.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:17.222+0000 7f2ae4068700 1 -- 172.21.15.92:0/2601849588 wait complete. 2023-09-29T23:27:20.235 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:27:20.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.367+0000 7f614e1bf700 1 Processor -- start 2023-09-29T23:27:20.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.367+0000 7f614e1bf700 1 -- start start 2023-09-29T23:27:20.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.367+0000 7f614e1bf700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6148097780 0x7f6148131640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:20.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.367+0000 7f614e1bf700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6148098700 con 0x7f6148096ca0 2023-09-29T23:27:20.368 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.367+0000 7f614e1bf700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614809f430 con 0x7f6148097780 2023-09-29T23:27:20.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.367+0000 7f613effd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6148097780 0x7f6148131640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:20.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.367+0000 7f61477fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f6148096ca0 0x7f6148097070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:46836/0 (socket says 172.21.15.92:46836) 2023-09-29T23:27:20.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.367+0000 7f61477fe700 1 -- 172.21.15.92:0/2130430075 learned_addr learned my addr 172.21.15.92:0/2130430075 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:27:20.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.368+0000 7f613effd700 1 -- 172.21.15.92:0/2130430075 >> v1:172.21.15.92:6789/0 conn(0x7f6148096ca0 legacy=0x7f6148097070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:20.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.368+0000 7f613effd700 1 -- 172.21.15.92:0/2130430075 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614806fab0 con 0x7f6148097780 2023-09-29T23:27:20.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.368+0000 7f6146ffd700 1 -- 172.21.15.92:0/2130430075 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335964033 0 0) 0x7f6148098700 con 0x7f6148096ca0 2023-09-29T23:27:20.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.368+0000 7f613effd700 1 --2- 172.21.15.92:0/2130430075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6148097780 0x7f6148131640 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6130009860 tx=0x7f61300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc25df886458d8da server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:20.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.368+0000 7f6146ffd700 1 -- 172.21.15.92:0/2130430075 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f613000b680 con 0x7f6148097780 2023-09-29T23:27:20.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.368+0000 7f6146ffd700 1 -- 172.21.15.92:0/2130430075 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613000b7e0 con 0x7f6148097780 2023-09-29T23:27:20.369 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.368+0000 7f6146ffd700 1 -- 172.21.15.92:0/2130430075 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f613000bad0 con 0x7f6148097780 2023-09-29T23:27:20.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.368+0000 7f614e1bf700 1 -- 172.21.15.92:0/2130430075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6148097780 msgr2=0x7f6148131640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:20.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.368+0000 7f614e1bf700 1 --2- 172.21.15.92:0/2130430075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6148097780 0x7f6148131640 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6130009860 tx=0x7f61300091a0 comp rx=0 tx=0).stop 2023-09-29T23:27:20.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.368+0000 7f614e1bf700 1 -- 172.21.15.92:0/2130430075 shutdown_connections 2023-09-29T23:27:20.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.368+0000 7f614e1bf700 1 --2- 172.21.15.92:0/2130430075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6148097780 0x7f6148131640 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:20.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.368+0000 7f614e1bf700 1 -- 172.21.15.92:0/2130430075 >> 172.21.15.92:0/2130430075 conn(0x7f614806bd70 msgr2=0x7f614806e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:20.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.368+0000 7f614e1bf700 1 -- 172.21.15.92:0/2130430075 shutdown_connections 2023-09-29T23:27:20.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.368+0000 7f614e1bf700 1 -- 172.21.15.92:0/2130430075 wait complete. 2023-09-29T23:27:20.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.369+0000 7f614e1bf700 1 Processor -- start 2023-09-29T23:27:20.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.370+0000 7f614e1bf700 1 -- start start 2023-09-29T23:27:20.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.370+0000 7f614e1bf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6148096ca0 0x7f614808e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:20.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.370+0000 7f614e1bf700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614808fec0 con 0x7f6148096ca0 2023-09-29T23:27:20.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.370+0000 7f61477fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6148096ca0 0x7f614808e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:20.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.370+0000 7f61477fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6148096ca0 0x7f614808e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57470/0 (socket says 172.21.15.92:57470) 2023-09-29T23:27:20.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.370+0000 7f61477fe700 1 -- 172.21.15.92:0/1933345105 learned_addr learned my addr 172.21.15.92:0/1933345105 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:20.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.370+0000 7f61477fe700 1 -- 172.21.15.92:0/1933345105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6130009420 con 0x7f6148096ca0 2023-09-29T23:27:20.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.370+0000 7f61477fe700 1 --2- 172.21.15.92:0/1933345105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6148096ca0 0x7f614808e510 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f613800c690 tx=0x7f6138007c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:20.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.370+0000 7f613ffff700 1 -- 172.21.15.92:0/1933345105 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6138007460 con 0x7f6148096ca0 2023-09-29T23:27:20.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.371+0000 7f613ffff700 1 -- 172.21.15.92:0/1933345105 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61380075e0 con 0x7f6148096ca0 2023-09-29T23:27:20.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.371+0000 7f614e1bf700 1 -- 172.21.15.92:0/1933345105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614808fc90 con 0x7f6148096ca0 2023-09-29T23:27:20.373 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.371+0000 7f613ffff700 1 -- 172.21.15.92:0/1933345105 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6138005970 con 0x7f6148096ca0 2023-09-29T23:27:20.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.371+0000 7f614e1bf700 1 -- 172.21.15.92:0/1933345105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6148091660 con 0x7f6148096ca0 2023-09-29T23:27:20.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.372+0000 7f613ffff700 1 -- 172.21.15.92:0/1933345105 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f6138005ad0 con 0x7f6148096ca0 2023-09-29T23:27:20.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.372+0000 7f614e1bf700 1 -- 172.21.15.92:0/1933345105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614805f230 con 0x7f6148096ca0 2023-09-29T23:27:20.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.372+0000 7f613ffff700 1 --2- 172.21.15.92:0/1933345105 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6128035640 0x7f6128037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:20.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.372+0000 7f613ffff700 1 -- 172.21.15.92:0/1933345105 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f61380474c0 con 0x7f6148096ca0 2023-09-29T23:27:20.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.372+0000 7f613effd700 1 --2- 172.21.15.92:0/1933345105 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6128035640 0x7f6128037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:20.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.372+0000 7f613effd700 1 --2- 172.21.15.92:0/1933345105 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6128035640 0x7f6128037af0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f61300030c0 tx=0x7f6130016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:20.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.376+0000 7f613ffff700 1 -- 172.21.15.92:0/1933345105 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61380102c0 con 0x7f6148096ca0 2023-09-29T23:27:20.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.601+0000 7f614e1bf700 1 -- 172.21.15.92:0/1933345105 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f614804bb40 con 0x7f6148096ca0 2023-09-29T23:27:20.602 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.602+0000 7f613ffff700 1 -- 172.21.15.92:0/1933345105 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f613801bae0 con 0x7f6148096ca0 2023-09-29T23:27:20.602 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:27:20.602 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:27:20.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.604+0000 7f614e1bf700 1 -- 172.21.15.92:0/1933345105 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6128035640 msgr2=0x7f6128037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:20.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.604+0000 7f614e1bf700 1 --2- 172.21.15.92:0/1933345105 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6128035640 0x7f6128037af0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f61300030c0 tx=0x7f6130016000 comp rx=0 tx=0).stop 2023-09-29T23:27:20.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.604+0000 7f614e1bf700 1 -- 172.21.15.92:0/1933345105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6148096ca0 msgr2=0x7f614808e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:20.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.604+0000 7f614e1bf700 1 --2- 172.21.15.92:0/1933345105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6148096ca0 0x7f614808e510 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f613800c690 tx=0x7f6138007c40 comp rx=0 tx=0).stop 2023-09-29T23:27:20.604 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.604+0000 7f614e1bf700 1 -- 172.21.15.92:0/1933345105 shutdown_connections 2023-09-29T23:27:20.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.604+0000 7f614e1bf700 1 --2- 172.21.15.92:0/1933345105 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6128035640 0x7f6128037af0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:20.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.604+0000 7f614e1bf700 1 --2- 172.21.15.92:0/1933345105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6148096ca0 0x7f614808e510 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:20.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.604+0000 7f614e1bf700 1 -- 172.21.15.92:0/1933345105 >> 172.21.15.92:0/1933345105 conn(0x7f614806bd70 msgr2=0x7f614809c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:20.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.604+0000 7f614e1bf700 1 -- 172.21.15.92:0/1933345105 shutdown_connections 2023-09-29T23:27:20.605 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:20.604+0000 7f614e1bf700 1 -- 172.21.15.92:0/1933345105 wait complete. 2023-09-29T23:27:23.616 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:27:23.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.737+0000 7ff58dd3e700 1 Processor -- start 2023-09-29T23:27:23.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.737+0000 7ff58dd3e700 1 -- start start 2023-09-29T23:27:23.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.737+0000 7ff58dd3e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff58806b0c0 0x7ff58812f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:23.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.737+0000 7ff58dd3e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58809ca80 con 0x7ff58812fb70 2023-09-29T23:27:23.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.737+0000 7ff58dd3e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff58806b490 con 0x7ff58806b0c0 2023-09-29T23:27:23.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.737+0000 7ff58cd3c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff58806b0c0 0x7ff58812f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:23.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.738+0000 7ff587fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ff58812fb70 0x7ff588099530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:46852/0 (socket says 172.21.15.92:46852) 2023-09-29T23:27:23.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.738+0000 7ff587fff700 1 -- 172.21.15.92:0/2420825070 learned_addr learned my addr 172.21.15.92:0/2420825070 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:27:23.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.738+0000 7ff58cd3c700 1 -- 172.21.15.92:0/2420825070 >> v1:172.21.15.92:6789/0 conn(0x7ff58812fb70 legacy=0x7ff588099530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:23.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.738+0000 7ff58cd3c700 1 -- 172.21.15.92:0/2420825070 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58809be20 con 0x7ff58806b0c0 2023-09-29T23:27:23.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.738+0000 7ff5877fe700 1 -- 172.21.15.92:0/2420825070 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887533091 0 0) 0x7ff574001110 con 0x7ff58812fb70 2023-09-29T23:27:23.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.738+0000 7ff58cd3c700 1 --2- 172.21.15.92:0/2420825070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff58806b0c0 0x7ff58812f630 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009860 tx=0x7ff57c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d572524933518a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:23.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.738+0000 7ff5877fe700 1 -- 172.21.15.92:0/2420825070 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff57c00b680 con 0x7ff58806b0c0 2023-09-29T23:27:23.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.738+0000 7ff5877fe700 1 -- 172.21.15.92:0/2420825070 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c00b7e0 con 0x7ff58806b0c0 2023-09-29T23:27:23.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.738+0000 7ff5877fe700 1 -- 172.21.15.92:0/2420825070 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff57c00bad0 con 0x7ff58806b0c0 2023-09-29T23:27:23.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.739+0000 7ff58dd3e700 1 -- 172.21.15.92:0/2420825070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff58806b0c0 msgr2=0x7ff58812f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:23.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.739+0000 7ff58dd3e700 1 --2- 172.21.15.92:0/2420825070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff58806b0c0 0x7ff58812f630 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009860 tx=0x7ff57c0091a0 comp rx=0 tx=0).stop 2023-09-29T23:27:23.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.739+0000 7ff58dd3e700 1 -- 172.21.15.92:0/2420825070 shutdown_connections 2023-09-29T23:27:23.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.739+0000 7ff58dd3e700 1 --2- 172.21.15.92:0/2420825070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff58806b0c0 0x7ff58812f630 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:23.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.739+0000 7ff58dd3e700 1 -- 172.21.15.92:0/2420825070 >> 172.21.15.92:0/2420825070 conn(0x7ff58806a5b0 msgr2=0x7ff58806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:23.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.739+0000 7ff58dd3e700 1 -- 172.21.15.92:0/2420825070 shutdown_connections 2023-09-29T23:27:23.741 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.739+0000 7ff58dd3e700 1 -- 172.21.15.92:0/2420825070 wait complete. 2023-09-29T23:27:23.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.739+0000 7ff58dd3e700 1 Processor -- start 2023-09-29T23:27:23.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.740+0000 7ff58dd3e700 1 -- start start 2023-09-29T23:27:23.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.740+0000 7ff58dd3e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff58806b0c0 0x7ff58811dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:23.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.740+0000 7ff58dd3e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58811a7b0 con 0x7ff58806b0c0 2023-09-29T23:27:23.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.740+0000 7ff58cd3c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff58806b0c0 0x7ff58811dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:23.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.740+0000 7ff58cd3c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff58806b0c0 0x7ff58811dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57488/0 (socket says 172.21.15.92:57488) 2023-09-29T23:27:23.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.740+0000 7ff58cd3c700 1 -- 172.21.15.92:0/1467816512 learned_addr learned my addr 172.21.15.92:0/1467816512 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:23.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.740+0000 7ff58cd3c700 1 -- 172.21.15.92:0/1467816512 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c009420 con 0x7ff58806b0c0 2023-09-29T23:27:23.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.740+0000 7ff58cd3c700 1 --2- 172.21.15.92:0/1467816512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff58806b0c0 0x7ff58811dfe0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff57c006eb0 tx=0x7ff57c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:23.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.741+0000 7ff584ff9700 1 -- 172.21.15.92:0/1467816512 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff57c025470 con 0x7ff58806b0c0 2023-09-29T23:27:23.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.741+0000 7ff584ff9700 1 -- 172.21.15.92:0/1467816512 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c0255d0 con 0x7ff58806b0c0 2023-09-29T23:27:23.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.741+0000 7ff58dd3e700 1 -- 172.21.15.92:0/1467816512 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58812cea0 con 0x7ff58806b0c0 2023-09-29T23:27:23.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.741+0000 7ff584ff9700 1 -- 172.21.15.92:0/1467816512 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff57c025880 con 0x7ff58806b0c0 2023-09-29T23:27:23.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.741+0000 7ff58dd3e700 1 -- 172.21.15.92:0/1467816512 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58811e6c0 con 0x7ff58806b0c0 2023-09-29T23:27:23.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.742+0000 7ff584ff9700 1 -- 172.21.15.92:0/1467816512 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7ff57c022070 con 0x7ff58806b0c0 2023-09-29T23:27:23.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.742+0000 7ff58dd3e700 1 -- 172.21.15.92:0/1467816512 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58805f230 con 0x7ff58806b0c0 2023-09-29T23:27:23.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.742+0000 7ff584ff9700 1 --2- 172.21.15.92:0/1467816512 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff56c035640 0x7ff56c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:23.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.742+0000 7ff584ff9700 1 -- 172.21.15.92:0/1467816512 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7ff57c049530 con 0x7ff58806b0c0 2023-09-29T23:27:23.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.742+0000 7ff587fff700 1 --2- 172.21.15.92:0/1467816512 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff56c035640 0x7ff56c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:23.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.742+0000 7ff587fff700 1 --2- 172.21.15.92:0/1467816512 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff56c035640 0x7ff56c037af0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff574007fd0 tx=0x7ff574001250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:23.746 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.746+0000 7ff584ff9700 1 -- 172.21.15.92:0/1467816512 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff57c01ada0 con 0x7ff58806b0c0 2023-09-29T23:27:23.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.969+0000 7ff58dd3e700 1 -- 172.21.15.92:0/1467816512 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff58812f320 con 0x7ff58806b0c0 2023-09-29T23:27:23.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.969+0000 7ff584ff9700 1 -- 172.21.15.92:0/1467816512 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7ff57c01abc0 con 0x7ff58806b0c0 2023-09-29T23:27:23.970 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:27:23.970 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:27:23.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.971+0000 7ff58dd3e700 1 -- 172.21.15.92:0/1467816512 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff56c035640 msgr2=0x7ff56c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:23.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.971+0000 7ff58dd3e700 1 --2- 172.21.15.92:0/1467816512 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff56c035640 0x7ff56c037af0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff574007fd0 tx=0x7ff574001250 comp rx=0 tx=0).stop 2023-09-29T23:27:23.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.971+0000 7ff58dd3e700 1 -- 172.21.15.92:0/1467816512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff58806b0c0 msgr2=0x7ff58811dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:23.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.971+0000 7ff58dd3e700 1 --2- 172.21.15.92:0/1467816512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff58806b0c0 0x7ff58811dfe0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff57c006eb0 tx=0x7ff57c016000 comp rx=0 tx=0).stop 2023-09-29T23:27:23.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.971+0000 7ff58dd3e700 1 -- 172.21.15.92:0/1467816512 shutdown_connections 2023-09-29T23:27:23.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.971+0000 7ff58dd3e700 1 --2- 172.21.15.92:0/1467816512 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7ff56c035640 0x7ff56c037af0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:23.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.971+0000 7ff58dd3e700 1 --2- 172.21.15.92:0/1467816512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff58806b0c0 0x7ff58811dfe0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:23.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.971+0000 7ff58dd3e700 1 -- 172.21.15.92:0/1467816512 >> 172.21.15.92:0/1467816512 conn(0x7ff58806a5b0 msgr2=0x7ff58812dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:23.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.972+0000 7ff58dd3e700 1 -- 172.21.15.92:0/1467816512 shutdown_connections 2023-09-29T23:27:23.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:23.972+0000 7ff58dd3e700 1 -- 172.21.15.92:0/1467816512 wait complete. 2023-09-29T23:27:26.983 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:27:27.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.105+0000 7fb4bfcd0700 1 Processor -- start 2023-09-29T23:27:27.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.105+0000 7fb4bfcd0700 1 -- start start 2023-09-29T23:27:27.107 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.106+0000 7fb4bfcd0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb4b80a3030 0x7fb4b812f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:27.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.106+0000 7fb4bfcd0700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b80997f0 con 0x7fb4b812fae0 2023-09-29T23:27:27.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.106+0000 7fb4bfcd0700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b80a3400 con 0x7fb4b80a3030 2023-09-29T23:27:27.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.106+0000 7fb4bda6c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb4b80a3030 0x7fb4b812f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:27.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.106+0000 7fb4bd26b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fb4b812fae0 0x7fb4b8095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:46868/0 (socket says 172.21.15.92:46868) 2023-09-29T23:27:27.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.106+0000 7fb4bd26b700 1 -- 172.21.15.92:0/2990543139 learned_addr learned my addr 172.21.15.92:0/2990543139 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:27:27.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.106+0000 7fb4bda6c700 1 -- 172.21.15.92:0/2990543139 >> v1:172.21.15.92:6789/0 conn(0x7fb4b812fae0 legacy=0x7fb4b8095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:27.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.106+0000 7fb4bda6c700 1 -- 172.21.15.92:0/2990543139 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b80977a0 con 0x7fb4b80a3030 2023-09-29T23:27:27.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.106+0000 7fb4bca6a700 1 -- 172.21.15.92:0/2990543139 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585140085 0 0) 0x7fb4b80997f0 con 0x7fb4b812fae0 2023-09-29T23:27:27.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.106+0000 7fb4bda6c700 1 --2- 172.21.15.92:0/2990543139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b80a3030 0x7fb4b812f5a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4009de0 tx=0x7fb4b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e6823535435a08 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:27.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.106+0000 7fb4bca6a700 1 -- 172.21.15.92:0/2990543139 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4b400e070 con 0x7fb4b80a3030 2023-09-29T23:27:27.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.106+0000 7fb4bca6a700 1 -- 172.21.15.92:0/2990543139 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b400bd10 con 0x7fb4b80a3030 2023-09-29T23:27:27.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.106+0000 7fb4bca6a700 1 -- 172.21.15.92:0/2990543139 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4b4012430 con 0x7fb4b80a3030 2023-09-29T23:27:27.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.107+0000 7fb4bfcd0700 1 -- 172.21.15.92:0/2990543139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b80a3030 msgr2=0x7fb4b812f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:27.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.107+0000 7fb4bfcd0700 1 --2- 172.21.15.92:0/2990543139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b80a3030 0x7fb4b812f5a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4009de0 tx=0x7fb4b4009780 comp rx=0 tx=0).stop 2023-09-29T23:27:27.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.107+0000 7fb4bfcd0700 1 -- 172.21.15.92:0/2990543139 shutdown_connections 2023-09-29T23:27:27.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.107+0000 7fb4bfcd0700 1 --2- 172.21.15.92:0/2990543139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b80a3030 0x7fb4b812f5a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:27.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.107+0000 7fb4bfcd0700 1 -- 172.21.15.92:0/2990543139 >> 172.21.15.92:0/2990543139 conn(0x7fb4b8067fc0 msgr2=0x7fb4b80a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:27.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.107+0000 7fb4bfcd0700 1 -- 172.21.15.92:0/2990543139 shutdown_connections 2023-09-29T23:27:27.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.107+0000 7fb4bfcd0700 1 -- 172.21.15.92:0/2990543139 wait complete. 2023-09-29T23:27:27.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.108+0000 7fb4bfcd0700 1 Processor -- start 2023-09-29T23:27:27.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.108+0000 7fb4bfcd0700 1 -- start start 2023-09-29T23:27:27.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.108+0000 7fb4bfcd0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b80a3030 0x7fb4b813e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:27.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.108+0000 7fb4bfcd0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b811d1f0 con 0x7fb4b80a3030 2023-09-29T23:27:27.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.108+0000 7fb4bda6c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b80a3030 0x7fb4b813e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:27.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.108+0000 7fb4bda6c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b80a3030 0x7fb4b813e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57508/0 (socket says 172.21.15.92:57508) 2023-09-29T23:27:27.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.108+0000 7fb4bda6c700 1 -- 172.21.15.92:0/2131497537 learned_addr learned my addr 172.21.15.92:0/2131497537 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:27.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.108+0000 7fb4bda6c700 1 -- 172.21.15.92:0/2131497537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b4009a20 con 0x7fb4b80a3030 2023-09-29T23:27:27.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.109+0000 7fb4bda6c700 1 --2- 172.21.15.92:0/2131497537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b80a3030 0x7fb4b813e4d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb4b40099f0 tx=0x7fb4b4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:27.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.109+0000 7fb4adffb700 1 -- 172.21.15.92:0/2131497537 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4b401d640 con 0x7fb4b80a3030 2023-09-29T23:27:27.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.109+0000 7fb4adffb700 1 -- 172.21.15.92:0/2131497537 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b401d7a0 con 0x7fb4b80a3030 2023-09-29T23:27:27.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.109+0000 7fb4bfcd0700 1 -- 172.21.15.92:0/2131497537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b812ce00 con 0x7fb4b80a3030 2023-09-29T23:27:27.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.109+0000 7fb4adffb700 1 -- 172.21.15.92:0/2131497537 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4b401da90 con 0x7fb4b80a3030 2023-09-29T23:27:27.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.109+0000 7fb4bfcd0700 1 -- 172.21.15.92:0/2131497537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b811e630 con 0x7fb4b80a3030 2023-09-29T23:27:27.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.110+0000 7fb4adffb700 1 -- 172.21.15.92:0/2131497537 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fb4b4024070 con 0x7fb4b80a3030 2023-09-29T23:27:27.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.110+0000 7fb4bfcd0700 1 -- 172.21.15.92:0/2131497537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b811d060 con 0x7fb4b80a3030 2023-09-29T23:27:27.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.110+0000 7fb4adffb700 1 --2- 172.21.15.92:0/2131497537 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb49c035630 0x7fb49c037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:27.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.110+0000 7fb4adffb700 1 -- 172.21.15.92:0/2131497537 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fb4b404a390 con 0x7fb4b80a3030 2023-09-29T23:27:27.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.110+0000 7fb4bd26b700 1 --2- 172.21.15.92:0/2131497537 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb49c035630 0x7fb49c037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:27.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.110+0000 7fb4bd26b700 1 --2- 172.21.15.92:0/2131497537 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb49c035630 0x7fb49c037ae0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb4a80011e0 tx=0x7fb4a80079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:27.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.115+0000 7fb4adffb700 1 -- 172.21.15.92:0/2131497537 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4b4027990 con 0x7fb4b80a3030 2023-09-29T23:27:27.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.337+0000 7fb4bfcd0700 1 -- 172.21.15.92:0/2131497537 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb4b8097d10 con 0x7fb4b80a3030 2023-09-29T23:27:27.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.338+0000 7fb4adffb700 1 -- 172.21.15.92:0/2131497537 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fb4b401cba0 con 0x7fb4b80a3030 2023-09-29T23:27:27.338 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:27:27.338 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:27:27.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.340+0000 7fb4bfcd0700 1 -- 172.21.15.92:0/2131497537 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb49c035630 msgr2=0x7fb49c037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:27.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.340+0000 7fb4bfcd0700 1 --2- 172.21.15.92:0/2131497537 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb49c035630 0x7fb49c037ae0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb4a80011e0 tx=0x7fb4a80079d0 comp rx=0 tx=0).stop 2023-09-29T23:27:27.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.340+0000 7fb4bfcd0700 1 -- 172.21.15.92:0/2131497537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b80a3030 msgr2=0x7fb4b813e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:27.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.340+0000 7fb4bfcd0700 1 --2- 172.21.15.92:0/2131497537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b80a3030 0x7fb4b813e4d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb4b40099f0 tx=0x7fb4b4018000 comp rx=0 tx=0).stop 2023-09-29T23:27:27.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.340+0000 7fb4bfcd0700 1 -- 172.21.15.92:0/2131497537 shutdown_connections 2023-09-29T23:27:27.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.340+0000 7fb4bfcd0700 1 --2- 172.21.15.92:0/2131497537 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fb49c035630 0x7fb49c037ae0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:27.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.340+0000 7fb4bfcd0700 1 --2- 172.21.15.92:0/2131497537 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b80a3030 0x7fb4b813e4d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:27.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.340+0000 7fb4bfcd0700 1 -- 172.21.15.92:0/2131497537 >> 172.21.15.92:0/2131497537 conn(0x7fb4b8067fc0 msgr2=0x7fb4b812d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:27.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.340+0000 7fb4bfcd0700 1 -- 172.21.15.92:0/2131497537 shutdown_connections 2023-09-29T23:27:27.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:27.340+0000 7fb4bfcd0700 1 -- 172.21.15.92:0/2131497537 wait complete. 2023-09-29T23:27:30.352 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:27:30.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.475+0000 7f392e98c700 1 Processor -- start 2023-09-29T23:27:30.475 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.475+0000 7f392e98c700 1 -- start start 2023-09-29T23:27:30.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.475+0000 7f392e98c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f392806b0c0 0x7f392812f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:30.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.475+0000 7f392e98c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392809ca80 con 0x7f392812fb70 2023-09-29T23:27:30.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.475+0000 7f392e98c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392806b490 con 0x7f392806b0c0 2023-09-29T23:27:30.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.475+0000 7f392d98a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f392806b0c0 0x7f392812f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:30.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.475+0000 7f392d189700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f392812fb70 0x7f3928099530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:49718/0 (socket says 172.21.15.92:49718) 2023-09-29T23:27:30.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.475+0000 7f392d189700 1 -- 172.21.15.92:0/3696030409 learned_addr learned my addr 172.21.15.92:0/3696030409 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:27:30.477 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.476+0000 7f392d98a700 1 -- 172.21.15.92:0/3696030409 >> v1:172.21.15.92:6789/0 conn(0x7f392812fb70 legacy=0x7f3928099530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:30.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.476+0000 7f392d98a700 1 -- 172.21.15.92:0/3696030409 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392809be20 con 0x7f392806b0c0 2023-09-29T23:27:30.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.476+0000 7f392c988700 1 -- 172.21.15.92:0/3696030409 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153715724 0 0) 0x7f3924001110 con 0x7f392812fb70 2023-09-29T23:27:30.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.476+0000 7f392d98a700 1 --2- 172.21.15.92:0/3696030409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f392806b0c0 0x7f392812f630 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3918009860 tx=0x7f39180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d667459cd27ce2cc server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:30.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.476+0000 7f392c988700 1 -- 172.21.15.92:0/3696030409 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f391800b680 con 0x7f392806b0c0 2023-09-29T23:27:30.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.476+0000 7f392c988700 1 -- 172.21.15.92:0/3696030409 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391800b7e0 con 0x7f392806b0c0 2023-09-29T23:27:30.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.476+0000 7f392c988700 1 -- 172.21.15.92:0/3696030409 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f391800bad0 con 0x7f392806b0c0 2023-09-29T23:27:30.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.476+0000 7f392e98c700 1 -- 172.21.15.92:0/3696030409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f392806b0c0 msgr2=0x7f392812f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:30.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.476+0000 7f392e98c700 1 --2- 172.21.15.92:0/3696030409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f392806b0c0 0x7f392812f630 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3918009860 tx=0x7f39180091a0 comp rx=0 tx=0).stop 2023-09-29T23:27:30.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.476+0000 7f392e98c700 1 -- 172.21.15.92:0/3696030409 shutdown_connections 2023-09-29T23:27:30.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.477+0000 7f392e98c700 1 --2- 172.21.15.92:0/3696030409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f392806b0c0 0x7f392812f630 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:30.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.477+0000 7f392e98c700 1 -- 172.21.15.92:0/3696030409 >> 172.21.15.92:0/3696030409 conn(0x7f392806a5b0 msgr2=0x7f392806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:30.478 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.477+0000 7f392e98c700 1 -- 172.21.15.92:0/3696030409 shutdown_connections 2023-09-29T23:27:30.479 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.477+0000 7f392e98c700 1 -- 172.21.15.92:0/3696030409 wait complete. 2023-09-29T23:27:30.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.477+0000 7f392e98c700 1 Processor -- start 2023-09-29T23:27:30.480 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.477+0000 7f392e98c700 1 -- start start 2023-09-29T23:27:30.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.478+0000 7f392e98c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f392806b0c0 0x7f392811dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:30.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.478+0000 7f392e98c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392811a7b0 con 0x7f392806b0c0 2023-09-29T23:27:30.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.478+0000 7f392d98a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f392806b0c0 0x7f392811dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:30.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.478+0000 7f392d98a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f392806b0c0 0x7f392811dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44800/0 (socket says 172.21.15.92:44800) 2023-09-29T23:27:30.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.478+0000 7f392d98a700 1 -- 172.21.15.92:0/1505398071 learned_addr learned my addr 172.21.15.92:0/1505398071 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:30.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.478+0000 7f392d98a700 1 -- 172.21.15.92:0/1505398071 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3918009420 con 0x7f392806b0c0 2023-09-29T23:27:30.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.478+0000 7f392d98a700 1 --2- 172.21.15.92:0/1505398071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f392806b0c0 0x7f392811dfe0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3918006eb0 tx=0x7f3918016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:30.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.478+0000 7f391dffb700 1 -- 172.21.15.92:0/1505398071 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3918025470 con 0x7f392806b0c0 2023-09-29T23:27:30.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.478+0000 7f391dffb700 1 -- 172.21.15.92:0/1505398071 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39180255d0 con 0x7f392806b0c0 2023-09-29T23:27:30.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.478+0000 7f391dffb700 1 -- 172.21.15.92:0/1505398071 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3918025880 con 0x7f392806b0c0 2023-09-29T23:27:30.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.478+0000 7f392e98c700 1 -- 172.21.15.92:0/1505398071 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392812cea0 con 0x7f392806b0c0 2023-09-29T23:27:30.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.479+0000 7f392e98c700 1 -- 172.21.15.92:0/1505398071 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392811e6c0 con 0x7f392806b0c0 2023-09-29T23:27:30.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.479+0000 7f391dffb700 1 -- 172.21.15.92:0/1505398071 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f3918022070 con 0x7f392806b0c0 2023-09-29T23:27:30.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.479+0000 7f392e98c700 1 -- 172.21.15.92:0/1505398071 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392805f230 con 0x7f392806b0c0 2023-09-29T23:27:30.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.479+0000 7f391dffb700 1 --2- 172.21.15.92:0/1505398071 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f390c035640 0x7f390c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:30.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.479+0000 7f391dffb700 1 -- 172.21.15.92:0/1505398071 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f39180495a0 con 0x7f392806b0c0 2023-09-29T23:27:30.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.480+0000 7f392d189700 1 --2- 172.21.15.92:0/1505398071 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f390c035640 0x7f390c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:30.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.480+0000 7f392d189700 1 --2- 172.21.15.92:0/1505398071 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f390c035640 0x7f390c037af0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3924007fd0 tx=0x7f3924001250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:30.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.484+0000 7f391dffb700 1 -- 172.21.15.92:0/1505398071 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f391801ad50 con 0x7f392806b0c0 2023-09-29T23:27:30.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.708+0000 7f392e98c700 1 -- 172.21.15.92:0/1505398071 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f392804bb40 con 0x7f392806b0c0 2023-09-29T23:27:30.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.709+0000 7f391dffb700 1 -- 172.21.15.92:0/1505398071 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f391801ce40 con 0x7f392806b0c0 2023-09-29T23:27:30.709 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:27:30.709 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:27:30.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.711+0000 7f392e98c700 1 -- 172.21.15.92:0/1505398071 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f390c035640 msgr2=0x7f390c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:30.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.711+0000 7f392e98c700 1 --2- 172.21.15.92:0/1505398071 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f390c035640 0x7f390c037af0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3924007fd0 tx=0x7f3924001250 comp rx=0 tx=0).stop 2023-09-29T23:27:30.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.711+0000 7f392e98c700 1 -- 172.21.15.92:0/1505398071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f392806b0c0 msgr2=0x7f392811dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:30.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.711+0000 7f392e98c700 1 --2- 172.21.15.92:0/1505398071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f392806b0c0 0x7f392811dfe0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3918006eb0 tx=0x7f3918016000 comp rx=0 tx=0).stop 2023-09-29T23:27:30.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.711+0000 7f392e98c700 1 -- 172.21.15.92:0/1505398071 shutdown_connections 2023-09-29T23:27:30.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.711+0000 7f392e98c700 1 --2- 172.21.15.92:0/1505398071 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f390c035640 0x7f390c037af0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:30.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.711+0000 7f392e98c700 1 --2- 172.21.15.92:0/1505398071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f392806b0c0 0x7f392811dfe0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:30.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.711+0000 7f392e98c700 1 -- 172.21.15.92:0/1505398071 >> 172.21.15.92:0/1505398071 conn(0x7f392806a5b0 msgr2=0x7f392812dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:30.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.711+0000 7f392e98c700 1 -- 172.21.15.92:0/1505398071 shutdown_connections 2023-09-29T23:27:30.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:30.711+0000 7f392e98c700 1 -- 172.21.15.92:0/1505398071 wait complete. 2023-09-29T23:27:33.723 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:27:33.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.852+0000 7f64bd208700 1 Processor -- start 2023-09-29T23:27:33.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.852+0000 7f64bd208700 1 -- start start 2023-09-29T23:27:33.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.852+0000 7f64bd208700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f64b806f210 0x7f64b8069930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:33.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.852+0000 7f64bd208700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b8069620 con 0x7f64b809b890 2023-09-29T23:27:33.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.852+0000 7f64bd208700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b806f5e0 con 0x7f64b806f210 2023-09-29T23:27:33.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.852+0000 7f64b6d9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f64b806f210 0x7f64b8069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:33.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.852+0000 7f64b659c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f64b809b890 0x7f64b8069e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:49722/0 (socket says 172.21.15.92:49722) 2023-09-29T23:27:33.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.852+0000 7f64b659c700 1 -- 172.21.15.92:0/2539228565 learned_addr learned my addr 172.21.15.92:0/2539228565 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:27:33.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.853+0000 7f64b6d9d700 1 -- 172.21.15.92:0/2539228565 >> v1:172.21.15.92:6789/0 conn(0x7f64b809b890 legacy=0x7f64b8069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:33.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.853+0000 7f64b6d9d700 1 -- 172.21.15.92:0/2539228565 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b809cc70 con 0x7f64b806f210 2023-09-29T23:27:33.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.853+0000 7f64b5d9b700 1 -- 172.21.15.92:0/2539228565 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682854699 0 0) 0x7f64b8069620 con 0x7f64b809b890 2023-09-29T23:27:33.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.853+0000 7f64b6d9d700 1 --2- 172.21.15.92:0/2539228565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64b806f210 0x7f64b8069930 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f64b0009e30 tx=0x7f64b0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ea253366b9dc95 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:33.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.853+0000 7f64b5d9b700 1 -- 172.21.15.92:0/2539228565 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64b000e070 con 0x7f64b806f210 2023-09-29T23:27:33.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.853+0000 7f64b5d9b700 1 -- 172.21.15.92:0/2539228565 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b000bd70 con 0x7f64b806f210 2023-09-29T23:27:33.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.853+0000 7f64b5d9b700 1 -- 172.21.15.92:0/2539228565 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64b00125b0 con 0x7f64b806f210 2023-09-29T23:27:33.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.854+0000 7f64bd208700 1 -- 172.21.15.92:0/2539228565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64b806f210 msgr2=0x7f64b8069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:33.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.854+0000 7f64bd208700 1 --2- 172.21.15.92:0/2539228565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64b806f210 0x7f64b8069930 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f64b0009e30 tx=0x7f64b0009780 comp rx=0 tx=0).stop 2023-09-29T23:27:33.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.854+0000 7f64bd208700 1 -- 172.21.15.92:0/2539228565 shutdown_connections 2023-09-29T23:27:33.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.854+0000 7f64bd208700 1 --2- 172.21.15.92:0/2539228565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64b806f210 0x7f64b8069930 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:33.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.854+0000 7f64bd208700 1 -- 172.21.15.92:0/2539228565 >> 172.21.15.92:0/2539228565 conn(0x7f64b8094a70 msgr2=0x7f64b806eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:33.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.854+0000 7f64bd208700 1 -- 172.21.15.92:0/2539228565 shutdown_connections 2023-09-29T23:27:33.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.854+0000 7f64bd208700 1 -- 172.21.15.92:0/2539228565 wait complete. 2023-09-29T23:27:33.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.855+0000 7f64bd208700 1 Processor -- start 2023-09-29T23:27:33.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.855+0000 7f64bd208700 1 -- start start 2023-09-29T23:27:33.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.855+0000 7f64bd208700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64b806f210 0x7f64b812bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:33.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.855+0000 7f64bd208700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b811eaf0 con 0x7f64b806f210 2023-09-29T23:27:33.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.855+0000 7f64b6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64b806f210 0x7f64b812bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:33.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.855+0000 7f64b6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64b806f210 0x7f64b812bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44816/0 (socket says 172.21.15.92:44816) 2023-09-29T23:27:33.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.855+0000 7f64b6d9d700 1 -- 172.21.15.92:0/1443105429 learned_addr learned my addr 172.21.15.92:0/1443105429 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:33.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.855+0000 7f64b6d9d700 1 -- 172.21.15.92:0/1443105429 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b0009a20 con 0x7f64b806f210 2023-09-29T23:27:33.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.856+0000 7f64b6d9d700 1 --2- 172.21.15.92:0/1443105429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64b806f210 0x7f64b812bff0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f64b00099f0 tx=0x7f64b0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:33.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.856+0000 7f64aeffd700 1 -- 172.21.15.92:0/1443105429 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64b0027470 con 0x7f64b806f210 2023-09-29T23:27:33.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.856+0000 7f64aeffd700 1 -- 172.21.15.92:0/1443105429 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b00275d0 con 0x7f64b806f210 2023-09-29T23:27:33.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.856+0000 7f64aeffd700 1 -- 172.21.15.92:0/1443105429 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64b00278c0 con 0x7f64b806f210 2023-09-29T23:27:33.859 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.856+0000 7f64bd208700 1 -- 172.21.15.92:0/1443105429 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b812cdd0 con 0x7f64b806f210 2023-09-29T23:27:33.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.856+0000 7f64bd208700 1 -- 172.21.15.92:0/1443105429 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b811e350 con 0x7f64b806f210 2023-09-29T23:27:33.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.856+0000 7f64aeffd700 1 -- 172.21.15.92:0/1443105429 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f64b0024070 con 0x7f64b806f210 2023-09-29T23:27:33.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.857+0000 7f64bd208700 1 -- 172.21.15.92:0/1443105429 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b811e540 con 0x7f64b806f210 2023-09-29T23:27:33.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.857+0000 7f64aeffd700 1 --2- 172.21.15.92:0/1443105429 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6498035640 0x7f6498037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:33.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.857+0000 7f64aeffd700 1 -- 172.21.15.92:0/1443105429 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f64b0049de0 con 0x7f64b806f210 2023-09-29T23:27:33.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.857+0000 7f64b659c700 1 --2- 172.21.15.92:0/1443105429 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6498035640 0x7f6498037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:33.860 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.857+0000 7f64b659c700 1 --2- 172.21.15.92:0/1443105429 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6498035640 0x7f6498037af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f64a00011e0 tx=0x7f64a00079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:33.861 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:33.861+0000 7f64aeffd700 1 -- 172.21.15.92:0/1443105429 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64b002f760 con 0x7f64b806f210 2023-09-29T23:27:34.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:34.083+0000 7f64bd208700 1 -- 172.21.15.92:0/1443105429 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f64b805f230 con 0x7f64b806f210 2023-09-29T23:27:34.084 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:34.084+0000 7f64aeffd700 1 -- 172.21.15.92:0/1443105429 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f64b002f3a0 con 0x7f64b806f210 2023-09-29T23:27:34.084 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:27:34.084 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:27:34.086 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:34.086+0000 7f64bd208700 1 -- 172.21.15.92:0/1443105429 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6498035640 msgr2=0x7f6498037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:34.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:34.086+0000 7f64bd208700 1 --2- 172.21.15.92:0/1443105429 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6498035640 0x7f6498037af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f64a00011e0 tx=0x7f64a00079d0 comp rx=0 tx=0).stop 2023-09-29T23:27:34.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:34.086+0000 7f64bd208700 1 -- 172.21.15.92:0/1443105429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64b806f210 msgr2=0x7f64b812bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:34.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:34.086+0000 7f64bd208700 1 --2- 172.21.15.92:0/1443105429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64b806f210 0x7f64b812bff0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f64b00099f0 tx=0x7f64b0018000 comp rx=0 tx=0).stop 2023-09-29T23:27:34.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:34.086+0000 7f64bd208700 1 -- 172.21.15.92:0/1443105429 shutdown_connections 2023-09-29T23:27:34.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:34.086+0000 7f64bd208700 1 --2- 172.21.15.92:0/1443105429 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6498035640 0x7f6498037af0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:34.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:34.086+0000 7f64bd208700 1 --2- 172.21.15.92:0/1443105429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64b806f210 0x7f64b812bff0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:34.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:34.086+0000 7f64bd208700 1 -- 172.21.15.92:0/1443105429 >> 172.21.15.92:0/1443105429 conn(0x7f64b8094a70 msgr2=0x7f64b806da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:34.087 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:34.086+0000 7f64bd208700 1 -- 172.21.15.92:0/1443105429 shutdown_connections 2023-09-29T23:27:34.088 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:34.086+0000 7f64bd208700 1 -- 172.21.15.92:0/1443105429 wait complete. 2023-09-29T23:27:37.099 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:27:37.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.229+0000 7f2c91efb700 1 Processor -- start 2023-09-29T23:27:37.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.229+0000 7f2c91efb700 1 -- start start 2023-09-29T23:27:37.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.229+0000 7f2c91efb700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2c8c0a3030 0x7f2c8c12f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:37.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.229+0000 7f2c91efb700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8c0997f0 con 0x7f2c8c12fae0 2023-09-29T23:27:37.231 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.229+0000 7f2c91efb700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c8c0a3400 con 0x7f2c8c0a3030 2023-09-29T23:27:37.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.230+0000 7f2c8b7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2c8c0a3030 0x7f2c8c12f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:37.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.230+0000 7f2c8affd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f2c8c12fae0 0x7f2c8c095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:49732/0 (socket says 172.21.15.92:49732) 2023-09-29T23:27:37.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.230+0000 7f2c8affd700 1 -- 172.21.15.92:0/4011375629 learned_addr learned my addr 172.21.15.92:0/4011375629 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:27:37.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.230+0000 7f2c8b7fe700 1 -- 172.21.15.92:0/4011375629 >> v1:172.21.15.92:6789/0 conn(0x7f2c8c12fae0 legacy=0x7f2c8c095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:37.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.230+0000 7f2c8b7fe700 1 -- 172.21.15.92:0/4011375629 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8c0977a0 con 0x7f2c8c0a3030 2023-09-29T23:27:37.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.230+0000 7f2c8a7fc700 1 -- 172.21.15.92:0/4011375629 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775099242 0 0) 0x7f2c8c0997f0 con 0x7f2c8c12fae0 2023-09-29T23:27:37.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.230+0000 7f2c8b7fe700 1 --2- 172.21.15.92:0/4011375629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8c0a3030 0x7f2c8c12f5a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c009de0 tx=0x7f2c7c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7e51212c09b024 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:37.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.230+0000 7f2c8a7fc700 1 -- 172.21.15.92:0/4011375629 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c7c00e070 con 0x7f2c8c0a3030 2023-09-29T23:27:37.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.230+0000 7f2c8a7fc700 1 -- 172.21.15.92:0/4011375629 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7c00bd10 con 0x7f2c8c0a3030 2023-09-29T23:27:37.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.230+0000 7f2c8a7fc700 1 -- 172.21.15.92:0/4011375629 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c7c012430 con 0x7f2c8c0a3030 2023-09-29T23:27:37.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.231+0000 7f2c91efb700 1 -- 172.21.15.92:0/4011375629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8c0a3030 msgr2=0x7f2c8c12f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:37.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.231+0000 7f2c91efb700 1 --2- 172.21.15.92:0/4011375629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8c0a3030 0x7f2c8c12f5a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c009de0 tx=0x7f2c7c009780 comp rx=0 tx=0).stop 2023-09-29T23:27:37.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.231+0000 7f2c91efb700 1 -- 172.21.15.92:0/4011375629 shutdown_connections 2023-09-29T23:27:37.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.231+0000 7f2c91efb700 1 --2- 172.21.15.92:0/4011375629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8c0a3030 0x7f2c8c12f5a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:37.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.231+0000 7f2c91efb700 1 -- 172.21.15.92:0/4011375629 >> 172.21.15.92:0/4011375629 conn(0x7f2c8c067fc0 msgr2=0x7f2c8c0a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:37.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.231+0000 7f2c91efb700 1 -- 172.21.15.92:0/4011375629 shutdown_connections 2023-09-29T23:27:37.233 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.231+0000 7f2c91efb700 1 -- 172.21.15.92:0/4011375629 wait complete. 2023-09-29T23:27:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.232+0000 7f2c91efb700 1 Processor -- start 2023-09-29T23:27:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.232+0000 7f2c91efb700 1 -- start start 2023-09-29T23:27:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.232+0000 7f2c91efb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8c0a3030 0x7f2c8c13e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.232+0000 7f2c91efb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8c11e850 con 0x7f2c8c0a3030 2023-09-29T23:27:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.233+0000 7f2c8b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8c0a3030 0x7f2c8c13e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.233+0000 7f2c8b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8c0a3030 0x7f2c8c13e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44834/0 (socket says 172.21.15.92:44834) 2023-09-29T23:27:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.233+0000 7f2c8b7fe700 1 -- 172.21.15.92:0/481880360 learned_addr learned my addr 172.21.15.92:0/481880360 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.233+0000 7f2c8b7fe700 1 -- 172.21.15.92:0/481880360 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7c009a20 con 0x7f2c8c0a3030 2023-09-29T23:27:37.235 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.233+0000 7f2c8b7fe700 1 --2- 172.21.15.92:0/481880360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8c0a3030 0x7f2c8c13e4d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0097c0 tx=0x7f2c7c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.233+0000 7f2c737fe700 1 -- 172.21.15.92:0/481880360 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c7c00be80 con 0x7f2c8c0a3030 2023-09-29T23:27:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.233+0000 7f2c737fe700 1 -- 172.21.15.92:0/481880360 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7c01d640 con 0x7f2c8c0a3030 2023-09-29T23:27:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.233+0000 7f2c91efb700 1 -- 172.21.15.92:0/481880360 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c8c11e540 con 0x7f2c8c0a3030 2023-09-29T23:27:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.233+0000 7f2c737fe700 1 -- 172.21.15.92:0/481880360 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c7c01d930 con 0x7f2c8c0a3030 2023-09-29T23:27:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.233+0000 7f2c91efb700 1 -- 172.21.15.92:0/481880360 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8c11dcb0 con 0x7f2c8c0a3030 2023-09-29T23:27:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.234+0000 7f2c737fe700 1 -- 172.21.15.92:0/481880360 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f2c7c024070 con 0x7f2c8c0a3030 2023-09-29T23:27:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.234+0000 7f2c91efb700 1 -- 172.21.15.92:0/481880360 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c8c11e2e0 con 0x7f2c8c0a3030 2023-09-29T23:27:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.234+0000 7f2c737fe700 1 --2- 172.21.15.92:0/481880360 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2c78035640 0x7f2c78037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.234+0000 7f2c737fe700 1 -- 172.21.15.92:0/481880360 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f2c7c04a290 con 0x7f2c8c0a3030 2023-09-29T23:27:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.234+0000 7f2c8affd700 1 --2- 172.21.15.92:0/481880360 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2c78035640 0x7f2c78037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:37.236 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.235+0000 7f2c8affd700 1 --2- 172.21.15.92:0/481880360 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2c78035640 0x7f2c78037af0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2c800011e0 tx=0x7f2c800079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:37.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.239+0000 7f2c737fe700 1 -- 172.21.15.92:0/481880360 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c7c01da90 con 0x7f2c8c0a3030 2023-09-29T23:27:37.462 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.462+0000 7f2c91efb700 1 -- 172.21.15.92:0/481880360 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2c8c05f230 con 0x7f2c8c0a3030 2023-09-29T23:27:37.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.463+0000 7f2c737fe700 1 -- 172.21.15.92:0/481880360 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f2c7c01cb10 con 0x7f2c8c0a3030 2023-09-29T23:27:37.463 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:27:37.463 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:27:37.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.465+0000 7f2c91efb700 1 -- 172.21.15.92:0/481880360 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2c78035640 msgr2=0x7f2c78037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:37.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.465+0000 7f2c91efb700 1 --2- 172.21.15.92:0/481880360 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2c78035640 0x7f2c78037af0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2c800011e0 tx=0x7f2c800079d0 comp rx=0 tx=0).stop 2023-09-29T23:27:37.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.465+0000 7f2c91efb700 1 -- 172.21.15.92:0/481880360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8c0a3030 msgr2=0x7f2c8c13e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:37.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.465+0000 7f2c91efb700 1 --2- 172.21.15.92:0/481880360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8c0a3030 0x7f2c8c13e4d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0097c0 tx=0x7f2c7c018000 comp rx=0 tx=0).stop 2023-09-29T23:27:37.465 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.465+0000 7f2c91efb700 1 -- 172.21.15.92:0/481880360 shutdown_connections 2023-09-29T23:27:37.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.465+0000 7f2c91efb700 1 --2- 172.21.15.92:0/481880360 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2c78035640 0x7f2c78037af0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:37.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.465+0000 7f2c91efb700 1 --2- 172.21.15.92:0/481880360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8c0a3030 0x7f2c8c13e4d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:37.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.465+0000 7f2c91efb700 1 -- 172.21.15.92:0/481880360 >> 172.21.15.92:0/481880360 conn(0x7f2c8c067fc0 msgr2=0x7f2c8c12d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:37.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.465+0000 7f2c91efb700 1 -- 172.21.15.92:0/481880360 shutdown_connections 2023-09-29T23:27:37.466 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:37.465+0000 7f2c91efb700 1 -- 172.21.15.92:0/481880360 wait complete. 2023-09-29T23:27:40.480 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:27:40.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.608+0000 7f5b9acb7700 1 Processor -- start 2023-09-29T23:27:40.608 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.608+0000 7f5b9acb7700 1 -- start start 2023-09-29T23:27:40.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.609+0000 7f5b9acb7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5b9406a040 0x7f5b94134560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:40.610 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.609+0000 7f5b9acb7700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b940a1580 con 0x7f5b9406f210 2023-09-29T23:27:40.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.609+0000 7f5b9acb7700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9406f5e0 con 0x7f5b9406a040 2023-09-29T23:27:40.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.609+0000 7f5b93fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5b9406a040 0x7f5b94134560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:40.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.609+0000 7f5b93fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5b9406a040 0x7f5b94134560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50194/0 (socket says 172.21.15.92:50194) 2023-09-29T23:27:40.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.609+0000 7f5b98a53700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f5b9406f210 0x7f5b94069930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:44432/0 (socket says 172.21.15.92:44432) 2023-09-29T23:27:40.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.609+0000 7f5b93fff700 1 -- 172.21.15.92:0/3595883657 learned_addr learned my addr 172.21.15.92:0/3595883657 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:40.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.609+0000 7f5b93fff700 1 -- 172.21.15.92:0/3595883657 >> v1:172.21.15.92:6789/0 conn(0x7f5b9406f210 legacy=0x7f5b94069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:40.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.609+0000 7f5b93fff700 1 -- 172.21.15.92:0/3595883657 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9409cc70 con 0x7f5b9406a040 2023-09-29T23:27:40.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.609+0000 7f5b937fe700 1 -- 172.21.15.92:0/3595883657 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429548365 0 0) 0x7f5b940a1580 con 0x7f5b9406f210 2023-09-29T23:27:40.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.609+0000 7f5b93fff700 1 --2- 172.21.15.92:0/3595883657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b9406a040 0x7f5b94134560 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009930 tx=0x7f5b88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9f304971b9efbb server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:40.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.609+0000 7f5b937fe700 1 -- 172.21.15.92:0/3595883657 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b8800b860 con 0x7f5b9406a040 2023-09-29T23:27:40.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.609+0000 7f5b937fe700 1 -- 172.21.15.92:0/3595883657 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8800b9c0 con 0x7f5b9406a040 2023-09-29T23:27:40.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.609+0000 7f5b937fe700 1 -- 172.21.15.92:0/3595883657 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b8800bc90 con 0x7f5b9406a040 2023-09-29T23:27:40.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.610+0000 7f5b9acb7700 1 -- 172.21.15.92:0/3595883657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b9406a040 msgr2=0x7f5b94134560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:40.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.610+0000 7f5b9acb7700 1 --2- 172.21.15.92:0/3595883657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b9406a040 0x7f5b94134560 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009930 tx=0x7f5b88009250 comp rx=0 tx=0).stop 2023-09-29T23:27:40.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.610+0000 7f5b9acb7700 1 -- 172.21.15.92:0/3595883657 shutdown_connections 2023-09-29T23:27:40.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.610+0000 7f5b9acb7700 1 --2- 172.21.15.92:0/3595883657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b9406a040 0x7f5b94134560 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:40.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.610+0000 7f5b9acb7700 1 -- 172.21.15.92:0/3595883657 >> 172.21.15.92:0/3595883657 conn(0x7f5b94094a70 msgr2=0x7f5b9406eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:40.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.610+0000 7f5b9acb7700 1 -- 172.21.15.92:0/3595883657 shutdown_connections 2023-09-29T23:27:40.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.610+0000 7f5b9acb7700 1 -- 172.21.15.92:0/3595883657 wait complete. 2023-09-29T23:27:40.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.611+0000 7f5b9acb7700 1 Processor -- start 2023-09-29T23:27:40.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.611+0000 7f5b9acb7700 1 -- start start 2023-09-29T23:27:40.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.611+0000 7f5b9acb7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b9406a040 0x7f5b94116f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:40.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.611+0000 7f5b9acb7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9411b130 con 0x7f5b9406a040 2023-09-29T23:27:40.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.611+0000 7f5b98a53700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b9406a040 0x7f5b94116f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:40.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.611+0000 7f5b98a53700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b9406a040 0x7f5b94116f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50204/0 (socket says 172.21.15.92:50204) 2023-09-29T23:27:40.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.611+0000 7f5b98a53700 1 -- 172.21.15.92:0/2005968975 learned_addr learned my addr 172.21.15.92:0/2005968975 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:40.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.612+0000 7f5b98a53700 1 -- 172.21.15.92:0/2005968975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b880094f0 con 0x7f5b9406a040 2023-09-29T23:27:40.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.612+0000 7f5b98a53700 1 --2- 172.21.15.92:0/2005968975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b9406a040 0x7f5b94116f20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00ca60 tx=0x7f5b8c001780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:40.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.612+0000 7f5b90ff9700 1 -- 172.21.15.92:0/2005968975 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b8c005d80 con 0x7f5b9406a040 2023-09-29T23:27:40.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.612+0000 7f5b90ff9700 1 -- 172.21.15.92:0/2005968975 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c00a5d0 con 0x7f5b9406a040 2023-09-29T23:27:40.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.612+0000 7f5b9acb7700 1 -- 172.21.15.92:0/2005968975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b94118320 con 0x7f5b9406a040 2023-09-29T23:27:40.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.612+0000 7f5b90ff9700 1 -- 172.21.15.92:0/2005968975 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b8c00a8c0 con 0x7f5b9406a040 2023-09-29T23:27:40.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.612+0000 7f5b9acb7700 1 -- 172.21.15.92:0/2005968975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b9411b440 con 0x7f5b9406a040 2023-09-29T23:27:40.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.613+0000 7f5b90ff9700 1 -- 172.21.15.92:0/2005968975 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f5b8c00aa20 con 0x7f5b9406a040 2023-09-29T23:27:40.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.613+0000 7f5b9acb7700 1 -- 172.21.15.92:0/2005968975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b9412cde0 con 0x7f5b9406a040 2023-09-29T23:27:40.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.613+0000 7f5b90ff9700 1 --2- 172.21.15.92:0/2005968975 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5b80035640 0x7f5b80037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:40.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.613+0000 7f5b90ff9700 1 -- 172.21.15.92:0/2005968975 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f5b8c046d20 con 0x7f5b9406a040 2023-09-29T23:27:40.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.613+0000 7f5b93fff700 1 --2- 172.21.15.92:0/2005968975 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5b80035640 0x7f5b80037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:40.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.613+0000 7f5b93fff700 1 --2- 172.21.15.92:0/2005968975 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5b80035640 0x7f5b80037af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5b88000c00 tx=0x7f5b88016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:40.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.618+0000 7f5b90ff9700 1 -- 172.21.15.92:0/2005968975 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b8c019260 con 0x7f5b9406a040 2023-09-29T23:27:40.842 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.841+0000 7f5b9acb7700 1 -- 172.21.15.92:0/2005968975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5b9411b280 con 0x7f5b9406a040 2023-09-29T23:27:40.842 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.842+0000 7f5b90ff9700 1 -- 172.21.15.92:0/2005968975 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f5b8c018100 con 0x7f5b9406a040 2023-09-29T23:27:40.842 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:27:40.842 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:27:40.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.844+0000 7f5b9acb7700 1 -- 172.21.15.92:0/2005968975 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5b80035640 msgr2=0x7f5b80037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:40.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.844+0000 7f5b9acb7700 1 --2- 172.21.15.92:0/2005968975 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5b80035640 0x7f5b80037af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5b88000c00 tx=0x7f5b88016000 comp rx=0 tx=0).stop 2023-09-29T23:27:40.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.844+0000 7f5b9acb7700 1 -- 172.21.15.92:0/2005968975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b9406a040 msgr2=0x7f5b94116f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:40.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.844+0000 7f5b9acb7700 1 --2- 172.21.15.92:0/2005968975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b9406a040 0x7f5b94116f20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00ca60 tx=0x7f5b8c001780 comp rx=0 tx=0).stop 2023-09-29T23:27:40.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.844+0000 7f5b9acb7700 1 -- 172.21.15.92:0/2005968975 shutdown_connections 2023-09-29T23:27:40.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.844+0000 7f5b9acb7700 1 --2- 172.21.15.92:0/2005968975 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5b80035640 0x7f5b80037af0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:40.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.844+0000 7f5b9acb7700 1 --2- 172.21.15.92:0/2005968975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b9406a040 0x7f5b94116f20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:40.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.844+0000 7f5b9acb7700 1 -- 172.21.15.92:0/2005968975 >> 172.21.15.92:0/2005968975 conn(0x7f5b94094a70 msgr2=0x7f5b9412ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:40.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.844+0000 7f5b9acb7700 1 -- 172.21.15.92:0/2005968975 shutdown_connections 2023-09-29T23:27:40.845 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:40.844+0000 7f5b9acb7700 1 -- 172.21.15.92:0/2005968975 wait complete. 2023-09-29T23:27:43.857 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:27:43.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.977+0000 7f680ee7d700 1 Processor -- start 2023-09-29T23:27:43.977 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.977+0000 7f680ee7d700 1 -- start start 2023-09-29T23:27:43.979 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.977+0000 7f680ee7d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f680806ed70 0x7f68080960e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:43.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.977+0000 7f680ee7d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68080979d0 con 0x7f6808096620 2023-09-29T23:27:43.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.978+0000 7f680ee7d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680806f140 con 0x7f680806ed70 2023-09-29T23:27:43.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.978+0000 7f680de7b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f680806ed70 0x7f68080960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:43.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.978+0000 7f680d67a700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f6808096620 0x7f6808130420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:44448/0 (socket says 172.21.15.92:44448) 2023-09-29T23:27:43.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.978+0000 7f680d67a700 1 -- 172.21.15.92:0/32782870 learned_addr learned my addr 172.21.15.92:0/32782870 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:27:43.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.978+0000 7f680ce79700 1 -- 172.21.15.92:0/32782870 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068180267 0 0) 0x7f68080979d0 con 0x7f6808096620 2023-09-29T23:27:43.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.978+0000 7f680ce79700 1 -- 172.21.15.92:0/32782870 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67f4003570 con 0x7f6808096620 2023-09-29T23:27:43.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.978+0000 7f680de7b700 1 -- 172.21.15.92:0/32782870 >> v1:172.21.15.92:6789/0 conn(0x7f6808096620 legacy=0x7f6808130420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:43.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.978+0000 7f680de7b700 1 -- 172.21.15.92:0/32782870 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6808098020 con 0x7f680806ed70 2023-09-29T23:27:43.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.978+0000 7f680de7b700 1 --2- 172.21.15.92:0/32782870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680806ed70 0x7f68080960e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6804009850 tx=0x7f6804009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c7ff005b4f06aa server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:43.980 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.978+0000 7f680ce79700 1 -- 172.21.15.92:0/32782870 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6804005d50 con 0x7f680806ed70 2023-09-29T23:27:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.978+0000 7f680ce79700 1 -- 172.21.15.92:0/32782870 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6804006030 con 0x7f680806ed70 2023-09-29T23:27:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.978+0000 7f680ce79700 1 -- 172.21.15.92:0/32782870 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6804006300 con 0x7f680806ed70 2023-09-29T23:27:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.979+0000 7f680ee7d700 1 -- 172.21.15.92:0/32782870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680806ed70 msgr2=0x7f68080960e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.979+0000 7f680ee7d700 1 --2- 172.21.15.92:0/32782870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680806ed70 0x7f68080960e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6804009850 tx=0x7f6804009120 comp rx=0 tx=0).stop 2023-09-29T23:27:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.979+0000 7f680ee7d700 1 -- 172.21.15.92:0/32782870 shutdown_connections 2023-09-29T23:27:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.979+0000 7f680ee7d700 1 --2- 172.21.15.92:0/32782870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680806ed70 0x7f68080960e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.979+0000 7f680ee7d700 1 -- 172.21.15.92:0/32782870 >> 172.21.15.92:0/32782870 conn(0x7f680806b270 msgr2=0x7f680806d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.979+0000 7f680ee7d700 1 -- 172.21.15.92:0/32782870 shutdown_connections 2023-09-29T23:27:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.979+0000 7f680ee7d700 1 -- 172.21.15.92:0/32782870 wait complete. 2023-09-29T23:27:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.980+0000 7f680ee7d700 1 Processor -- start 2023-09-29T23:27:43.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.980+0000 7f680ee7d700 1 -- start start 2023-09-29T23:27:43.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.980+0000 7f680ee7d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680806ed70 0x7f680813a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:43.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.980+0000 7f680ee7d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680808c730 con 0x7f680806ed70 2023-09-29T23:27:43.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.980+0000 7f680de7b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680806ed70 0x7f680813a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:43.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.980+0000 7f680de7b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680806ed70 0x7f680813a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50234/0 (socket says 172.21.15.92:50234) 2023-09-29T23:27:43.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.980+0000 7f680de7b700 1 -- 172.21.15.92:0/2729024977 learned_addr learned my addr 172.21.15.92:0/2729024977 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:43.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.980+0000 7f680de7b700 1 -- 172.21.15.92:0/2729024977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68040093c0 con 0x7f680806ed70 2023-09-29T23:27:43.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.980+0000 7f680de7b700 1 --2- 172.21.15.92:0/2729024977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680806ed70 0x7f680813a4e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6804006e50 tx=0x7f6804015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:43.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.981+0000 7f67fdffb700 1 -- 172.21.15.92:0/2729024977 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6804011980 con 0x7f680806ed70 2023-09-29T23:27:43.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.981+0000 7f67fdffb700 1 -- 172.21.15.92:0/2729024977 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6804011ae0 con 0x7f680806ed70 2023-09-29T23:27:43.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.981+0000 7f680ee7d700 1 -- 172.21.15.92:0/2729024977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680808d440 con 0x7f680806ed70 2023-09-29T23:27:43.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.981+0000 7f67fdffb700 1 -- 172.21.15.92:0/2729024977 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6804011dd0 con 0x7f680806ed70 2023-09-29T23:27:43.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.981+0000 7f680ee7d700 1 -- 172.21.15.92:0/2729024977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680808dad0 con 0x7f680806ed70 2023-09-29T23:27:43.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.982+0000 7f67fdffb700 1 -- 172.21.15.92:0/2729024977 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f6804023070 con 0x7f680806ed70 2023-09-29T23:27:43.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.982+0000 7f67fdffb700 1 --2- 172.21.15.92:0/2729024977 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f67ec035640 0x7f67ec037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:43.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.982+0000 7f680ee7d700 1 -- 172.21.15.92:0/2729024977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6808063220 con 0x7f680806ed70 2023-09-29T23:27:43.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.982+0000 7f67fdffb700 1 -- 172.21.15.92:0/2729024977 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f6804049270 con 0x7f680806ed70 2023-09-29T23:27:43.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.982+0000 7f680d67a700 1 --2- 172.21.15.92:0/2729024977 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f67ec035640 0x7f67ec037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:43.985 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.982+0000 7f680d67a700 1 --2- 172.21.15.92:0/2729024977 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f67ec035640 0x7f67ec037af0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f67f80058d0 tx=0x7f67f80079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:43.986 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:43.986+0000 7f67fdffb700 1 -- 172.21.15.92:0/2729024977 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f680401d430 con 0x7f680806ed70 2023-09-29T23:27:44.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:44.209+0000 7f680ee7d700 1 -- 172.21.15.92:0/2729024977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f68080992f0 con 0x7f680806ed70 2023-09-29T23:27:44.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:44.209+0000 7f67fdffb700 1 -- 172.21.15.92:0/2729024977 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f680401b3b0 con 0x7f680806ed70 2023-09-29T23:27:44.209 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:27:44.210 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:27:44.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:44.211+0000 7f680ee7d700 1 -- 172.21.15.92:0/2729024977 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f67ec035640 msgr2=0x7f67ec037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:44.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:44.211+0000 7f680ee7d700 1 --2- 172.21.15.92:0/2729024977 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f67ec035640 0x7f67ec037af0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f67f80058d0 tx=0x7f67f80079d0 comp rx=0 tx=0).stop 2023-09-29T23:27:44.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:44.211+0000 7f680ee7d700 1 -- 172.21.15.92:0/2729024977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680806ed70 msgr2=0x7f680813a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:44.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:44.211+0000 7f680ee7d700 1 --2- 172.21.15.92:0/2729024977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680806ed70 0x7f680813a4e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6804006e50 tx=0x7f6804015000 comp rx=0 tx=0).stop 2023-09-29T23:27:44.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:44.211+0000 7f680ee7d700 1 -- 172.21.15.92:0/2729024977 shutdown_connections 2023-09-29T23:27:44.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:44.211+0000 7f680ee7d700 1 --2- 172.21.15.92:0/2729024977 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f67ec035640 0x7f67ec037af0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:44.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:44.211+0000 7f680ee7d700 1 --2- 172.21.15.92:0/2729024977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680806ed70 0x7f680813a4e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:44.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:44.211+0000 7f680ee7d700 1 -- 172.21.15.92:0/2729024977 >> 172.21.15.92:0/2729024977 conn(0x7f680806b270 msgr2=0x7f680806e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:44.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:44.211+0000 7f680ee7d700 1 -- 172.21.15.92:0/2729024977 shutdown_connections 2023-09-29T23:27:44.212 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:44.211+0000 7f680ee7d700 1 -- 172.21.15.92:0/2729024977 wait complete. 2023-09-29T23:27:47.223 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:27:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.344+0000 7fc57877f700 1 Processor -- start 2023-09-29T23:27:47.344 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.344+0000 7fc57877f700 1 -- start start 2023-09-29T23:27:47.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.345+0000 7fc57877f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc5700963e0 0x7fc5700967b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:47.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.345+0000 7fc57877f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc570096220 con 0x7fc570096cf0 2023-09-29T23:27:47.346 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.345+0000 7fc57877f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc570098ad0 con 0x7fc5700963e0 2023-09-29T23:27:47.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.345+0000 7fc57651b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc5700963e0 0x7fc5700967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:47.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.345+0000 7fc575d1a700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fc570096cf0 0x7fc57012b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:44450/0 (socket says 172.21.15.92:44450) 2023-09-29T23:27:47.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.345+0000 7fc575d1a700 1 -- 172.21.15.92:0/30844999 learned_addr learned my addr 172.21.15.92:0/30844999 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:27:47.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.345+0000 7fc57651b700 1 --2- 172.21.15.92:0/30844999 >> v2:172.21.15.92:3300/0 conn(0x7fc5700963e0 0x7fc5700967b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50248/0 (socket says 172.21.15.92:50248) 2023-09-29T23:27:47.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.345+0000 7fc57651b700 1 -- 172.21.15.92:0/30844999 >> v1:172.21.15.92:6789/0 conn(0x7fc570096cf0 legacy=0x7fc57012b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:47.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.345+0000 7fc57651b700 1 -- 172.21.15.92:0/30844999 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5700972d0 con 0x7fc5700963e0 2023-09-29T23:27:47.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.345+0000 7fc575519700 1 -- 172.21.15.92:0/30844999 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033588999 0 0) 0x7fc570096220 con 0x7fc570096cf0 2023-09-29T23:27:47.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.345+0000 7fc57651b700 1 --2- 172.21.15.92:0/30844999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5700963e0 0x7fc5700967b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc56800a9f0 tx=0x7fc56800a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73e409d131271a8 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:47.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.345+0000 7fc575519700 1 -- 172.21.15.92:0/30844999 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc568005c10 con 0x7fc5700963e0 2023-09-29T23:27:47.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.345+0000 7fc575519700 1 -- 172.21.15.92:0/30844999 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc568005d70 con 0x7fc5700963e0 2023-09-29T23:27:47.347 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.345+0000 7fc575519700 1 -- 172.21.15.92:0/30844999 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc56800c760 con 0x7fc5700963e0 2023-09-29T23:27:47.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.346+0000 7fc57877f700 1 -- 172.21.15.92:0/30844999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5700963e0 msgr2=0x7fc5700967b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:47.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.346+0000 7fc57877f700 1 --2- 172.21.15.92:0/30844999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5700963e0 0x7fc5700967b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc56800a9f0 tx=0x7fc56800a2e0 comp rx=0 tx=0).stop 2023-09-29T23:27:47.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.346+0000 7fc57877f700 1 -- 172.21.15.92:0/30844999 shutdown_connections 2023-09-29T23:27:47.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.346+0000 7fc57877f700 1 --2- 172.21.15.92:0/30844999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5700963e0 0x7fc5700967b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:47.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.346+0000 7fc57877f700 1 -- 172.21.15.92:0/30844999 >> 172.21.15.92:0/30844999 conn(0x7fc57006bd70 msgr2=0x7fc57006e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:47.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.346+0000 7fc57877f700 1 -- 172.21.15.92:0/30844999 shutdown_connections 2023-09-29T23:27:47.348 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.346+0000 7fc57877f700 1 -- 172.21.15.92:0/30844999 wait complete. 2023-09-29T23:27:47.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.347+0000 7fc57877f700 1 Processor -- start 2023-09-29T23:27:47.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.347+0000 7fc57877f700 1 -- start start 2023-09-29T23:27:47.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.347+0000 7fc57877f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5700963e0 0x7fc570123580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:47.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.347+0000 7fc57877f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc570127980 con 0x7fc5700963e0 2023-09-29T23:27:47.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.347+0000 7fc57651b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5700963e0 0x7fc570123580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:47.350 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.347+0000 7fc57651b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5700963e0 0x7fc570123580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50254/0 (socket says 172.21.15.92:50254) 2023-09-29T23:27:47.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.347+0000 7fc57651b700 1 -- 172.21.15.92:0/3950675531 learned_addr learned my addr 172.21.15.92:0/3950675531 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:47.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.347+0000 7fc57651b700 1 -- 172.21.15.92:0/3950675531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56800a560 con 0x7fc5700963e0 2023-09-29T23:27:47.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.348+0000 7fc57651b700 1 --2- 172.21.15.92:0/3950675531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5700963e0 0x7fc570123580 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc568003080 tx=0x7fc568018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:47.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.348+0000 7fc56e7fc700 1 -- 172.21.15.92:0/3950675531 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc56800c760 con 0x7fc5700963e0 2023-09-29T23:27:47.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.348+0000 7fc56e7fc700 1 -- 172.21.15.92:0/3950675531 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc568023440 con 0x7fc5700963e0 2023-09-29T23:27:47.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.348+0000 7fc57877f700 1 -- 172.21.15.92:0/3950675531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc570127b70 con 0x7fc5700963e0 2023-09-29T23:27:47.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.348+0000 7fc56e7fc700 1 -- 172.21.15.92:0/3950675531 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc568023710 con 0x7fc5700963e0 2023-09-29T23:27:47.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.348+0000 7fc57877f700 1 -- 172.21.15.92:0/3950675531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc570127dd0 con 0x7fc5700963e0 2023-09-29T23:27:47.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.348+0000 7fc56e7fc700 1 -- 172.21.15.92:0/3950675531 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fc5680183f0 con 0x7fc5700963e0 2023-09-29T23:27:47.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.349+0000 7fc56e7fc700 1 --2- 172.21.15.92:0/3950675531 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc55c035640 0x7fc55c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:47.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.349+0000 7fc56e7fc700 1 -- 172.21.15.92:0/3950675531 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fc568049ea0 con 0x7fc5700963e0 2023-09-29T23:27:47.351 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.349+0000 7fc575d1a700 1 --2- 172.21.15.92:0/3950675531 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc55c035640 0x7fc55c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:47.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.349+0000 7fc57877f700 1 -- 172.21.15.92:0/3950675531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc570098660 con 0x7fc5700963e0 2023-09-29T23:27:47.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.349+0000 7fc575d1a700 1 --2- 172.21.15.92:0/3950675531 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc55c035640 0x7fc55c037af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc5640011e0 tx=0x7fc5640079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:47.353 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.353+0000 7fc56e7fc700 1 -- 172.21.15.92:0/3950675531 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc568028020 con 0x7fc5700963e0 2023-09-29T23:27:47.574 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.574+0000 7fc57877f700 1 -- 172.21.15.92:0/3950675531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc57006d3a0 con 0x7fc5700963e0 2023-09-29T23:27:47.575 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.574+0000 7fc56e7fc700 1 -- 172.21.15.92:0/3950675531 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fc568017350 con 0x7fc5700963e0 2023-09-29T23:27:47.575 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:27:47.575 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:27:47.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.576+0000 7fc57877f700 1 -- 172.21.15.92:0/3950675531 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc55c035640 msgr2=0x7fc55c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:47.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.576+0000 7fc57877f700 1 --2- 172.21.15.92:0/3950675531 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc55c035640 0x7fc55c037af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc5640011e0 tx=0x7fc5640079d0 comp rx=0 tx=0).stop 2023-09-29T23:27:47.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.576+0000 7fc57877f700 1 -- 172.21.15.92:0/3950675531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5700963e0 msgr2=0x7fc570123580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:47.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.576+0000 7fc57877f700 1 --2- 172.21.15.92:0/3950675531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5700963e0 0x7fc570123580 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc568003080 tx=0x7fc568018000 comp rx=0 tx=0).stop 2023-09-29T23:27:47.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.576+0000 7fc57877f700 1 -- 172.21.15.92:0/3950675531 shutdown_connections 2023-09-29T23:27:47.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.576+0000 7fc57877f700 1 --2- 172.21.15.92:0/3950675531 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc55c035640 0x7fc55c037af0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:47.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.576+0000 7fc57877f700 1 --2- 172.21.15.92:0/3950675531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5700963e0 0x7fc570123580 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:47.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.576+0000 7fc57877f700 1 -- 172.21.15.92:0/3950675531 >> 172.21.15.92:0/3950675531 conn(0x7fc57006bd70 msgr2=0x7fc570093580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:47.577 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.576+0000 7fc57877f700 1 -- 172.21.15.92:0/3950675531 shutdown_connections 2023-09-29T23:27:47.578 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:47.576+0000 7fc57877f700 1 -- 172.21.15.92:0/3950675531 wait complete. 2023-09-29T23:27:50.589 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:27:50.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.706+0000 7f03a81a9700 1 Processor -- start 2023-09-29T23:27:50.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.706+0000 7f03a81a9700 1 -- start start 2023-09-29T23:27:50.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.707+0000 7f03a81a9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f03a012ffc0 0x7f03a00a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:50.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.707+0000 7f03a81a9700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a0098710 con 0x7f03a009fd80 2023-09-29T23:27:50.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.707+0000 7f03a81a9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a012f340 con 0x7f03a012ffc0 2023-09-29T23:27:50.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.707+0000 7f03a5744700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f03a012ffc0 0x7f03a00a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:50.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.707+0000 7f03a5f45700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f03a009fd80 0x7f03a012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:34178/0 (socket says 172.21.15.92:34178) 2023-09-29T23:27:50.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.707+0000 7f03a5f45700 1 -- 172.21.15.92:0/2383257454 learned_addr learned my addr 172.21.15.92:0/2383257454 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:27:50.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.707+0000 7f03a5744700 1 -- 172.21.15.92:0/2383257454 >> v1:172.21.15.92:6789/0 conn(0x7f03a009fd80 legacy=0x7f03a012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:50.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.707+0000 7f03a5744700 1 -- 172.21.15.92:0/2383257454 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a00997e0 con 0x7f03a012ffc0 2023-09-29T23:27:50.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.707+0000 7f03a5744700 1 --2- 172.21.15.92:0/2383257454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03a012ffc0 0x7f03a00a3090 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0394009860 tx=0x7f03940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a0c3265855d8fd server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:50.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.708+0000 7f03a4f43700 1 -- 172.21.15.92:0/2383257454 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f039400b680 con 0x7f03a012ffc0 2023-09-29T23:27:50.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.708+0000 7f03a4f43700 1 -- 172.21.15.92:0/2383257454 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039400b7e0 con 0x7f03a012ffc0 2023-09-29T23:27:50.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.708+0000 7f03a4f43700 1 -- 172.21.15.92:0/2383257454 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f039400b990 con 0x7f03a012ffc0 2023-09-29T23:27:50.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.708+0000 7f03a81a9700 1 -- 172.21.15.92:0/2383257454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03a012ffc0 msgr2=0x7f03a00a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:50.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.708+0000 7f03a81a9700 1 --2- 172.21.15.92:0/2383257454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03a012ffc0 0x7f03a00a3090 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0394009860 tx=0x7f03940091a0 comp rx=0 tx=0).stop 2023-09-29T23:27:50.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.708+0000 7f03a81a9700 1 -- 172.21.15.92:0/2383257454 shutdown_connections 2023-09-29T23:27:50.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.708+0000 7f03a81a9700 1 --2- 172.21.15.92:0/2383257454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03a012ffc0 0x7f03a00a3090 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:50.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.708+0000 7f03a81a9700 1 -- 172.21.15.92:0/2383257454 >> 172.21.15.92:0/2383257454 conn(0x7f03a0068000 msgr2=0x7f03a00a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:50.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.708+0000 7f03a81a9700 1 -- 172.21.15.92:0/2383257454 shutdown_connections 2023-09-29T23:27:50.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.708+0000 7f03a81a9700 1 -- 172.21.15.92:0/2383257454 wait complete. 2023-09-29T23:27:50.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.709+0000 7f03a81a9700 1 Processor -- start 2023-09-29T23:27:50.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.709+0000 7f03a81a9700 1 -- start start 2023-09-29T23:27:50.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.709+0000 7f03a81a9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03a009fd80 0x7f03a011def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:50.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.709+0000 7f03a81a9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a011cb30 con 0x7f03a009fd80 2023-09-29T23:27:50.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.709+0000 7f03a5f45700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03a009fd80 0x7f03a011def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:50.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.709+0000 7f03a5f45700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03a009fd80 0x7f03a011def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45112/0 (socket says 172.21.15.92:45112) 2023-09-29T23:27:50.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.709+0000 7f03a5f45700 1 -- 172.21.15.92:0/293278867 learned_addr learned my addr 172.21.15.92:0/293278867 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:50.712 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.710+0000 7f03a5f45700 1 -- 172.21.15.92:0/293278867 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0394009420 con 0x7f03a009fd80 2023-09-29T23:27:50.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.710+0000 7f03a5f45700 1 --2- 172.21.15.92:0/293278867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03a009fd80 0x7f03a011def0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f039000c460 tx=0x7f0390001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:50.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.710+0000 7f039dffb700 1 -- 172.21.15.92:0/293278867 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0390005b30 con 0x7f03a009fd80 2023-09-29T23:27:50.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.710+0000 7f039dffb700 1 -- 172.21.15.92:0/293278867 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0390005c90 con 0x7f03a009fd80 2023-09-29T23:27:50.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.710+0000 7f03a81a9700 1 -- 172.21.15.92:0/293278867 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a011da60 con 0x7f03a009fd80 2023-09-29T23:27:50.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.710+0000 7f039dffb700 1 -- 172.21.15.92:0/293278867 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03900070d0 con 0x7f03a009fd80 2023-09-29T23:27:50.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.710+0000 7f03a81a9700 1 -- 172.21.15.92:0/293278867 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a011a750 con 0x7f03a009fd80 2023-09-29T23:27:50.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.711+0000 7f039dffb700 1 -- 172.21.15.92:0/293278867 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f0390007230 con 0x7f03a009fd80 2023-09-29T23:27:50.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.711+0000 7f03a81a9700 1 -- 172.21.15.92:0/293278867 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a00a30e0 con 0x7f03a009fd80 2023-09-29T23:27:50.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.711+0000 7f039dffb700 1 --2- 172.21.15.92:0/293278867 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f038c035630 0x7f038c037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:50.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.711+0000 7f039dffb700 1 -- 172.21.15.92:0/293278867 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f0390046850 con 0x7f03a009fd80 2023-09-29T23:27:50.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.711+0000 7f03a5744700 1 --2- 172.21.15.92:0/293278867 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f038c035630 0x7f038c037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:50.714 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.711+0000 7f03a5744700 1 --2- 172.21.15.92:0/293278867 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f038c035630 0x7f038c037ae0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0394009860 tx=0x7f0394016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:50.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.716+0000 7f039dffb700 1 -- 172.21.15.92:0/293278867 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f039000f850 con 0x7f03a009fd80 2023-09-29T23:27:50.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.937+0000 7f03a81a9700 1 -- 172.21.15.92:0/293278867 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f03a00a1ba0 con 0x7f03a009fd80 2023-09-29T23:27:50.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.938+0000 7f039dffb700 1 -- 172.21.15.92:0/293278867 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f0390017070 con 0x7f03a009fd80 2023-09-29T23:27:50.938 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:27:50.938 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:27:50.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.940+0000 7f03a81a9700 1 -- 172.21.15.92:0/293278867 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f038c035630 msgr2=0x7f038c037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:50.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.940+0000 7f03a81a9700 1 --2- 172.21.15.92:0/293278867 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f038c035630 0x7f038c037ae0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0394009860 tx=0x7f0394016000 comp rx=0 tx=0).stop 2023-09-29T23:27:50.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.940+0000 7f03a81a9700 1 -- 172.21.15.92:0/293278867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03a009fd80 msgr2=0x7f03a011def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:50.940 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.940+0000 7f03a81a9700 1 --2- 172.21.15.92:0/293278867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03a009fd80 0x7f03a011def0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f039000c460 tx=0x7f0390001020 comp rx=0 tx=0).stop 2023-09-29T23:27:50.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.940+0000 7f03a81a9700 1 -- 172.21.15.92:0/293278867 shutdown_connections 2023-09-29T23:27:50.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.940+0000 7f03a81a9700 1 --2- 172.21.15.92:0/293278867 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f038c035630 0x7f038c037ae0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:50.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.940+0000 7f03a81a9700 1 --2- 172.21.15.92:0/293278867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03a009fd80 0x7f03a011def0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:50.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.940+0000 7f03a81a9700 1 -- 172.21.15.92:0/293278867 >> 172.21.15.92:0/293278867 conn(0x7f03a0068000 msgr2=0x7f03a012def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:50.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.940+0000 7f03a81a9700 1 -- 172.21.15.92:0/293278867 shutdown_connections 2023-09-29T23:27:50.941 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:50.940+0000 7f03a81a9700 1 -- 172.21.15.92:0/293278867 wait complete. 2023-09-29T23:27:53.952 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:27:54.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.073+0000 7fae76f9d700 1 Processor -- start 2023-09-29T23:27:54.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.074+0000 7fae76f9d700 1 -- start start 2023-09-29T23:27:54.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.074+0000 7fae76f9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fae7012f6b0 0x7fae70134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:54.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.074+0000 7fae76f9d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7009b730 con 0x7fae7006f100 2023-09-29T23:27:54.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.074+0000 7fae76f9d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7006a870 con 0x7fae7012f6b0 2023-09-29T23:27:54.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.074+0000 7fae7579a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fae7012f6b0 0x7fae70134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:54.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.074+0000 7fae75f9b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fae7006f100 0x7fae7012efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:34194/0 (socket says 172.21.15.92:34194) 2023-09-29T23:27:54.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.074+0000 7fae75f9b700 1 -- 172.21.15.92:0/3024128239 learned_addr learned my addr 172.21.15.92:0/3024128239 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:27:54.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.074+0000 7fae7579a700 1 -- 172.21.15.92:0/3024128239 >> v1:172.21.15.92:6789/0 conn(0x7fae7006f100 legacy=0x7fae7012efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:54.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.075+0000 7fae7579a700 1 -- 172.21.15.92:0/3024128239 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7009b9d0 con 0x7fae7012f6b0 2023-09-29T23:27:54.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.074+0000 7fae74f99700 1 -- 172.21.15.92:0/3024128239 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271625582 0 0) 0x7fae7009b730 con 0x7fae7006f100 2023-09-29T23:27:54.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.075+0000 7fae7579a700 1 --2- 172.21.15.92:0/3024128239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae7012f6b0 0x7fae70134330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fae64009860 tx=0x7fae640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5da844ec2e22819 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:54.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.075+0000 7fae74f99700 1 -- 172.21.15.92:0/3024128239 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae6400b680 con 0x7fae7012f6b0 2023-09-29T23:27:54.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.075+0000 7fae74f99700 1 -- 172.21.15.92:0/3024128239 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6400b7e0 con 0x7fae7012f6b0 2023-09-29T23:27:54.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.075+0000 7fae74f99700 1 -- 172.21.15.92:0/3024128239 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae6400b990 con 0x7fae7012f6b0 2023-09-29T23:27:54.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.075+0000 7fae76f9d700 1 -- 172.21.15.92:0/3024128239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae7012f6b0 msgr2=0x7fae70134330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:54.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.075+0000 7fae76f9d700 1 --2- 172.21.15.92:0/3024128239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae7012f6b0 0x7fae70134330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fae64009860 tx=0x7fae640091a0 comp rx=0 tx=0).stop 2023-09-29T23:27:54.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.075+0000 7fae76f9d700 1 -- 172.21.15.92:0/3024128239 shutdown_connections 2023-09-29T23:27:54.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.075+0000 7fae76f9d700 1 --2- 172.21.15.92:0/3024128239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae7012f6b0 0x7fae70134330 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:54.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.075+0000 7fae76f9d700 1 -- 172.21.15.92:0/3024128239 >> 172.21.15.92:0/3024128239 conn(0x7fae70094a70 msgr2=0x7fae7006e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:54.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.075+0000 7fae76f9d700 1 -- 172.21.15.92:0/3024128239 shutdown_connections 2023-09-29T23:27:54.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.075+0000 7fae76f9d700 1 -- 172.21.15.92:0/3024128239 wait complete. 2023-09-29T23:27:54.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.076+0000 7fae76f9d700 1 Processor -- start 2023-09-29T23:27:54.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.076+0000 7fae76f9d700 1 -- start start 2023-09-29T23:27:54.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.077+0000 7fae76f9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae7006f100 0x7fae7012be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:54.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.077+0000 7fae76f9d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7011e910 con 0x7fae7006f100 2023-09-29T23:27:54.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.077+0000 7fae75f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae7006f100 0x7fae7012be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:54.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.077+0000 7fae75f9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae7006f100 0x7fae7012be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45130/0 (socket says 172.21.15.92:45130) 2023-09-29T23:27:54.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.077+0000 7fae75f9b700 1 -- 172.21.15.92:0/3935564932 learned_addr learned my addr 172.21.15.92:0/3935564932 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:54.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.077+0000 7fae75f9b700 1 -- 172.21.15.92:0/3935564932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae64009420 con 0x7fae7006f100 2023-09-29T23:27:54.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.077+0000 7fae75f9b700 1 --2- 172.21.15.92:0/3935564932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae7006f100 0x7fae7012be10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fae6000cbc0 tx=0x7fae600019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:54.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.077+0000 7fae6dffb700 1 -- 172.21.15.92:0/3935564932 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae6000a970 con 0x7fae7006f100 2023-09-29T23:27:54.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.077+0000 7fae6dffb700 1 -- 172.21.15.92:0/3935564932 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6000aaf0 con 0x7fae7006f100 2023-09-29T23:27:54.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.077+0000 7fae76f9d700 1 -- 172.21.15.92:0/3935564932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7011e600 con 0x7fae7006f100 2023-09-29T23:27:54.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.077+0000 7fae6dffb700 1 -- 172.21.15.92:0/3935564932 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fae6000ade0 con 0x7fae7006f100 2023-09-29T23:27:54.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.077+0000 7fae76f9d700 1 -- 172.21.15.92:0/3935564932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7011dd00 con 0x7fae7006f100 2023-09-29T23:27:54.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.078+0000 7fae6dffb700 1 -- 172.21.15.92:0/3935564932 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fae600070f0 con 0x7fae7006f100 2023-09-29T23:27:54.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.078+0000 7fae76f9d700 1 -- 172.21.15.92:0/3935564932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7005f230 con 0x7fae7006f100 2023-09-29T23:27:54.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.078+0000 7fae6dffb700 1 --2- 172.21.15.92:0/3935564932 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fae5c035630 0x7fae5c037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:54.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.078+0000 7fae6dffb700 1 -- 172.21.15.92:0/3935564932 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fae600479a0 con 0x7fae7006f100 2023-09-29T23:27:54.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.078+0000 7fae7579a700 1 --2- 172.21.15.92:0/3935564932 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fae5c035630 0x7fae5c037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:54.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.079+0000 7fae7579a700 1 --2- 172.21.15.92:0/3935564932 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fae5c035630 0x7fae5c037ae0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fae64006eb0 tx=0x7fae64016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:54.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.083+0000 7fae6dffb700 1 -- 172.21.15.92:0/3935564932 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae600108f0 con 0x7fae7006f100 2023-09-29T23:27:54.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.305+0000 7fae76f9d700 1 -- 172.21.15.92:0/3935564932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fae7006b250 con 0x7fae7006f100 2023-09-29T23:27:54.305 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.305+0000 7fae6dffb700 1 -- 172.21.15.92:0/3935564932 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fae600113a0 con 0x7fae7006f100 2023-09-29T23:27:54.306 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:27:54.306 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:27:54.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.307+0000 7fae76f9d700 1 -- 172.21.15.92:0/3935564932 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fae5c035630 msgr2=0x7fae5c037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:54.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.307+0000 7fae76f9d700 1 --2- 172.21.15.92:0/3935564932 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fae5c035630 0x7fae5c037ae0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fae64006eb0 tx=0x7fae64016000 comp rx=0 tx=0).stop 2023-09-29T23:27:54.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.307+0000 7fae76f9d700 1 -- 172.21.15.92:0/3935564932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae7006f100 msgr2=0x7fae7012be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:54.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.307+0000 7fae76f9d700 1 --2- 172.21.15.92:0/3935564932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae7006f100 0x7fae7012be10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fae6000cbc0 tx=0x7fae600019e0 comp rx=0 tx=0).stop 2023-09-29T23:27:54.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.307+0000 7fae76f9d700 1 -- 172.21.15.92:0/3935564932 shutdown_connections 2023-09-29T23:27:54.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.307+0000 7fae76f9d700 1 --2- 172.21.15.92:0/3935564932 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fae5c035630 0x7fae5c037ae0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:54.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.307+0000 7fae76f9d700 1 --2- 172.21.15.92:0/3935564932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae7006f100 0x7fae7012be10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:54.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.307+0000 7fae76f9d700 1 -- 172.21.15.92:0/3935564932 >> 172.21.15.92:0/3935564932 conn(0x7fae70094a70 msgr2=0x7fae7012ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:54.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.307+0000 7fae76f9d700 1 -- 172.21.15.92:0/3935564932 shutdown_connections 2023-09-29T23:27:54.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:54.307+0000 7fae76f9d700 1 -- 172.21.15.92:0/3935564932 wait complete. 2023-09-29T23:27:57.320 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:27:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.479+0000 7f76d161c700 1 Processor -- start 2023-09-29T23:27:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.479+0000 7f76d161c700 1 -- start start 2023-09-29T23:27:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.480+0000 7f76d161c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f76cc09fd80 0x7f76cc0a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.480+0000 7f76d161c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76cc098710 con 0x7f76cc12f8b0 2023-09-29T23:27:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.480+0000 7f76d161c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76cc12f340 con 0x7f76cc09fd80 2023-09-29T23:27:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.480+0000 7f76caffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f76cc09fd80 0x7f76cc0a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.480+0000 7f76ca7fc700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f76cc12f8b0 0x7f76cc095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:34206/0 (socket says 172.21.15.92:34206) 2023-09-29T23:27:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.480+0000 7f76caffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f76cc09fd80 0x7f76cc0a3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45138/0 (socket says 172.21.15.92:45138) 2023-09-29T23:27:57.481 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.480+0000 7f76ca7fc700 1 -- 172.21.15.92:0/1184049489 learned_addr learned my addr 172.21.15.92:0/1184049489 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:27:57.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.480+0000 7f76caffd700 1 -- 172.21.15.92:0/1184049489 >> v1:172.21.15.92:6789/0 conn(0x7f76cc12f8b0 legacy=0x7f76cc095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:57.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.480+0000 7f76caffd700 1 -- 172.21.15.92:0/1184049489 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc0997e0 con 0x7f76cc09fd80 2023-09-29T23:27:57.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.480+0000 7f76caffd700 1 --2- 172.21.15.92:0/1184049489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76cc09fd80 0x7f76cc0a3090 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009de0 tx=0x7f76bc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79bb651814e8460c server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:57.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.480+0000 7f76c9ffb700 1 -- 172.21.15.92:0/1184049489 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76bc00e070 con 0x7f76cc09fd80 2023-09-29T23:27:57.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.481+0000 7f76c9ffb700 1 -- 172.21.15.92:0/1184049489 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc00bc80 con 0x7f76cc09fd80 2023-09-29T23:27:57.482 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.481+0000 7f76c9ffb700 1 -- 172.21.15.92:0/1184049489 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76bc012430 con 0x7f76cc09fd80 2023-09-29T23:27:57.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.481+0000 7f76d161c700 1 -- 172.21.15.92:0/1184049489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76cc09fd80 msgr2=0x7f76cc0a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:57.484 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.481+0000 7f76d161c700 1 --2- 172.21.15.92:0/1184049489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76cc09fd80 0x7f76cc0a3090 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009de0 tx=0x7f76bc009780 comp rx=0 tx=0).stop 2023-09-29T23:27:57.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.481+0000 7f76d161c700 1 -- 172.21.15.92:0/1184049489 shutdown_connections 2023-09-29T23:27:57.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.481+0000 7f76d161c700 1 --2- 172.21.15.92:0/1184049489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76cc09fd80 0x7f76cc0a3090 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:57.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.481+0000 7f76d161c700 1 -- 172.21.15.92:0/1184049489 >> 172.21.15.92:0/1184049489 conn(0x7f76cc068000 msgr2=0x7f76cc0a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:57.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.481+0000 7f76d161c700 1 -- 172.21.15.92:0/1184049489 shutdown_connections 2023-09-29T23:27:57.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.481+0000 7f76d161c700 1 -- 172.21.15.92:0/1184049489 wait complete. 2023-09-29T23:27:57.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.482+0000 7f76d161c700 1 Processor -- start 2023-09-29T23:27:57.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.482+0000 7f76d161c700 1 -- start start 2023-09-29T23:27:57.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.482+0000 7f76d161c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76cc09fd80 0x7f76cc119fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:57.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.482+0000 7f76d161c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc11e610 con 0x7f76cc09fd80 2023-09-29T23:27:57.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.483+0000 7f76caffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76cc09fd80 0x7f76cc119fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:57.485 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.483+0000 7f76caffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76cc09fd80 0x7f76cc119fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45150/0 (socket says 172.21.15.92:45150) 2023-09-29T23:27:57.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.483+0000 7f76caffd700 1 -- 172.21.15.92:0/2259657329 learned_addr learned my addr 172.21.15.92:0/2259657329 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:27:57.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.483+0000 7f76caffd700 1 -- 172.21.15.92:0/2259657329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc009a20 con 0x7f76cc09fd80 2023-09-29T23:27:57.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.483+0000 7f76caffd700 1 --2- 172.21.15.92:0/2259657329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76cc09fd80 0x7f76cc119fa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0099f0 tx=0x7f76bc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:57.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.483+0000 7f76b2ffd700 1 -- 172.21.15.92:0/2259657329 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76bc027470 con 0x7f76cc09fd80 2023-09-29T23:27:57.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.483+0000 7f76b2ffd700 1 -- 172.21.15.92:0/2259657329 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc0275d0 con 0x7f76cc09fd80 2023-09-29T23:27:57.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.483+0000 7f76d161c700 1 -- 172.21.15.92:0/2259657329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76cc11ba50 con 0x7f76cc09fd80 2023-09-29T23:27:57.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.483+0000 7f76b2ffd700 1 -- 172.21.15.92:0/2259657329 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76bc0278c0 con 0x7f76cc09fd80 2023-09-29T23:27:57.486 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.483+0000 7f76d161c700 1 -- 172.21.15.92:0/2259657329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76cc11d460 con 0x7f76cc09fd80 2023-09-29T23:27:57.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.484+0000 7f76b2ffd700 1 -- 172.21.15.92:0/2259657329 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f76bc024070 con 0x7f76cc09fd80 2023-09-29T23:27:57.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.484+0000 7f76b2ffd700 1 --2- 172.21.15.92:0/2259657329 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f76b8035640 0x7f76b8037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:27:57.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.484+0000 7f76b2ffd700 1 -- 172.21.15.92:0/2259657329 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f76bc049cc0 con 0x7f76cc09fd80 2023-09-29T23:27:57.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.484+0000 7f76ca7fc700 1 --2- 172.21.15.92:0/2259657329 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f76b8035640 0x7f76b8037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:27:57.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.484+0000 7f76d161c700 1 -- 172.21.15.92:0/2259657329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76cc05f230 con 0x7f76cc09fd80 2023-09-29T23:27:57.487 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.484+0000 7f76ca7fc700 1 --2- 172.21.15.92:0/2259657329 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f76b8035640 0x7f76b8037af0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f76c00016a0 tx=0x7f76c0007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:27:57.489 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.489+0000 7f76b2ffd700 1 -- 172.21.15.92:0/2259657329 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76bc027a20 con 0x7f76cc09fd80 2023-09-29T23:27:57.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.713+0000 7f76d161c700 1 -- 172.21.15.92:0/2259657329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f76cc04bb40 con 0x7f76cc09fd80 2023-09-29T23:27:57.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.713+0000 7f76b2ffd700 1 -- 172.21.15.92:0/2259657329 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f76bc01cba0 con 0x7f76cc09fd80 2023-09-29T23:27:57.714 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:27:57.714 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:27:57.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.715+0000 7f76d161c700 1 -- 172.21.15.92:0/2259657329 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f76b8035640 msgr2=0x7f76b8037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:57.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.715+0000 7f76d161c700 1 --2- 172.21.15.92:0/2259657329 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f76b8035640 0x7f76b8037af0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f76c00016a0 tx=0x7f76c0007b30 comp rx=0 tx=0).stop 2023-09-29T23:27:57.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.715+0000 7f76d161c700 1 -- 172.21.15.92:0/2259657329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76cc09fd80 msgr2=0x7f76cc119fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:27:57.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.715+0000 7f76d161c700 1 --2- 172.21.15.92:0/2259657329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76cc09fd80 0x7f76cc119fa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0099f0 tx=0x7f76bc018000 comp rx=0 tx=0).stop 2023-09-29T23:27:57.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.715+0000 7f76d161c700 1 -- 172.21.15.92:0/2259657329 shutdown_connections 2023-09-29T23:27:57.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.715+0000 7f76d161c700 1 --2- 172.21.15.92:0/2259657329 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f76b8035640 0x7f76b8037af0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:57.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.715+0000 7f76d161c700 1 --2- 172.21.15.92:0/2259657329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76cc09fd80 0x7f76cc119fa0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:27:57.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.715+0000 7f76d161c700 1 -- 172.21.15.92:0/2259657329 >> 172.21.15.92:0/2259657329 conn(0x7f76cc068000 msgr2=0x7f76cc094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:27:57.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.715+0000 7f76d161c700 1 -- 172.21.15.92:0/2259657329 shutdown_connections 2023-09-29T23:27:57.716 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:27:57.715+0000 7f76d161c700 1 -- 172.21.15.92:0/2259657329 wait complete. 2023-09-29T23:28:00.728 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:28:00.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.849+0000 7f8bdfcac700 1 Processor -- start 2023-09-29T23:28:00.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.849+0000 7f8bdfcac700 1 -- start start 2023-09-29T23:28:00.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.850+0000 7f8bdfcac700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8bd806a040 0x7f8bd8134540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:00.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.850+0000 7f8bdfcac700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd80a1580 con 0x7f8bd806f210 2023-09-29T23:28:00.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.850+0000 7f8bdfcac700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd806f5e0 con 0x7f8bd806a040 2023-09-29T23:28:00.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.850+0000 7f8bdd247700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8bd806a040 0x7f8bd8134540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:00.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.850+0000 7f8bdda48700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f8bd806f210 0x7f8bd8069930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:52076/0 (socket says 172.21.15.92:52076) 2023-09-29T23:28:00.851 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.850+0000 7f8bdd247700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8bd806a040 0x7f8bd8134540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43930/0 (socket says 172.21.15.92:43930) 2023-09-29T23:28:00.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.850+0000 7f8bdda48700 1 -- 172.21.15.92:0/2344443820 learned_addr learned my addr 172.21.15.92:0/2344443820 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:00.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.850+0000 7f8bdd247700 1 -- 172.21.15.92:0/2344443820 >> v1:172.21.15.92:6789/0 conn(0x7f8bd806f210 legacy=0x7f8bd8069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:00.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.850+0000 7f8bdca46700 1 -- 172.21.15.92:0/2344443820 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1612239555 0 0) 0x7f8bd80a1580 con 0x7f8bd806f210 2023-09-29T23:28:00.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.850+0000 7f8bdd247700 1 -- 172.21.15.92:0/2344443820 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd809cc70 con 0x7f8bd806a040 2023-09-29T23:28:00.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.850+0000 7f8bdd247700 1 --2- 172.21.15.92:0/2344443820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bd806a040 0x7f8bd8134540 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009860 tx=0x7f8bc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca9e7599a830ecb server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:00.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.850+0000 7f8bdca46700 1 -- 172.21.15.92:0/2344443820 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8bc800b680 con 0x7f8bd806a040 2023-09-29T23:28:00.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.850+0000 7f8bdca46700 1 -- 172.21.15.92:0/2344443820 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc800b7e0 con 0x7f8bd806a040 2023-09-29T23:28:00.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.850+0000 7f8bdca46700 1 -- 172.21.15.92:0/2344443820 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8bc800bad0 con 0x7f8bd806a040 2023-09-29T23:28:00.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.851+0000 7f8bdfcac700 1 -- 172.21.15.92:0/2344443820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bd806a040 msgr2=0x7f8bd8134540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:00.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.851+0000 7f8bdfcac700 1 --2- 172.21.15.92:0/2344443820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bd806a040 0x7f8bd8134540 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009860 tx=0x7f8bc80091a0 comp rx=0 tx=0).stop 2023-09-29T23:28:00.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.851+0000 7f8bdfcac700 1 -- 172.21.15.92:0/2344443820 shutdown_connections 2023-09-29T23:28:00.852 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.851+0000 7f8bdfcac700 1 --2- 172.21.15.92:0/2344443820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bd806a040 0x7f8bd8134540 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:00.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.851+0000 7f8bdfcac700 1 -- 172.21.15.92:0/2344443820 >> 172.21.15.92:0/2344443820 conn(0x7f8bd8094a70 msgr2=0x7f8bd806eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:00.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.851+0000 7f8bdfcac700 1 -- 172.21.15.92:0/2344443820 shutdown_connections 2023-09-29T23:28:00.853 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.851+0000 7f8bdfcac700 1 -- 172.21.15.92:0/2344443820 wait complete. 2023-09-29T23:28:00.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.852+0000 7f8bdfcac700 1 Processor -- start 2023-09-29T23:28:00.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.852+0000 7f8bdfcac700 1 -- start start 2023-09-29T23:28:00.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.852+0000 7f8bdfcac700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bd806a040 0x7f8bd811dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:00.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.852+0000 7f8bdfcac700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd811a6a0 con 0x7f8bd806a040 2023-09-29T23:28:00.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.852+0000 7f8bdda48700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bd806a040 0x7f8bd811dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:00.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.852+0000 7f8bdda48700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bd806a040 0x7f8bd811dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43942/0 (socket says 172.21.15.92:43942) 2023-09-29T23:28:00.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.852+0000 7f8bdda48700 1 -- 172.21.15.92:0/860668444 learned_addr learned my addr 172.21.15.92:0/860668444 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:00.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.852+0000 7f8bdda48700 1 -- 172.21.15.92:0/860668444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc8009420 con 0x7f8bd806a040 2023-09-29T23:28:00.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.853+0000 7f8bdda48700 1 --2- 172.21.15.92:0/860668444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bd806a040 0x7f8bd811dfb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400c710 tx=0x7f8bd4007c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:00.855 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.853+0000 7f8bcdffb700 1 -- 172.21.15.92:0/860668444 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8bd4007320 con 0x7f8bd806a040 2023-09-29T23:28:00.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.853+0000 7f8bcdffb700 1 -- 172.21.15.92:0/860668444 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd40074a0 con 0x7f8bd806a040 2023-09-29T23:28:00.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.853+0000 7f8bdfcac700 1 -- 172.21.15.92:0/860668444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd811e700 con 0x7f8bd806a040 2023-09-29T23:28:00.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.853+0000 7f8bcdffb700 1 -- 172.21.15.92:0/860668444 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8bd40057f0 con 0x7f8bd806a040 2023-09-29T23:28:00.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.853+0000 7f8bdfcac700 1 -- 172.21.15.92:0/860668444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd811a940 con 0x7f8bd806a040 2023-09-29T23:28:00.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.853+0000 7f8bcdffb700 1 -- 172.21.15.92:0/860668444 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f8bd4005a20 con 0x7f8bd806a040 2023-09-29T23:28:00.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.854+0000 7f8bcdffb700 1 --2- 172.21.15.92:0/860668444 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8bbc035630 0x7f8bbc037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:00.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.854+0000 7f8bcdffb700 1 -- 172.21.15.92:0/860668444 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f8bd4001e40 con 0x7f8bd806a040 2023-09-29T23:28:00.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.854+0000 7f8bdd247700 1 --2- 172.21.15.92:0/860668444 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8bbc035630 0x7f8bbc037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:00.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.854+0000 7f8bdfcac700 1 -- 172.21.15.92:0/860668444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd805f230 con 0x7f8bd806a040 2023-09-29T23:28:00.856 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.854+0000 7f8bdd247700 1 --2- 172.21.15.92:0/860668444 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8bbc035630 0x7f8bbc037ae0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8006eb0 tx=0x7f8bc8016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:00.858 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:00.858+0000 7f8bcdffb700 1 -- 172.21.15.92:0/860668444 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8bd40102c0 con 0x7f8bd806a040 2023-09-29T23:28:01.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:01.078+0000 7f8bdfcac700 1 -- 172.21.15.92:0/860668444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8bd809bdd0 con 0x7f8bd806a040 2023-09-29T23:28:01.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:01.078+0000 7f8bcdffb700 1 -- 172.21.15.92:0/860668444 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f8bd401bb30 con 0x7f8bd806a040 2023-09-29T23:28:01.079 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:01.079 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:28:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:01.080+0000 7f8bdfcac700 1 -- 172.21.15.92:0/860668444 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8bbc035630 msgr2=0x7f8bbc037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:01.080+0000 7f8bdfcac700 1 --2- 172.21.15.92:0/860668444 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8bbc035630 0x7f8bbc037ae0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8006eb0 tx=0x7f8bc8016000 comp rx=0 tx=0).stop 2023-09-29T23:28:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:01.081+0000 7f8bdfcac700 1 -- 172.21.15.92:0/860668444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bd806a040 msgr2=0x7f8bd811dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:01.081+0000 7f8bdfcac700 1 --2- 172.21.15.92:0/860668444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bd806a040 0x7f8bd811dfb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400c710 tx=0x7f8bd4007c20 comp rx=0 tx=0).stop 2023-09-29T23:28:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:01.081+0000 7f8bdfcac700 1 -- 172.21.15.92:0/860668444 shutdown_connections 2023-09-29T23:28:01.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:01.081+0000 7f8bdfcac700 1 --2- 172.21.15.92:0/860668444 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8bbc035630 0x7f8bbc037ae0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:01.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:01.081+0000 7f8bdfcac700 1 --2- 172.21.15.92:0/860668444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bd806a040 0x7f8bd811dfb0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:01.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:01.081+0000 7f8bdfcac700 1 -- 172.21.15.92:0/860668444 >> 172.21.15.92:0/860668444 conn(0x7f8bd8094a70 msgr2=0x7f8bd812ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:01.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:01.081+0000 7f8bdfcac700 1 -- 172.21.15.92:0/860668444 shutdown_connections 2023-09-29T23:28:01.082 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:01.081+0000 7f8bdfcac700 1 -- 172.21.15.92:0/860668444 wait complete. 2023-09-29T23:28:04.093 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:28:04.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.215+0000 7f04ceee9700 1 Processor -- start 2023-09-29T23:28:04.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.215+0000 7f04ceee9700 1 -- start start 2023-09-29T23:28:04.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.216+0000 7f04ceee9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f04c806f210 0x7f04c8069930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:04.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.216+0000 7f04ceee9700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c80a1580 con 0x7f04c8069e70 2023-09-29T23:28:04.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.216+0000 7f04ceee9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c806f5e0 con 0x7f04c806f210 2023-09-29T23:28:04.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.216+0000 7f04ccc85700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f04c806f210 0x7f04c8069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:04.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.216+0000 7f04c7fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f04c8069e70 0x7f04c812f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:52080/0 (socket says 172.21.15.92:52080) 2023-09-29T23:28:04.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.216+0000 7f04c7fff700 1 -- 172.21.15.92:0/49235067 learned_addr learned my addr 172.21.15.92:0/49235067 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:04.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.216+0000 7f04ccc85700 1 -- 172.21.15.92:0/49235067 >> v1:172.21.15.92:6789/0 conn(0x7f04c8069e70 legacy=0x7f04c812f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:04.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.216+0000 7f04ccc85700 1 -- 172.21.15.92:0/49235067 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c809cc70 con 0x7f04c806f210 2023-09-29T23:28:04.217 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.216+0000 7f04c77fe700 1 -- 172.21.15.92:0/49235067 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514578592 0 0) 0x7f04c80a1580 con 0x7f04c8069e70 2023-09-29T23:28:04.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.216+0000 7f04ccc85700 1 --2- 172.21.15.92:0/49235067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04c806f210 0x7f04c8069930 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009850 tx=0x7f04b0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9842bf05ab0db176 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:04.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.216+0000 7f04c77fe700 1 -- 172.21.15.92:0/49235067 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04b0005d50 con 0x7f04c806f210 2023-09-29T23:28:04.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.216+0000 7f04c77fe700 1 -- 172.21.15.92:0/49235067 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b0006030 con 0x7f04c806f210 2023-09-29T23:28:04.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.216+0000 7f04c77fe700 1 -- 172.21.15.92:0/49235067 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04b0006300 con 0x7f04c806f210 2023-09-29T23:28:04.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.217+0000 7f04ceee9700 1 -- 172.21.15.92:0/49235067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04c806f210 msgr2=0x7f04c8069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:04.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.217+0000 7f04ceee9700 1 --2- 172.21.15.92:0/49235067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04c806f210 0x7f04c8069930 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009850 tx=0x7f04b0009120 comp rx=0 tx=0).stop 2023-09-29T23:28:04.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.217+0000 7f04ceee9700 1 -- 172.21.15.92:0/49235067 shutdown_connections 2023-09-29T23:28:04.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.217+0000 7f04ceee9700 1 --2- 172.21.15.92:0/49235067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04c806f210 0x7f04c8069930 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:04.220 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.217+0000 7f04ceee9700 1 -- 172.21.15.92:0/49235067 >> 172.21.15.92:0/49235067 conn(0x7f04c8094a70 msgr2=0x7f04c806eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:04.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.217+0000 7f04ceee9700 1 -- 172.21.15.92:0/49235067 shutdown_connections 2023-09-29T23:28:04.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.217+0000 7f04ceee9700 1 -- 172.21.15.92:0/49235067 wait complete. 2023-09-29T23:28:04.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.218+0000 7f04ceee9700 1 Processor -- start 2023-09-29T23:28:04.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.218+0000 7f04ceee9700 1 -- start start 2023-09-29T23:28:04.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.218+0000 7f04ceee9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04c8069e70 0x7f04c811bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:04.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.218+0000 7f04ceee9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c812cec0 con 0x7f04c8069e70 2023-09-29T23:28:04.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.218+0000 7f04ccc85700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04c8069e70 0x7f04c811bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:04.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.218+0000 7f04ccc85700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04c8069e70 0x7f04c811bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43970/0 (socket says 172.21.15.92:43970) 2023-09-29T23:28:04.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.218+0000 7f04ccc85700 1 -- 172.21.15.92:0/327745528 learned_addr learned my addr 172.21.15.92:0/327745528 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:04.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.219+0000 7f04ccc85700 1 -- 172.21.15.92:0/327745528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b00093c0 con 0x7f04c8069e70 2023-09-29T23:28:04.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.219+0000 7f04ccc85700 1 --2- 172.21.15.92:0/327745528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04c8069e70 0x7f04c811bf50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f04b0000c00 tx=0x7f04b0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:04.221 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.219+0000 7f04c4ff9700 1 -- 172.21.15.92:0/327745528 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04b000bb20 con 0x7f04c8069e70 2023-09-29T23:28:04.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.219+0000 7f04c4ff9700 1 -- 172.21.15.92:0/327745528 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b000bc80 con 0x7f04c8069e70 2023-09-29T23:28:04.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.219+0000 7f04ceee9700 1 -- 172.21.15.92:0/327745528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c8118740 con 0x7f04c8069e70 2023-09-29T23:28:04.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.219+0000 7f04c4ff9700 1 -- 172.21.15.92:0/327745528 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f04b001c430 con 0x7f04c8069e70 2023-09-29T23:28:04.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.219+0000 7f04ceee9700 1 -- 172.21.15.92:0/327745528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c811c630 con 0x7f04c8069e70 2023-09-29T23:28:04.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.220+0000 7f04c4ff9700 1 -- 172.21.15.92:0/327745528 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f04b0023070 con 0x7f04c8069e70 2023-09-29T23:28:04.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.220+0000 7f04ceee9700 1 -- 172.21.15.92:0/327745528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c806eda0 con 0x7f04c8069e70 2023-09-29T23:28:04.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.220+0000 7f04c4ff9700 1 --2- 172.21.15.92:0/327745528 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f04a8035630 0x7f04a8037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:04.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.220+0000 7f04c4ff9700 1 -- 172.21.15.92:0/327745528 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f04b00495b0 con 0x7f04c8069e70 2023-09-29T23:28:04.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.220+0000 7f04c7fff700 1 --2- 172.21.15.92:0/327745528 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f04a8035630 0x7f04a8037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:04.222 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.220+0000 7f04c7fff700 1 --2- 172.21.15.92:0/327745528 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f04a8035630 0x7f04a8037ae0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f04b8007fd0 tx=0x7f04b8007bb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:04.224 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.224+0000 7f04c4ff9700 1 -- 172.21.15.92:0/327745528 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04b001c590 con 0x7f04c8069e70 2023-09-29T23:28:04.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.448+0000 7f04ceee9700 1 -- 172.21.15.92:0/327745528 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f04c812eb10 con 0x7f04c8069e70 2023-09-29T23:28:04.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.448+0000 7f04c4ff9700 1 -- 172.21.15.92:0/327745528 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f04b001b3b0 con 0x7f04c8069e70 2023-09-29T23:28:04.449 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:04.449 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:28:04.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.450+0000 7f04ceee9700 1 -- 172.21.15.92:0/327745528 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f04a8035630 msgr2=0x7f04a8037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:04.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.450+0000 7f04ceee9700 1 --2- 172.21.15.92:0/327745528 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f04a8035630 0x7f04a8037ae0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f04b8007fd0 tx=0x7f04b8007bb0 comp rx=0 tx=0).stop 2023-09-29T23:28:04.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.450+0000 7f04ceee9700 1 -- 172.21.15.92:0/327745528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04c8069e70 msgr2=0x7f04c811bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:04.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.450+0000 7f04ceee9700 1 --2- 172.21.15.92:0/327745528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04c8069e70 0x7f04c811bf50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f04b0000c00 tx=0x7f04b0015000 comp rx=0 tx=0).stop 2023-09-29T23:28:04.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.451+0000 7f04ceee9700 1 -- 172.21.15.92:0/327745528 shutdown_connections 2023-09-29T23:28:04.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.451+0000 7f04ceee9700 1 --2- 172.21.15.92:0/327745528 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f04a8035630 0x7f04a8037ae0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:04.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.451+0000 7f04ceee9700 1 --2- 172.21.15.92:0/327745528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04c8069e70 0x7f04c811bf50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:04.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.451+0000 7f04ceee9700 1 -- 172.21.15.92:0/327745528 >> 172.21.15.92:0/327745528 conn(0x7f04c8094a70 msgr2=0x7f04c806ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:04.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.451+0000 7f04ceee9700 1 -- 172.21.15.92:0/327745528 shutdown_connections 2023-09-29T23:28:04.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:04.451+0000 7f04ceee9700 1 -- 172.21.15.92:0/327745528 wait complete. 2023-09-29T23:28:07.463 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:28:07.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.586+0000 7f4263fff700 1 Processor -- start 2023-09-29T23:28:07.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.586+0000 7f4263fff700 1 -- start start 2023-09-29T23:28:07.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.587+0000 7f4263fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f426409c600 0x7f42640a3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:07.588 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.587+0000 7f4263fff700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4264098320 con 0x7f426412bc80 2023-09-29T23:28:07.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.587+0000 7f4263fff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f426409c9d0 con 0x7f426409c600 2023-09-29T23:28:07.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.587+0000 7f4262ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f426409c600 0x7f42640a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:07.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.587+0000 7f42627fc700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f426412bc80 0x7f426412f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:52094/0 (socket says 172.21.15.92:52094) 2023-09-29T23:28:07.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.587+0000 7f42627fc700 1 -- 172.21.15.92:0/736760058 learned_addr learned my addr 172.21.15.92:0/736760058 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:07.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.587+0000 7f4262ffd700 1 -- 172.21.15.92:0/736760058 >> v1:172.21.15.92:6789/0 conn(0x7f426412bc80 legacy=0x7f426412f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:07.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.587+0000 7f4262ffd700 1 -- 172.21.15.92:0/736760058 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426412c620 con 0x7f426409c600 2023-09-29T23:28:07.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.587+0000 7f4262ffd700 1 --2- 172.21.15.92:0/736760058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f426409c600 0x7f42640a3030 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f425c009de0 tx=0x7f425c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2d9d969ad7aa89 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:07.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.587+0000 7f4261ffb700 1 -- 172.21.15.92:0/736760058 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f425c00e070 con 0x7f426409c600 2023-09-29T23:28:07.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.587+0000 7f4261ffb700 1 -- 172.21.15.92:0/736760058 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c00bdc0 con 0x7f426409c600 2023-09-29T23:28:07.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.587+0000 7f4261ffb700 1 -- 172.21.15.92:0/736760058 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f425c0125b0 con 0x7f426409c600 2023-09-29T23:28:07.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.588+0000 7f4263fff700 1 -- 172.21.15.92:0/736760058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f426409c600 msgr2=0x7f42640a3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:07.589 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.588+0000 7f4263fff700 1 --2- 172.21.15.92:0/736760058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f426409c600 0x7f42640a3030 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f425c009de0 tx=0x7f425c009780 comp rx=0 tx=0).stop 2023-09-29T23:28:07.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.588+0000 7f4263fff700 1 -- 172.21.15.92:0/736760058 shutdown_connections 2023-09-29T23:28:07.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.588+0000 7f4263fff700 1 --2- 172.21.15.92:0/736760058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f426409c600 0x7f42640a3030 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:07.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.588+0000 7f4263fff700 1 -- 172.21.15.92:0/736760058 >> 172.21.15.92:0/736760058 conn(0x7f4264068080 msgr2=0x7f4264096a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:07.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.588+0000 7f4263fff700 1 -- 172.21.15.92:0/736760058 shutdown_connections 2023-09-29T23:28:07.590 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.588+0000 7f4263fff700 1 -- 172.21.15.92:0/736760058 wait complete. 2023-09-29T23:28:07.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.589+0000 7f4263fff700 1 Processor -- start 2023-09-29T23:28:07.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.589+0000 7f4263fff700 1 -- start start 2023-09-29T23:28:07.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.589+0000 7f4263fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f426409c600 0x7f42641198e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:07.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.589+0000 7f4263fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426411ac60 con 0x7f426409c600 2023-09-29T23:28:07.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.589+0000 7f4262ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f426409c600 0x7f42641198e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:07.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.589+0000 7f4262ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f426409c600 0x7f42641198e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43996/0 (socket says 172.21.15.92:43996) 2023-09-29T23:28:07.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.589+0000 7f4262ffd700 1 -- 172.21.15.92:0/917076157 learned_addr learned my addr 172.21.15.92:0/917076157 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:07.592 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.589+0000 7f4262ffd700 1 -- 172.21.15.92:0/917076157 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425c009a20 con 0x7f426409c600 2023-09-29T23:28:07.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.590+0000 7f4262ffd700 1 --2- 172.21.15.92:0/917076157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f426409c600 0x7f42641198e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f425c0099f0 tx=0x7f425c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:07.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.590+0000 7f425affd700 1 -- 172.21.15.92:0/917076157 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f425c01e430 con 0x7f426409c600 2023-09-29T23:28:07.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.590+0000 7f425affd700 1 -- 172.21.15.92:0/917076157 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c01e590 con 0x7f426409c600 2023-09-29T23:28:07.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.590+0000 7f4263fff700 1 -- 172.21.15.92:0/917076157 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426411c600 con 0x7f426409c600 2023-09-29T23:28:07.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.590+0000 7f425affd700 1 -- 172.21.15.92:0/917076157 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f425c01e740 con 0x7f426409c600 2023-09-29T23:28:07.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.590+0000 7f4263fff700 1 -- 172.21.15.92:0/917076157 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426411d4a0 con 0x7f426409c600 2023-09-29T23:28:07.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.590+0000 7f425affd700 1 -- 172.21.15.92:0/917076157 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f425c01e8a0 con 0x7f426409c600 2023-09-29T23:28:07.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.591+0000 7f425affd700 1 --2- 172.21.15.92:0/917076157 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4244035640 0x7f4244037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:07.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.591+0000 7f4263fff700 1 -- 172.21.15.92:0/917076157 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4264068b80 con 0x7f426409c600 2023-09-29T23:28:07.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.591+0000 7f425affd700 1 -- 172.21.15.92:0/917076157 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f425c049ac0 con 0x7f426409c600 2023-09-29T23:28:07.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.591+0000 7f42627fc700 1 --2- 172.21.15.92:0/917076157 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4244035640 0x7f4244037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:07.593 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.591+0000 7f42627fc700 1 --2- 172.21.15.92:0/917076157 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4244035640 0x7f4244037af0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f424c007fd0 tx=0x7f424c007b90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:07.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.595+0000 7f425affd700 1 -- 172.21.15.92:0/917076157 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f425c01ad80 con 0x7f426409c600 2023-09-29T23:28:07.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.818+0000 7f4263fff700 1 -- 172.21.15.92:0/917076157 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f426405f230 con 0x7f426409c600 2023-09-29T23:28:07.819 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.819+0000 7f425affd700 1 -- 172.21.15.92:0/917076157 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f425c01aba0 con 0x7f426409c600 2023-09-29T23:28:07.820 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:07.820 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:28:07.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.821+0000 7f4263fff700 1 -- 172.21.15.92:0/917076157 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4244035640 msgr2=0x7f4244037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:07.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.821+0000 7f4263fff700 1 --2- 172.21.15.92:0/917076157 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4244035640 0x7f4244037af0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f424c007fd0 tx=0x7f424c007b90 comp rx=0 tx=0).stop 2023-09-29T23:28:07.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.821+0000 7f4263fff700 1 -- 172.21.15.92:0/917076157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f426409c600 msgr2=0x7f42641198e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:07.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.821+0000 7f4263fff700 1 --2- 172.21.15.92:0/917076157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f426409c600 0x7f42641198e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f425c0099f0 tx=0x7f425c018000 comp rx=0 tx=0).stop 2023-09-29T23:28:07.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.821+0000 7f4263fff700 1 -- 172.21.15.92:0/917076157 shutdown_connections 2023-09-29T23:28:07.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.821+0000 7f4263fff700 1 --2- 172.21.15.92:0/917076157 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4244035640 0x7f4244037af0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:07.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.821+0000 7f4263fff700 1 --2- 172.21.15.92:0/917076157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f426409c600 0x7f42641198e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:07.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.821+0000 7f4263fff700 1 -- 172.21.15.92:0/917076157 >> 172.21.15.92:0/917076157 conn(0x7f4264068080 msgr2=0x7f4264096340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:07.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.821+0000 7f4263fff700 1 -- 172.21.15.92:0/917076157 shutdown_connections 2023-09-29T23:28:07.823 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:07.821+0000 7f4263fff700 1 -- 172.21.15.92:0/917076157 wait complete. 2023-09-29T23:28:10.834 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:28:10.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.956+0000 7f4ff1a7e700 1 Processor -- start 2023-09-29T23:28:10.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.956+0000 7f4ff1a7e700 1 -- start start 2023-09-29T23:28:10.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.956+0000 7f4ff1a7e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4fec06f100 0x7f4fec0974a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:10.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.956+0000 7f4ff1a7e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fec0a0e20 con 0x7f4fec0979e0 2023-09-29T23:28:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.956+0000 7f4ff1a7e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fec06f4d0 con 0x7f4fec06f100 2023-09-29T23:28:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.957+0000 7f4ff0a7c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4fec06f100 0x7f4fec0974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.957+0000 7f4febfff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f4fec0979e0 0x7f4fec12ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54258/0 (socket says 172.21.15.92:54258) 2023-09-29T23:28:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.957+0000 7f4ff0a7c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4fec06f100 0x7f4fec0974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40922/0 (socket says 172.21.15.92:40922) 2023-09-29T23:28:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.957+0000 7f4febfff700 1 -- 172.21.15.92:0/2753816920 learned_addr learned my addr 172.21.15.92:0/2753816920 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.957+0000 7f4ff0a7c700 1 -- 172.21.15.92:0/2753816920 >> v1:172.21.15.92:6789/0 conn(0x7f4fec0979e0 legacy=0x7f4fec12ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.957+0000 7f4ff0a7c700 1 -- 172.21.15.92:0/2753816920 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec098570 con 0x7f4fec06f100 2023-09-29T23:28:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.957+0000 7f4ff0a7c700 1 --2- 172.21.15.92:0/2753816920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fec06f100 0x7f4fec0974a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009890 tx=0x7f4fe00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa185f35a3fc3a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.957+0000 7f4feb7fe700 1 -- 172.21.15.92:0/2753816920 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4fe000b670 con 0x7f4fec06f100 2023-09-29T23:28:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.957+0000 7f4feb7fe700 1 -- 172.21.15.92:0/2753816920 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe000b7d0 con 0x7f4fec06f100 2023-09-29T23:28:10.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.957+0000 7f4feb7fe700 1 -- 172.21.15.92:0/2753816920 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4fe000bac0 con 0x7f4fec06f100 2023-09-29T23:28:10.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.958+0000 7f4ff1a7e700 1 -- 172.21.15.92:0/2753816920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fec06f100 msgr2=0x7f4fec0974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:10.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.958+0000 7f4ff1a7e700 1 --2- 172.21.15.92:0/2753816920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fec06f100 0x7f4fec0974a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009890 tx=0x7f4fe00091a0 comp rx=0 tx=0).stop 2023-09-29T23:28:10.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.958+0000 7f4ff1a7e700 1 -- 172.21.15.92:0/2753816920 shutdown_connections 2023-09-29T23:28:10.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.958+0000 7f4ff1a7e700 1 --2- 172.21.15.92:0/2753816920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fec06f100 0x7f4fec0974a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:10.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.958+0000 7f4ff1a7e700 1 -- 172.21.15.92:0/2753816920 >> 172.21.15.92:0/2753816920 conn(0x7f4fec094a70 msgr2=0x7f4fec06e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:10.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.958+0000 7f4ff1a7e700 1 -- 172.21.15.92:0/2753816920 shutdown_connections 2023-09-29T23:28:10.960 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.958+0000 7f4ff1a7e700 1 -- 172.21.15.92:0/2753816920 wait complete. 2023-09-29T23:28:10.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.958+0000 7f4ff1a7e700 1 Processor -- start 2023-09-29T23:28:10.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.959+0000 7f4ff1a7e700 1 -- start start 2023-09-29T23:28:10.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.959+0000 7f4ff1a7e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fec06f100 0x7f4fec09f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:10.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.959+0000 7f4ff1a7e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec116cd0 con 0x7f4fec06f100 2023-09-29T23:28:10.962 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.959+0000 7f4ff0a7c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fec06f100 0x7f4fec09f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:10.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.959+0000 7f4ff0a7c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fec06f100 0x7f4fec09f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40934/0 (socket says 172.21.15.92:40934) 2023-09-29T23:28:10.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.959+0000 7f4ff0a7c700 1 -- 172.21.15.92:0/448795955 learned_addr learned my addr 172.21.15.92:0/448795955 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:10.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.959+0000 7f4ff0a7c700 1 -- 172.21.15.92:0/448795955 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe0009420 con 0x7f4fec06f100 2023-09-29T23:28:10.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.960+0000 7f4ff0a7c700 1 --2- 172.21.15.92:0/448795955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fec06f100 0x7f4fec09f990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0000c00 tx=0x7f4fe0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:10.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.960+0000 7f4fe8ff9700 1 -- 172.21.15.92:0/448795955 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4fe0011cb0 con 0x7f4fec06f100 2023-09-29T23:28:10.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.960+0000 7f4fe8ff9700 1 -- 172.21.15.92:0/448795955 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe001f070 con 0x7f4fec06f100 2023-09-29T23:28:10.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.960+0000 7f4ff1a7e700 1 -- 172.21.15.92:0/448795955 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fec1179e0 con 0x7f4fec06f100 2023-09-29T23:28:10.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.960+0000 7f4fe8ff9700 1 -- 172.21.15.92:0/448795955 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4fe001a440 con 0x7f4fec06f100 2023-09-29T23:28:10.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.960+0000 7f4ff1a7e700 1 -- 172.21.15.92:0/448795955 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fec09f610 con 0x7f4fec06f100 2023-09-29T23:28:10.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.961+0000 7f4fe8ff9700 1 -- 172.21.15.92:0/448795955 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f4fe0021030 con 0x7f4fec06f100 2023-09-29T23:28:10.963 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.961+0000 7f4ff1a7e700 1 -- 172.21.15.92:0/448795955 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fec09f800 con 0x7f4fec06f100 2023-09-29T23:28:10.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.961+0000 7f4fe8ff9700 1 --2- 172.21.15.92:0/448795955 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4fd0035630 0x7f4fd0037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:10.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.961+0000 7f4fe8ff9700 1 -- 172.21.15.92:0/448795955 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f4fe0048f20 con 0x7f4fec06f100 2023-09-29T23:28:10.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.961+0000 7f4febfff700 1 --2- 172.21.15.92:0/448795955 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4fd0035630 0x7f4fd0037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:10.964 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.961+0000 7f4febfff700 1 --2- 172.21.15.92:0/448795955 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4fd0035630 0x7f4fd0037ae0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80016a0 tx=0x7f4fd8007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:10.965 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:10.965+0000 7f4fe8ff9700 1 -- 172.21.15.92:0/448795955 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fe001a5a0 con 0x7f4fec06f100 2023-09-29T23:28:11.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:11.188+0000 7f4ff1a7e700 1 -- 172.21.15.92:0/448795955 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4fec098ad0 con 0x7f4fec06f100 2023-09-29T23:28:11.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:11.188+0000 7f4fe8ff9700 1 -- 172.21.15.92:0/448795955 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f4fe0010380 con 0x7f4fec06f100 2023-09-29T23:28:11.189 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:11.189 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:28:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:11.191+0000 7f4ff1a7e700 1 -- 172.21.15.92:0/448795955 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4fd0035630 msgr2=0x7f4fd0037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:11.191+0000 7f4ff1a7e700 1 --2- 172.21.15.92:0/448795955 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4fd0035630 0x7f4fd0037ae0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80016a0 tx=0x7f4fd8007b30 comp rx=0 tx=0).stop 2023-09-29T23:28:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:11.191+0000 7f4ff1a7e700 1 -- 172.21.15.92:0/448795955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fec06f100 msgr2=0x7f4fec09f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:11.191+0000 7f4ff1a7e700 1 --2- 172.21.15.92:0/448795955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fec06f100 0x7f4fec09f990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0000c00 tx=0x7f4fe0016000 comp rx=0 tx=0).stop 2023-09-29T23:28:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:11.191+0000 7f4ff1a7e700 1 -- 172.21.15.92:0/448795955 shutdown_connections 2023-09-29T23:28:11.192 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:11.191+0000 7f4ff1a7e700 1 --2- 172.21.15.92:0/448795955 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4fd0035630 0x7f4fd0037ae0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:11.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:11.191+0000 7f4ff1a7e700 1 --2- 172.21.15.92:0/448795955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fec06f100 0x7f4fec09f990 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:11.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:11.191+0000 7f4ff1a7e700 1 -- 172.21.15.92:0/448795955 >> 172.21.15.92:0/448795955 conn(0x7f4fec094a70 msgr2=0x7f4fec06ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:11.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:11.191+0000 7f4ff1a7e700 1 -- 172.21.15.92:0/448795955 shutdown_connections 2023-09-29T23:28:11.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:11.191+0000 7f4ff1a7e700 1 -- 172.21.15.92:0/448795955 wait complete. 2023-09-29T23:28:14.203 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:28:14.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.324+0000 7f9f0b687700 1 Processor -- start 2023-09-29T23:28:14.324 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.324+0000 7f9f0b687700 1 -- start start 2023-09-29T23:28:14.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.324+0000 7f9f0b687700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9f0412fef0 0x7f9f04134630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:14.326 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.324+0000 7f9f0b687700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0412f2a0 con 0x7f9f040a3060 2023-09-29T23:28:14.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.324+0000 7f9f0b687700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f040a3430 con 0x7f9f0412fef0 2023-09-29T23:28:14.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.324+0000 7f9f08c22700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9f0412fef0 0x7f9f04134630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:14.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.324+0000 7f9f09423700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f9f040a3060 0x7f9f0412f7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54274/0 (socket says 172.21.15.92:54274) 2023-09-29T23:28:14.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.324+0000 7f9f09423700 1 -- 172.21.15.92:0/4195930439 learned_addr learned my addr 172.21.15.92:0/4195930439 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:14.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.325+0000 7f9f08c22700 1 -- 172.21.15.92:0/4195930439 >> v1:172.21.15.92:6789/0 conn(0x7f9f040a3060 legacy=0x7f9f0412f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:14.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.325+0000 7f9f08c22700 1 -- 172.21.15.92:0/4195930439 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f04099580 con 0x7f9f0412fef0 2023-09-29T23:28:14.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.325+0000 7f9f08c22700 1 --2- 172.21.15.92:0/4195930439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f0412fef0 0x7f9f04134630 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4009860 tx=0x7f9ef40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34193027f2f0b37 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:14.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.325+0000 7f9efbfff700 1 -- 172.21.15.92:0/4195930439 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ef400b680 con 0x7f9f0412fef0 2023-09-29T23:28:14.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.325+0000 7f9efbfff700 1 -- 172.21.15.92:0/4195930439 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef400b7e0 con 0x7f9f0412fef0 2023-09-29T23:28:14.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.325+0000 7f9efbfff700 1 -- 172.21.15.92:0/4195930439 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ef400bad0 con 0x7f9f0412fef0 2023-09-29T23:28:14.327 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.325+0000 7f9f0b687700 1 -- 172.21.15.92:0/4195930439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f0412fef0 msgr2=0x7f9f04134630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:14.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.325+0000 7f9f0b687700 1 --2- 172.21.15.92:0/4195930439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f0412fef0 0x7f9f04134630 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4009860 tx=0x7f9ef40091a0 comp rx=0 tx=0).stop 2023-09-29T23:28:14.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.325+0000 7f9f0b687700 1 -- 172.21.15.92:0/4195930439 shutdown_connections 2023-09-29T23:28:14.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.325+0000 7f9f0b687700 1 --2- 172.21.15.92:0/4195930439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f0412fef0 0x7f9f04134630 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:14.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.325+0000 7f9f0b687700 1 -- 172.21.15.92:0/4195930439 >> 172.21.15.92:0/4195930439 conn(0x7f9f04068040 msgr2=0x7f9f040a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:14.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.326+0000 7f9f0b687700 1 -- 172.21.15.92:0/4195930439 shutdown_connections 2023-09-29T23:28:14.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.326+0000 7f9f0b687700 1 -- 172.21.15.92:0/4195930439 wait complete. 2023-09-29T23:28:14.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.326+0000 7f9f0b687700 1 Processor -- start 2023-09-29T23:28:14.328 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.326+0000 7f9f0b687700 1 -- start start 2023-09-29T23:28:14.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.327+0000 7f9f0b687700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f040a3060 0x7f9f0411aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:14.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.327+0000 7f9f0b687700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0412cce0 con 0x7f9f040a3060 2023-09-29T23:28:14.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.327+0000 7f9f09423700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f040a3060 0x7f9f0411aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:14.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.327+0000 7f9f09423700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f040a3060 0x7f9f0411aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40952/0 (socket says 172.21.15.92:40952) 2023-09-29T23:28:14.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.327+0000 7f9f09423700 1 -- 172.21.15.92:0/2006742686 learned_addr learned my addr 172.21.15.92:0/2006742686 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:14.330 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.327+0000 7f9f09423700 1 -- 172.21.15.92:0/2006742686 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef4009420 con 0x7f9f040a3060 2023-09-29T23:28:14.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.327+0000 7f9f09423700 1 --2- 172.21.15.92:0/2006742686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f040a3060 0x7f9f0411aa90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000c6c0 tx=0x7f9f00007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:14.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.327+0000 7f9ef97fa700 1 -- 172.21.15.92:0/2006742686 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f00005b30 con 0x7f9f040a3060 2023-09-29T23:28:14.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.328+0000 7f9ef97fa700 1 -- 172.21.15.92:0/2006742686 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f00005c90 con 0x7f9f040a3060 2023-09-29T23:28:14.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.328+0000 7f9f0b687700 1 -- 172.21.15.92:0/2006742686 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0411cc00 con 0x7f9f040a3060 2023-09-29T23:28:14.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.328+0000 7f9ef97fa700 1 -- 172.21.15.92:0/2006742686 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f00004830 con 0x7f9f040a3060 2023-09-29T23:28:14.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.328+0000 7f9f0b687700 1 -- 172.21.15.92:0/2006742686 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0411db50 con 0x7f9f040a3060 2023-09-29T23:28:14.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.328+0000 7f9ef97fa700 1 -- 172.21.15.92:0/2006742686 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f9f00004a60 con 0x7f9f040a3060 2023-09-29T23:28:14.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.328+0000 7f9ef97fa700 1 --2- 172.21.15.92:0/2006742686 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9ee8035640 0x7f9ee8037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:14.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.328+0000 7f9ef97fa700 1 -- 172.21.15.92:0/2006742686 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f9f00046910 con 0x7f9f040a3060 2023-09-29T23:28:14.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.329+0000 7f9f08c22700 1 --2- 172.21.15.92:0/2006742686 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9ee8035640 0x7f9ee8037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:14.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.329+0000 7f9f0b687700 1 -- 172.21.15.92:0/2006742686 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0412f060 con 0x7f9f040a3060 2023-09-29T23:28:14.331 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.329+0000 7f9f08c22700 1 --2- 172.21.15.92:0/2006742686 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9ee8035640 0x7f9ee8037af0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4000c00 tx=0x7f9ef4016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:14.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.333+0000 7f9ef97fa700 1 -- 172.21.15.92:0/2006742686 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f000075f0 con 0x7f9f040a3060 2023-09-29T23:28:14.561 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.561+0000 7f9f0b687700 1 -- 172.21.15.92:0/2006742686 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9f0405f230 con 0x7f9f040a3060 2023-09-29T23:28:14.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.561+0000 7f9ef97fa700 1 -- 172.21.15.92:0/2006742686 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f9f0001b360 con 0x7f9f040a3060 2023-09-29T23:28:14.562 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:14.562 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:28:14.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.563+0000 7f9f0b687700 1 -- 172.21.15.92:0/2006742686 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9ee8035640 msgr2=0x7f9ee8037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:14.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.563+0000 7f9f0b687700 1 --2- 172.21.15.92:0/2006742686 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9ee8035640 0x7f9ee8037af0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4000c00 tx=0x7f9ef4016000 comp rx=0 tx=0).stop 2023-09-29T23:28:14.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.563+0000 7f9f0b687700 1 -- 172.21.15.92:0/2006742686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f040a3060 msgr2=0x7f9f0411aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:14.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.563+0000 7f9f0b687700 1 --2- 172.21.15.92:0/2006742686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f040a3060 0x7f9f0411aa90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000c6c0 tx=0x7f9f00007f70 comp rx=0 tx=0).stop 2023-09-29T23:28:14.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.563+0000 7f9f0b687700 1 -- 172.21.15.92:0/2006742686 shutdown_connections 2023-09-29T23:28:14.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.563+0000 7f9f0b687700 1 --2- 172.21.15.92:0/2006742686 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9ee8035640 0x7f9ee8037af0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:14.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.563+0000 7f9f0b687700 1 --2- 172.21.15.92:0/2006742686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f040a3060 0x7f9f0411aa90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:14.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.563+0000 7f9f0b687700 1 -- 172.21.15.92:0/2006742686 >> 172.21.15.92:0/2006742686 conn(0x7f9f04068040 msgr2=0x7f9f040a1850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:14.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.563+0000 7f9f0b687700 1 -- 172.21.15.92:0/2006742686 shutdown_connections 2023-09-29T23:28:14.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:14.563+0000 7f9f0b687700 1 -- 172.21.15.92:0/2006742686 wait complete. 2023-09-29T23:28:17.576 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:28:17.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.697+0000 7f656e486700 1 Processor -- start 2023-09-29T23:28:17.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.697+0000 7f656e486700 1 -- start start 2023-09-29T23:28:17.700 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.698+0000 7f656e486700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f656812ffc0 0x7f65680a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:17.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.698+0000 7f656e486700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6568098710 con 0x7f656809fd80 2023-09-29T23:28:17.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.698+0000 7f656e486700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f656812f340 con 0x7f656812ffc0 2023-09-29T23:28:17.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.698+0000 7f65677fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f656812ffc0 0x7f65680a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:17.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.698+0000 7f6567fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f656809fd80 0x7f656812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54276/0 (socket says 172.21.15.92:54276) 2023-09-29T23:28:17.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.698+0000 7f6567fff700 1 -- 172.21.15.92:0/968471333 learned_addr learned my addr 172.21.15.92:0/968471333 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:17.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.698+0000 7f6566ffd700 1 -- 172.21.15.92:0/968471333 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171768311 0 0) 0x7f6568098710 con 0x7f656809fd80 2023-09-29T23:28:17.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.698+0000 7f6566ffd700 1 -- 172.21.15.92:0/968471333 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6550003570 con 0x7f656809fd80 2023-09-29T23:28:17.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.698+0000 7f65677fe700 1 -- 172.21.15.92:0/968471333 >> v1:172.21.15.92:6789/0 conn(0x7f656809fd80 legacy=0x7f656812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:17.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.698+0000 7f65677fe700 1 -- 172.21.15.92:0/968471333 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65680997e0 con 0x7f656812ffc0 2023-09-29T23:28:17.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.698+0000 7f65677fe700 1 --2- 172.21.15.92:0/968471333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f656812ffc0 0x7f65680a3090 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f655c009860 tx=0x7f655c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac742d9e4cefc7c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:17.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.699+0000 7f6566ffd700 1 -- 172.21.15.92:0/968471333 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f655c011630 con 0x7f656812ffc0 2023-09-29T23:28:17.701 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.699+0000 7f6566ffd700 1 -- 172.21.15.92:0/968471333 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655c011790 con 0x7f656812ffc0 2023-09-29T23:28:17.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.699+0000 7f6566ffd700 1 -- 172.21.15.92:0/968471333 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f655c011920 con 0x7f656812ffc0 2023-09-29T23:28:17.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.699+0000 7f656e486700 1 -- 172.21.15.92:0/968471333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f656812ffc0 msgr2=0x7f65680a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:17.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.699+0000 7f656e486700 1 --2- 172.21.15.92:0/968471333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f656812ffc0 0x7f65680a3090 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f655c009860 tx=0x7f655c0091a0 comp rx=0 tx=0).stop 2023-09-29T23:28:17.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.699+0000 7f656e486700 1 -- 172.21.15.92:0/968471333 shutdown_connections 2023-09-29T23:28:17.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.699+0000 7f656e486700 1 --2- 172.21.15.92:0/968471333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f656812ffc0 0x7f65680a3090 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:17.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.699+0000 7f656e486700 1 -- 172.21.15.92:0/968471333 >> 172.21.15.92:0/968471333 conn(0x7f6568068000 msgr2=0x7f65680a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:17.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.699+0000 7f656e486700 1 -- 172.21.15.92:0/968471333 shutdown_connections 2023-09-29T23:28:17.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.699+0000 7f656e486700 1 -- 172.21.15.92:0/968471333 wait complete. 2023-09-29T23:28:17.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.700+0000 7f656e486700 1 Processor -- start 2023-09-29T23:28:17.702 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.700+0000 7f656e486700 1 -- start start 2023-09-29T23:28:17.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.700+0000 7f656e486700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f656809fd80 0x7f656813e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:17.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.700+0000 7f656e486700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656811e3b0 con 0x7f656809fd80 2023-09-29T23:28:17.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.701+0000 7f6567fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f656809fd80 0x7f656813e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:17.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.701+0000 7f6567fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f656809fd80 0x7f656813e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40976/0 (socket says 172.21.15.92:40976) 2023-09-29T23:28:17.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.701+0000 7f6567fff700 1 -- 172.21.15.92:0/3978241363 learned_addr learned my addr 172.21.15.92:0/3978241363 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:17.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.701+0000 7f6567fff700 1 -- 172.21.15.92:0/3978241363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c009420 con 0x7f656809fd80 2023-09-29T23:28:17.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.701+0000 7f6567fff700 1 --2- 172.21.15.92:0/3978241363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f656809fd80 0x7f656813e4f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f655800c490 tx=0x7f6558007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:17.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.701+0000 7f654ffff700 1 -- 172.21.15.92:0/3978241363 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6558005c70 con 0x7f656809fd80 2023-09-29T23:28:17.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.701+0000 7f654ffff700 1 -- 172.21.15.92:0/3978241363 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6558005dd0 con 0x7f656809fd80 2023-09-29T23:28:17.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.701+0000 7f656e486700 1 -- 172.21.15.92:0/3978241363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f656811c680 con 0x7f656809fd80 2023-09-29T23:28:17.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.701+0000 7f654ffff700 1 -- 172.21.15.92:0/3978241363 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6558007250 con 0x7f656809fd80 2023-09-29T23:28:17.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.701+0000 7f656e486700 1 -- 172.21.15.92:0/3978241363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f656811d2b0 con 0x7f656809fd80 2023-09-29T23:28:17.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.702+0000 7f654ffff700 1 -- 172.21.15.92:0/3978241363 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f65580073b0 con 0x7f656809fd80 2023-09-29T23:28:17.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.702+0000 7f656e486700 1 -- 172.21.15.92:0/3978241363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65680a1a10 con 0x7f656809fd80 2023-09-29T23:28:17.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.702+0000 7f654ffff700 1 --2- 172.21.15.92:0/3978241363 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6554035640 0x7f6554037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:17.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.702+0000 7f654ffff700 1 -- 172.21.15.92:0/3978241363 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f6558046b00 con 0x7f656809fd80 2023-09-29T23:28:17.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.702+0000 7f65677fe700 1 --2- 172.21.15.92:0/3978241363 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6554035640 0x7f6554037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:17.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.703+0000 7f65677fe700 1 --2- 172.21.15.92:0/3978241363 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6554035640 0x7f6554037af0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f655c009860 tx=0x7f655c016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:17.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.707+0000 7f654ffff700 1 -- 172.21.15.92:0/3978241363 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f655800ecf0 con 0x7f656809fd80 2023-09-29T23:28:17.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.929+0000 7f656e486700 1 -- 172.21.15.92:0/3978241363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f656811e500 con 0x7f656809fd80 2023-09-29T23:28:17.929 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.929+0000 7f654ffff700 1 -- 172.21.15.92:0/3978241363 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f6558017020 con 0x7f656809fd80 2023-09-29T23:28:17.930 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:17.930 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:28:17.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.931+0000 7f656e486700 1 -- 172.21.15.92:0/3978241363 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6554035640 msgr2=0x7f6554037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:17.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.931+0000 7f656e486700 1 --2- 172.21.15.92:0/3978241363 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6554035640 0x7f6554037af0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f655c009860 tx=0x7f655c016000 comp rx=0 tx=0).stop 2023-09-29T23:28:17.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.931+0000 7f656e486700 1 -- 172.21.15.92:0/3978241363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f656809fd80 msgr2=0x7f656813e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:17.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.931+0000 7f656e486700 1 --2- 172.21.15.92:0/3978241363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f656809fd80 0x7f656813e4f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f655800c490 tx=0x7f6558007e00 comp rx=0 tx=0).stop 2023-09-29T23:28:17.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.931+0000 7f656e486700 1 -- 172.21.15.92:0/3978241363 shutdown_connections 2023-09-29T23:28:17.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.931+0000 7f656e486700 1 --2- 172.21.15.92:0/3978241363 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f6554035640 0x7f6554037af0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:17.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.931+0000 7f656e486700 1 --2- 172.21.15.92:0/3978241363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f656809fd80 0x7f656813e4f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:17.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.931+0000 7f656e486700 1 -- 172.21.15.92:0/3978241363 >> 172.21.15.92:0/3978241363 conn(0x7f6568068000 msgr2=0x7f6568094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:17.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.931+0000 7f656e486700 1 -- 172.21.15.92:0/3978241363 shutdown_connections 2023-09-29T23:28:17.932 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:17.931+0000 7f656e486700 1 -- 172.21.15.92:0/3978241363 wait complete. 2023-09-29T23:28:20.944 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:28:21.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.073+0000 7f2c77534700 1 Processor -- start 2023-09-29T23:28:21.074 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.074+0000 7f2c77534700 1 -- start start 2023-09-29T23:28:21.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.074+0000 7f2c77534700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2c7006a040 0x7f2c70134560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:21.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.074+0000 7f2c77534700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c700a1580 con 0x7f2c7006f210 2023-09-29T23:28:21.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.074+0000 7f2c77534700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7006f5e0 con 0x7f2c7006a040 2023-09-29T23:28:21.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.074+0000 7f2c752d0700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f2c7006f210 0x7f2c70069930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:55308/0 (socket says 172.21.15.92:55308) 2023-09-29T23:28:21.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.074+0000 7f2c74acf700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2c7006a040 0x7f2c70134560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:21.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.074+0000 7f2c752d0700 1 -- 172.21.15.92:0/2656731396 learned_addr learned my addr 172.21.15.92:0/2656731396 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:21.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.074+0000 7f2c74acf700 1 -- 172.21.15.92:0/2656731396 >> v1:172.21.15.92:6789/0 conn(0x7f2c7006f210 legacy=0x7f2c70069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:21.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.074+0000 7f2c74acf700 1 -- 172.21.15.92:0/2656731396 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7009cc70 con 0x7f2c7006a040 2023-09-29T23:28:21.075 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.075+0000 7f2c74acf700 1 --2- 172.21.15.92:0/2656731396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7006a040 0x7f2c70134560 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009860 tx=0x7f2c600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334ec748a4c06c62 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:21.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.075+0000 7f2c67fff700 1 -- 172.21.15.92:0/2656731396 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c6000b680 con 0x7f2c7006a040 2023-09-29T23:28:21.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.075+0000 7f2c67fff700 1 -- 172.21.15.92:0/2656731396 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6000b7e0 con 0x7f2c7006a040 2023-09-29T23:28:21.076 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.075+0000 7f2c67fff700 1 -- 172.21.15.92:0/2656731396 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c6000bad0 con 0x7f2c7006a040 2023-09-29T23:28:21.077 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.075+0000 7f2c77534700 1 -- 172.21.15.92:0/2656731396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7006a040 msgr2=0x7f2c70134560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:21.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.075+0000 7f2c77534700 1 --2- 172.21.15.92:0/2656731396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7006a040 0x7f2c70134560 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009860 tx=0x7f2c600091a0 comp rx=0 tx=0).stop 2023-09-29T23:28:21.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.075+0000 7f2c77534700 1 -- 172.21.15.92:0/2656731396 shutdown_connections 2023-09-29T23:28:21.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.075+0000 7f2c77534700 1 --2- 172.21.15.92:0/2656731396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7006a040 0x7f2c70134560 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:21.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.075+0000 7f2c77534700 1 -- 172.21.15.92:0/2656731396 >> 172.21.15.92:0/2656731396 conn(0x7f2c70094a70 msgr2=0x7f2c7006eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:21.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.075+0000 7f2c77534700 1 -- 172.21.15.92:0/2656731396 shutdown_connections 2023-09-29T23:28:21.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.075+0000 7f2c77534700 1 -- 172.21.15.92:0/2656731396 wait complete. 2023-09-29T23:28:21.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.076+0000 7f2c77534700 1 Processor -- start 2023-09-29T23:28:21.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.076+0000 7f2c77534700 1 -- start start 2023-09-29T23:28:21.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.077+0000 7f2c77534700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7006a040 0x7f2c7011ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:21.078 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.077+0000 7f2c77534700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7012cbd0 con 0x7f2c7006a040 2023-09-29T23:28:21.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.077+0000 7f2c752d0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7006a040 0x7f2c7011ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:21.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.077+0000 7f2c752d0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7006a040 0x7f2c7011ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59288/0 (socket says 172.21.15.92:59288) 2023-09-29T23:28:21.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.077+0000 7f2c752d0700 1 -- 172.21.15.92:0/2991394363 learned_addr learned my addr 172.21.15.92:0/2991394363 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:21.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.077+0000 7f2c752d0700 1 -- 172.21.15.92:0/2991394363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c60009420 con 0x7f2c7006a040 2023-09-29T23:28:21.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.077+0000 7f2c752d0700 1 --2- 172.21.15.92:0/2991394363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7006a040 0x7f2c7011ac50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00c6c0 tx=0x7f2c6c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:21.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.077+0000 7f2c657fa700 1 -- 172.21.15.92:0/2991394363 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c6c007440 con 0x7f2c7006a040 2023-09-29T23:28:21.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.078+0000 7f2c657fa700 1 -- 172.21.15.92:0/2991394363 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c0075a0 con 0x7f2c7006a040 2023-09-29T23:28:21.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.078+0000 7f2c77534700 1 -- 172.21.15.92:0/2991394363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c70133de0 con 0x7f2c7006a040 2023-09-29T23:28:21.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.078+0000 7f2c657fa700 1 -- 172.21.15.92:0/2991394363 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c6c005970 con 0x7f2c7006a040 2023-09-29T23:28:21.079 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.078+0000 7f2c77534700 1 -- 172.21.15.92:0/2991394363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7011b330 con 0x7f2c7006a040 2023-09-29T23:28:21.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.079+0000 7f2c657fa700 1 -- 172.21.15.92:0/2991394363 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f2c6c005ba0 con 0x7f2c7006a040 2023-09-29T23:28:21.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.079+0000 7f2c77534700 1 -- 172.21.15.92:0/2991394363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7005f230 con 0x7f2c7006a040 2023-09-29T23:28:21.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.079+0000 7f2c657fa700 1 --2- 172.21.15.92:0/2991394363 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2c54035640 0x7f2c54037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:21.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.079+0000 7f2c657fa700 1 -- 172.21.15.92:0/2991394363 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f2c6c047300 con 0x7f2c7006a040 2023-09-29T23:28:21.080 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.079+0000 7f2c74acf700 1 --2- 172.21.15.92:0/2991394363 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2c54035640 0x7f2c54037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:21.081 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.079+0000 7f2c74acf700 1 --2- 172.21.15.92:0/2991394363 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2c54035640 0x7f2c54037af0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2c600091e0 tx=0x7f2c60016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:21.083 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.084+0000 7f2c657fa700 1 -- 172.21.15.92:0/2991394363 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c6c0108b0 con 0x7f2c7006a040 2023-09-29T23:28:21.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.306+0000 7f2c77534700 1 -- 172.21.15.92:0/2991394363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2c7004bb40 con 0x7f2c7006a040 2023-09-29T23:28:21.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.306+0000 7f2c657fa700 1 -- 172.21.15.92:0/2991394363 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f2c6c01bc20 con 0x7f2c7006a040 2023-09-29T23:28:21.307 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:21.307 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:28:21.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.308+0000 7f2c77534700 1 -- 172.21.15.92:0/2991394363 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2c54035640 msgr2=0x7f2c54037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:21.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.308+0000 7f2c77534700 1 --2- 172.21.15.92:0/2991394363 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2c54035640 0x7f2c54037af0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2c600091e0 tx=0x7f2c60016000 comp rx=0 tx=0).stop 2023-09-29T23:28:21.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.308+0000 7f2c77534700 1 -- 172.21.15.92:0/2991394363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7006a040 msgr2=0x7f2c7011ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:21.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.308+0000 7f2c77534700 1 --2- 172.21.15.92:0/2991394363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7006a040 0x7f2c7011ac50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00c6c0 tx=0x7f2c6c007de0 comp rx=0 tx=0).stop 2023-09-29T23:28:21.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.309+0000 7f2c77534700 1 -- 172.21.15.92:0/2991394363 shutdown_connections 2023-09-29T23:28:21.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.309+0000 7f2c77534700 1 --2- 172.21.15.92:0/2991394363 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2c54035640 0x7f2c54037af0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:21.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.309+0000 7f2c77534700 1 --2- 172.21.15.92:0/2991394363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7006a040 0x7f2c7011ac50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:21.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.309+0000 7f2c77534700 1 -- 172.21.15.92:0/2991394363 >> 172.21.15.92:0/2991394363 conn(0x7f2c70094a70 msgr2=0x7f2c7006d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:21.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.309+0000 7f2c77534700 1 -- 172.21.15.92:0/2991394363 shutdown_connections 2023-09-29T23:28:21.310 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:21.309+0000 7f2c77534700 1 -- 172.21.15.92:0/2991394363 wait complete. 2023-09-29T23:28:24.321 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:28:24.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.440+0000 7f7de530c700 1 Processor -- start 2023-09-29T23:28:24.441 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.440+0000 7f7de530c700 1 -- start start 2023-09-29T23:28:24.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.441+0000 7f7de530c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7de00a3030 0x7f7de012bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:24.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.441+0000 7f7de530c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de0098320 con 0x7f7de009c600 2023-09-29T23:28:24.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.441+0000 7f7de530c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de009c9d0 con 0x7f7de00a3030 2023-09-29T23:28:24.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.441+0000 7f7ddf7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7de00a3030 0x7f7de012bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:24.442 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.441+0000 7f7ddffff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f7de009c600 0x7f7de012f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:55316/0 (socket says 172.21.15.92:55316) 2023-09-29T23:28:24.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.441+0000 7f7ddffff700 1 -- 172.21.15.92:0/3252820308 learned_addr learned my addr 172.21.15.92:0/3252820308 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:24.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.441+0000 7f7ddf7fe700 1 -- 172.21.15.92:0/3252820308 >> v1:172.21.15.92:6789/0 conn(0x7f7de009c600 legacy=0x7f7de012f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:24.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.441+0000 7f7ddf7fe700 1 -- 172.21.15.92:0/3252820308 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de012c620 con 0x7f7de00a3030 2023-09-29T23:28:24.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.441+0000 7f7ddf7fe700 1 --2- 172.21.15.92:0/3252820308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7de00a3030 0x7f7de012bc80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009860 tx=0x7f7dd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f223b636c4949b69 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:24.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.441+0000 7f7ddeffd700 1 -- 172.21.15.92:0/3252820308 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7dd400b680 con 0x7f7de00a3030 2023-09-29T23:28:24.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.441+0000 7f7ddeffd700 1 -- 172.21.15.92:0/3252820308 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd400b7e0 con 0x7f7de00a3030 2023-09-29T23:28:24.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.441+0000 7f7ddeffd700 1 -- 172.21.15.92:0/3252820308 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7dd400bad0 con 0x7f7de00a3030 2023-09-29T23:28:24.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.442+0000 7f7de530c700 1 -- 172.21.15.92:0/3252820308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7de00a3030 msgr2=0x7f7de012bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:24.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.442+0000 7f7de530c700 1 --2- 172.21.15.92:0/3252820308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7de00a3030 0x7f7de012bc80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009860 tx=0x7f7dd40091a0 comp rx=0 tx=0).stop 2023-09-29T23:28:24.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.442+0000 7f7de530c700 1 -- 172.21.15.92:0/3252820308 shutdown_connections 2023-09-29T23:28:24.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.442+0000 7f7de530c700 1 --2- 172.21.15.92:0/3252820308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7de00a3030 0x7f7de012bc80 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:24.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.442+0000 7f7de530c700 1 -- 172.21.15.92:0/3252820308 >> 172.21.15.92:0/3252820308 conn(0x7f7de0068080 msgr2=0x7f7de0096a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:24.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.442+0000 7f7de530c700 1 -- 172.21.15.92:0/3252820308 shutdown_connections 2023-09-29T23:28:24.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.442+0000 7f7de530c700 1 -- 172.21.15.92:0/3252820308 wait complete. 2023-09-29T23:28:24.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.442+0000 7f7de530c700 1 Processor -- start 2023-09-29T23:28:24.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.443+0000 7f7de530c700 1 -- start start 2023-09-29T23:28:24.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.443+0000 7f7de530c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7de009c600 0x7f7de011cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:24.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.443+0000 7f7de530c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de011b770 con 0x7f7de009c600 2023-09-29T23:28:24.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.443+0000 7f7ddffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7de009c600 0x7f7de011cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:24.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.443+0000 7f7ddffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7de009c600 0x7f7de011cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59320/0 (socket says 172.21.15.92:59320) 2023-09-29T23:28:24.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.443+0000 7f7ddffff700 1 -- 172.21.15.92:0/1292938181 learned_addr learned my addr 172.21.15.92:0/1292938181 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:24.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.443+0000 7f7ddffff700 1 -- 172.21.15.92:0/1292938181 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd4009420 con 0x7f7de009c600 2023-09-29T23:28:24.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.443+0000 7f7ddffff700 1 --2- 172.21.15.92:0/1292938181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7de009c600 0x7f7de011cd50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000c460 tx=0x7f7dd0001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:24.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.444+0000 7f7dc7fff700 1 -- 172.21.15.92:0/1292938181 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7dd0005c70 con 0x7f7de009c600 2023-09-29T23:28:24.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.444+0000 7f7dc7fff700 1 -- 172.21.15.92:0/1292938181 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd0005dd0 con 0x7f7de009c600 2023-09-29T23:28:24.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.444+0000 7f7de530c700 1 -- 172.21.15.92:0/1292938181 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de011d430 con 0x7f7de009c600 2023-09-29T23:28:24.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.444+0000 7f7dc7fff700 1 -- 172.21.15.92:0/1292938181 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7dd0007210 con 0x7f7de009c600 2023-09-29T23:28:24.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.444+0000 7f7de530c700 1 -- 172.21.15.92:0/1292938181 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de011abf0 con 0x7f7de009c600 2023-09-29T23:28:24.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.445+0000 7f7dc7fff700 1 -- 172.21.15.92:0/1292938181 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f7dd0007370 con 0x7f7de009c600 2023-09-29T23:28:24.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.445+0000 7f7de530c700 1 -- 172.21.15.92:0/1292938181 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de011b5e0 con 0x7f7de009c600 2023-09-29T23:28:24.450 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.445+0000 7f7dc7fff700 1 --2- 172.21.15.92:0/1292938181 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7dcc035630 0x7f7dcc037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:24.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.445+0000 7f7dc7fff700 1 -- 172.21.15.92:0/1292938181 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f7dd00469d0 con 0x7f7de009c600 2023-09-29T23:28:24.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.445+0000 7f7ddf7fe700 1 --2- 172.21.15.92:0/1292938181 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7dcc035630 0x7f7dcc037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:24.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.445+0000 7f7ddf7fe700 1 --2- 172.21.15.92:0/1292938181 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7dcc035630 0x7f7dcc037ae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40091e0 tx=0x7f7dd4016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:24.451 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.449+0000 7f7dc7fff700 1 -- 172.21.15.92:0/1292938181 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7dd0012400 con 0x7f7de009c600 2023-09-29T23:28:24.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.674+0000 7f7de530c700 1 -- 172.21.15.92:0/1292938181 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7de0068b80 con 0x7f7de009c600 2023-09-29T23:28:24.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.674+0000 7f7dc7fff700 1 -- 172.21.15.92:0/1292938181 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f7dd0010680 con 0x7f7de009c600 2023-09-29T23:28:24.675 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:24.675 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:28:24.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.676+0000 7f7de530c700 1 -- 172.21.15.92:0/1292938181 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7dcc035630 msgr2=0x7f7dcc037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:24.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.676+0000 7f7de530c700 1 --2- 172.21.15.92:0/1292938181 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7dcc035630 0x7f7dcc037ae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40091e0 tx=0x7f7dd4016000 comp rx=0 tx=0).stop 2023-09-29T23:28:24.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.676+0000 7f7de530c700 1 -- 172.21.15.92:0/1292938181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7de009c600 msgr2=0x7f7de011cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:24.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.676+0000 7f7de530c700 1 --2- 172.21.15.92:0/1292938181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7de009c600 0x7f7de011cd50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000c460 tx=0x7f7dd0001020 comp rx=0 tx=0).stop 2023-09-29T23:28:24.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.676+0000 7f7de530c700 1 -- 172.21.15.92:0/1292938181 shutdown_connections 2023-09-29T23:28:24.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.676+0000 7f7de530c700 1 --2- 172.21.15.92:0/1292938181 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7dcc035630 0x7f7dcc037ae0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:24.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.676+0000 7f7de530c700 1 --2- 172.21.15.92:0/1292938181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7de009c600 0x7f7de011cd50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:24.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.676+0000 7f7de530c700 1 -- 172.21.15.92:0/1292938181 >> 172.21.15.92:0/1292938181 conn(0x7f7de0068080 msgr2=0x7f7de009cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:24.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.677+0000 7f7de530c700 1 -- 172.21.15.92:0/1292938181 shutdown_connections 2023-09-29T23:28:24.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:24.677+0000 7f7de530c700 1 -- 172.21.15.92:0/1292938181 wait complete. 2023-09-29T23:28:27.688 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:28:27.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.814+0000 7fbb94fa0700 1 Processor -- start 2023-09-29T23:28:27.815 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.815+0000 7fbb94fa0700 1 -- start start 2023-09-29T23:28:27.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.815+0000 7fbb94fa0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbb90095ab0 0x7fbb90132440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:27.816 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.815+0000 7fbb94fa0700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9006f700 con 0x7fbb90094fd0 2023-09-29T23:28:27.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.815+0000 7fbb94fa0700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb90099e30 con 0x7fbb90095ab0 2023-09-29T23:28:27.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.815+0000 7fbb8effd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbb90095ab0 0x7fbb90132440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:27.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.815+0000 7fbb8f7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fbb90094fd0 0x7fbb900953a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:55322/0 (socket says 172.21.15.92:55322) 2023-09-29T23:28:27.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.815+0000 7fbb8f7fe700 1 -- 172.21.15.92:0/2867326126 learned_addr learned my addr 172.21.15.92:0/2867326126 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:27.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.815+0000 7fbb8effd700 1 -- 172.21.15.92:0/2867326126 >> v1:172.21.15.92:6789/0 conn(0x7fbb90094fd0 legacy=0x7fbb900953a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:27.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.815+0000 7fbb8effd700 1 -- 172.21.15.92:0/2867326126 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9009f1d0 con 0x7fbb90095ab0 2023-09-29T23:28:27.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.816+0000 7fbb8effd700 1 --2- 172.21.15.92:0/2867326126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb90095ab0 0x7fbb90132440 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009860 tx=0x7fbb840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db275c167da7bbc server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:27.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.816+0000 7fbb8e7fc700 1 -- 172.21.15.92:0/2867326126 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb8400b680 con 0x7fbb90095ab0 2023-09-29T23:28:27.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.816+0000 7fbb8e7fc700 1 -- 172.21.15.92:0/2867326126 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8400b7e0 con 0x7fbb90095ab0 2023-09-29T23:28:27.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.816+0000 7fbb8e7fc700 1 -- 172.21.15.92:0/2867326126 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb8400b990 con 0x7fbb90095ab0 2023-09-29T23:28:27.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.816+0000 7fbb94fa0700 1 -- 172.21.15.92:0/2867326126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb90095ab0 msgr2=0x7fbb90132440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:27.817 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.816+0000 7fbb94fa0700 1 --2- 172.21.15.92:0/2867326126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb90095ab0 0x7fbb90132440 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009860 tx=0x7fbb840091a0 comp rx=0 tx=0).stop 2023-09-29T23:28:27.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.816+0000 7fbb94fa0700 1 -- 172.21.15.92:0/2867326126 shutdown_connections 2023-09-29T23:28:27.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.816+0000 7fbb94fa0700 1 --2- 172.21.15.92:0/2867326126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb90095ab0 0x7fbb90132440 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:27.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.816+0000 7fbb94fa0700 1 -- 172.21.15.92:0/2867326126 >> 172.21.15.92:0/2867326126 conn(0x7fbb9006b270 msgr2=0x7fbb9006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:27.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.816+0000 7fbb94fa0700 1 -- 172.21.15.92:0/2867326126 shutdown_connections 2023-09-29T23:28:27.818 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.816+0000 7fbb94fa0700 1 -- 172.21.15.92:0/2867326126 wait complete. 2023-09-29T23:28:27.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.817+0000 7fbb94fa0700 1 Processor -- start 2023-09-29T23:28:27.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.817+0000 7fbb94fa0700 1 -- start start 2023-09-29T23:28:27.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.818+0000 7fbb94fa0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb90094fd0 0x7fbb9008fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:27.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.818+0000 7fbb94fa0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb90090570 con 0x7fbb90094fd0 2023-09-29T23:28:27.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.818+0000 7fbb8f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb90094fd0 0x7fbb9008fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:27.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.818+0000 7fbb8f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb90094fd0 0x7fbb9008fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59336/0 (socket says 172.21.15.92:59336) 2023-09-29T23:28:27.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.818+0000 7fbb8f7fe700 1 -- 172.21.15.92:0/1590929991 learned_addr learned my addr 172.21.15.92:0/1590929991 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:27.820 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.818+0000 7fbb8f7fe700 1 -- 172.21.15.92:0/1590929991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb84009420 con 0x7fbb90094fd0 2023-09-29T23:28:27.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.818+0000 7fbb8f7fe700 1 --2- 172.21.15.92:0/1590929991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb90094fd0 0x7fbb9008fe20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbb8000ca10 tx=0x7fbb80001760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:27.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.818+0000 7fbb777fe700 1 -- 172.21.15.92:0/1590929991 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb800030d0 con 0x7fbb90094fd0 2023-09-29T23:28:27.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.818+0000 7fbb777fe700 1 -- 172.21.15.92:0/1590929991 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb80005d80 con 0x7fbb90094fd0 2023-09-29T23:28:27.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.818+0000 7fbb777fe700 1 -- 172.21.15.92:0/1590929991 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb8000a7c0 con 0x7fbb90094fd0 2023-09-29T23:28:27.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.818+0000 7fbb94fa0700 1 -- 172.21.15.92:0/1590929991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb90090fc0 con 0x7fbb90094fd0 2023-09-29T23:28:27.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.818+0000 7fbb94fa0700 1 -- 172.21.15.92:0/1590929991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9008e6b0 con 0x7fbb90094fd0 2023-09-29T23:28:27.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.819+0000 7fbb777fe700 1 -- 172.21.15.92:0/1590929991 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fbb8000a920 con 0x7fbb90094fd0 2023-09-29T23:28:27.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.819+0000 7fbb777fe700 1 --2- 172.21.15.92:0/1590929991 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fbb7c035640 0x7fbb7c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:27.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.819+0000 7fbb777fe700 1 -- 172.21.15.92:0/1590929991 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fbb80046d80 con 0x7fbb90094fd0 2023-09-29T23:28:27.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.819+0000 7fbb8effd700 1 --2- 172.21.15.92:0/1590929991 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fbb7c035640 0x7fbb7c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:27.821 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.819+0000 7fbb94fa0700 1 -- 172.21.15.92:0/1590929991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9005f230 con 0x7fbb90094fd0 2023-09-29T23:28:27.822 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.820+0000 7fbb8effd700 1 --2- 172.21.15.92:0/1590929991 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fbb7c035640 0x7fbb7c037af0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbb840091e0 tx=0x7fbb84016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:27.824 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:27.824+0000 7fbb777fe700 1 -- 172.21.15.92:0/1590929991 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb80019260 con 0x7fbb90094fd0 2023-09-29T23:28:28.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:28.046+0000 7fbb94fa0700 1 -- 172.21.15.92:0/1590929991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbb9004bb40 con 0x7fbb90094fd0 2023-09-29T23:28:28.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:28.046+0000 7fbb777fe700 1 -- 172.21.15.92:0/1590929991 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fbb80018030 con 0x7fbb90094fd0 2023-09-29T23:28:28.069 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:28.069 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:28:28.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:28.048+0000 7fbb94fa0700 1 -- 172.21.15.92:0/1590929991 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fbb7c035640 msgr2=0x7fbb7c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:28.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:28.048+0000 7fbb94fa0700 1 --2- 172.21.15.92:0/1590929991 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fbb7c035640 0x7fbb7c037af0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbb840091e0 tx=0x7fbb84016000 comp rx=0 tx=0).stop 2023-09-29T23:28:28.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:28.048+0000 7fbb94fa0700 1 -- 172.21.15.92:0/1590929991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb90094fd0 msgr2=0x7fbb9008fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:28.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:28.048+0000 7fbb94fa0700 1 --2- 172.21.15.92:0/1590929991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb90094fd0 0x7fbb9008fe20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbb8000ca10 tx=0x7fbb80001760 comp rx=0 tx=0).stop 2023-09-29T23:28:28.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:28.048+0000 7fbb94fa0700 1 -- 172.21.15.92:0/1590929991 shutdown_connections 2023-09-29T23:28:28.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:28.048+0000 7fbb94fa0700 1 --2- 172.21.15.92:0/1590929991 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fbb7c035640 0x7fbb7c037af0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:28.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:28.048+0000 7fbb94fa0700 1 --2- 172.21.15.92:0/1590929991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb90094fd0 0x7fbb9008fe20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:28.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:28.048+0000 7fbb94fa0700 1 -- 172.21.15.92:0/1590929991 >> 172.21.15.92:0/1590929991 conn(0x7fbb9006b270 msgr2=0x7fbb90086000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:28.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:28.048+0000 7fbb94fa0700 1 -- 172.21.15.92:0/1590929991 shutdown_connections 2023-09-29T23:28:28.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:28.048+0000 7fbb94fa0700 1 -- 172.21.15.92:0/1590929991 wait complete. 2023-09-29T23:28:31.072 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:28:31.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.195+0000 7f7fbbfe1700 1 Processor -- start 2023-09-29T23:28:31.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.195+0000 7f7fbbfe1700 1 -- start start 2023-09-29T23:28:31.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.196+0000 7f7fbbfe1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7fb412fcb0 0x7f7fb4134620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:31.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.196+0000 7f7fbbfe1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb40997f0 con 0x7f7fb40a3030 2023-09-29T23:28:31.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.196+0000 7f7fbbfe1700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb40a3400 con 0x7f7fb412fcb0 2023-09-29T23:28:31.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.196+0000 7f7fb957c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7fb412fcb0 0x7f7fb4134620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:31.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.196+0000 7f7fb9d7d700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f7fb40a3030 0x7f7fb412f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:59692/0 (socket says 172.21.15.92:59692) 2023-09-29T23:28:31.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.196+0000 7f7fb9d7d700 1 -- 172.21.15.92:0/1995329996 learned_addr learned my addr 172.21.15.92:0/1995329996 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:31.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.196+0000 7f7fb957c700 1 -- 172.21.15.92:0/1995329996 >> v1:172.21.15.92:6789/0 conn(0x7f7fb40a3030 legacy=0x7f7fb412f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:31.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.196+0000 7f7fb957c700 1 -- 172.21.15.92:0/1995329996 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb40977a0 con 0x7f7fb412fcb0 2023-09-29T23:28:31.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.196+0000 7f7fb957c700 1 --2- 172.21.15.92:0/1995329996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fb412fcb0 0x7f7fb4134620 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009860 tx=0x7f7fa40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbd3974d91be61d server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:31.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.196+0000 7f7fb8d7b700 1 -- 172.21.15.92:0/1995329996 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fa400b710 con 0x7f7fb412fcb0 2023-09-29T23:28:31.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.196+0000 7f7fb8d7b700 1 -- 172.21.15.92:0/1995329996 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa400b870 con 0x7f7fb412fcb0 2023-09-29T23:28:31.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.196+0000 7f7fb8d7b700 1 -- 172.21.15.92:0/1995329996 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fa400ba20 con 0x7f7fb412fcb0 2023-09-29T23:28:31.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.197+0000 7f7fbbfe1700 1 -- 172.21.15.92:0/1995329996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fb412fcb0 msgr2=0x7f7fb4134620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:31.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.197+0000 7f7fbbfe1700 1 --2- 172.21.15.92:0/1995329996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fb412fcb0 0x7f7fb4134620 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009860 tx=0x7f7fa40091a0 comp rx=0 tx=0).stop 2023-09-29T23:28:31.198 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.197+0000 7f7fbbfe1700 1 -- 172.21.15.92:0/1995329996 shutdown_connections 2023-09-29T23:28:31.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.197+0000 7f7fbbfe1700 1 --2- 172.21.15.92:0/1995329996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fb412fcb0 0x7f7fb4134620 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:31.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.197+0000 7f7fbbfe1700 1 -- 172.21.15.92:0/1995329996 >> 172.21.15.92:0/1995329996 conn(0x7f7fb4067fc0 msgr2=0x7f7fb40a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:31.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.197+0000 7f7fbbfe1700 1 -- 172.21.15.92:0/1995329996 shutdown_connections 2023-09-29T23:28:31.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.197+0000 7f7fbbfe1700 1 -- 172.21.15.92:0/1995329996 wait complete. 2023-09-29T23:28:31.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.198+0000 7f7fbbfe1700 1 Processor -- start 2023-09-29T23:28:31.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.198+0000 7f7fbbfe1700 1 -- start start 2023-09-29T23:28:31.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.198+0000 7f7fbbfe1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fb40a3030 0x7f7fb411a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:31.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.198+0000 7f7fbbfe1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb411a700 con 0x7f7fb40a3030 2023-09-29T23:28:31.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.198+0000 7f7fb9d7d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fb40a3030 0x7f7fb411a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:31.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.198+0000 7f7fb9d7d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fb40a3030 0x7f7fb411a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44096/0 (socket says 172.21.15.92:44096) 2023-09-29T23:28:31.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.198+0000 7f7fb9d7d700 1 -- 172.21.15.92:0/3830510 learned_addr learned my addr 172.21.15.92:0/3830510 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:31.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.198+0000 7f7fb9d7d700 1 -- 172.21.15.92:0/3830510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa4009420 con 0x7f7fb40a3030 2023-09-29T23:28:31.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.198+0000 7f7fb9d7d700 1 --2- 172.21.15.92:0/3830510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fb40a3030 0x7f7fb411a960 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000c6c0 tx=0x7f7fb0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:31.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.199+0000 7f7fa9ffb700 1 -- 172.21.15.92:0/3830510 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fb0005b30 con 0x7f7fb40a3030 2023-09-29T23:28:31.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.199+0000 7f7fa9ffb700 1 -- 172.21.15.92:0/3830510 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb0005c90 con 0x7f7fb40a3030 2023-09-29T23:28:31.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.199+0000 7f7fbbfe1700 1 -- 172.21.15.92:0/3830510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb412ceb0 con 0x7f7fb40a3030 2023-09-29T23:28:31.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.199+0000 7f7fa9ffb700 1 -- 172.21.15.92:0/3830510 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fb0004830 con 0x7f7fb40a3030 2023-09-29T23:28:31.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.199+0000 7f7fbbfe1700 1 -- 172.21.15.92:0/3830510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb411cb60 con 0x7f7fb40a3030 2023-09-29T23:28:31.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.199+0000 7f7fa9ffb700 1 -- 172.21.15.92:0/3830510 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f7fb0004a60 con 0x7f7fb40a3030 2023-09-29T23:28:31.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.199+0000 7f7fa9ffb700 1 --2- 172.21.15.92:0/3830510 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7f98035640 0x7f7f98037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:31.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.200+0000 7f7fa9ffb700 1 -- 172.21.15.92:0/3830510 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f7fb0046910 con 0x7f7fb40a3030 2023-09-29T23:28:31.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.200+0000 7f7fb957c700 1 --2- 172.21.15.92:0/3830510 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7f98035640 0x7f7f98037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:31.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.200+0000 7f7fbbfe1700 1 -- 172.21.15.92:0/3830510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb41300f0 con 0x7f7fb40a3030 2023-09-29T23:28:31.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.200+0000 7f7fb957c700 1 --2- 172.21.15.92:0/3830510 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7f98035640 0x7f7f98037af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40091e0 tx=0x7f7fa4016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:31.204 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.204+0000 7f7fa9ffb700 1 -- 172.21.15.92:0/3830510 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7fb00075f0 con 0x7f7fb40a3030 2023-09-29T23:28:31.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.425+0000 7f7fbbfe1700 1 -- 172.21.15.92:0/3830510 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7fb4096640 con 0x7f7fb40a3030 2023-09-29T23:28:31.426 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.426+0000 7f7fa9ffb700 1 -- 172.21.15.92:0/3830510 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f7fb001b360 con 0x7f7fb40a3030 2023-09-29T23:28:31.427 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:31.427 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:28:31.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.428+0000 7f7fbbfe1700 1 -- 172.21.15.92:0/3830510 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7f98035640 msgr2=0x7f7f98037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:31.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.428+0000 7f7fbbfe1700 1 --2- 172.21.15.92:0/3830510 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7f98035640 0x7f7f98037af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40091e0 tx=0x7f7fa4016000 comp rx=0 tx=0).stop 2023-09-29T23:28:31.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.428+0000 7f7fbbfe1700 1 -- 172.21.15.92:0/3830510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fb40a3030 msgr2=0x7f7fb411a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:31.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.428+0000 7f7fbbfe1700 1 --2- 172.21.15.92:0/3830510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fb40a3030 0x7f7fb411a960 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000c6c0 tx=0x7f7fb0007f70 comp rx=0 tx=0).stop 2023-09-29T23:28:31.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.428+0000 7f7fbbfe1700 1 -- 172.21.15.92:0/3830510 shutdown_connections 2023-09-29T23:28:31.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.428+0000 7f7fbbfe1700 1 --2- 172.21.15.92:0/3830510 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7f98035640 0x7f7f98037af0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:31.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.428+0000 7f7fbbfe1700 1 --2- 172.21.15.92:0/3830510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fb40a3030 0x7f7fb411a960 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:31.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.428+0000 7f7fbbfe1700 1 -- 172.21.15.92:0/3830510 >> 172.21.15.92:0/3830510 conn(0x7f7fb4067fc0 msgr2=0x7f7fb412d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:31.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.428+0000 7f7fbbfe1700 1 -- 172.21.15.92:0/3830510 shutdown_connections 2023-09-29T23:28:31.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:31.428+0000 7f7fbbfe1700 1 -- 172.21.15.92:0/3830510 wait complete. 2023-09-29T23:28:34.440 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:28:34.563 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.562+0000 7f172cf45700 1 Processor -- start 2023-09-29T23:28:34.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.562+0000 7f172cf45700 1 -- start start 2023-09-29T23:28:34.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.563+0000 7f172cf45700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f17280a3030 0x7f172812bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:34.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.563+0000 7f172cf45700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1728098320 con 0x7f172809c600 2023-09-29T23:28:34.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.563+0000 7f172cf45700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172809c9d0 con 0x7f17280a3030 2023-09-29T23:28:34.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.563+0000 7f1726ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f17280a3030 0x7f172812bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:34.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.563+0000 7f17277fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f172809c600 0x7f172812f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:59704/0 (socket says 172.21.15.92:59704) 2023-09-29T23:28:34.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.563+0000 7f17277fe700 1 -- 172.21.15.92:0/701037313 learned_addr learned my addr 172.21.15.92:0/701037313 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:34.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.563+0000 7f1726ffd700 1 -- 172.21.15.92:0/701037313 >> v1:172.21.15.92:6789/0 conn(0x7f172809c600 legacy=0x7f172812f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:34.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.563+0000 7f1726ffd700 1 -- 172.21.15.92:0/701037313 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172812c620 con 0x7f17280a3030 2023-09-29T23:28:34.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.563+0000 7f1726ffd700 1 --2- 172.21.15.92:0/701037313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17280a3030 0x7f172812bc80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f171c009860 tx=0x7f171c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d17d4d39ace6df7 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:34.564 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.563+0000 7f17267fc700 1 -- 172.21.15.92:0/701037313 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f171c00b680 con 0x7f17280a3030 2023-09-29T23:28:34.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.563+0000 7f17267fc700 1 -- 172.21.15.92:0/701037313 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c00b7e0 con 0x7f17280a3030 2023-09-29T23:28:34.565 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.563+0000 7f17267fc700 1 -- 172.21.15.92:0/701037313 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f171c00bad0 con 0x7f17280a3030 2023-09-29T23:28:34.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.564+0000 7f172cf45700 1 -- 172.21.15.92:0/701037313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17280a3030 msgr2=0x7f172812bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:34.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.564+0000 7f172cf45700 1 --2- 172.21.15.92:0/701037313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17280a3030 0x7f172812bc80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f171c009860 tx=0x7f171c0091a0 comp rx=0 tx=0).stop 2023-09-29T23:28:34.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.564+0000 7f172cf45700 1 -- 172.21.15.92:0/701037313 shutdown_connections 2023-09-29T23:28:34.567 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.564+0000 7f172cf45700 1 --2- 172.21.15.92:0/701037313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17280a3030 0x7f172812bc80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:34.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.564+0000 7f172cf45700 1 -- 172.21.15.92:0/701037313 >> 172.21.15.92:0/701037313 conn(0x7f1728068080 msgr2=0x7f1728096a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:34.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.564+0000 7f172cf45700 1 -- 172.21.15.92:0/701037313 shutdown_connections 2023-09-29T23:28:34.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.564+0000 7f172cf45700 1 -- 172.21.15.92:0/701037313 wait complete. 2023-09-29T23:28:34.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.565+0000 7f172cf45700 1 Processor -- start 2023-09-29T23:28:34.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.565+0000 7f172cf45700 1 -- start start 2023-09-29T23:28:34.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.565+0000 7f172cf45700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f172809c600 0x7f172811cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:34.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.565+0000 7f172cf45700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172811b770 con 0x7f172809c600 2023-09-29T23:28:34.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.565+0000 7f17277fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f172809c600 0x7f172811cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:34.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.565+0000 7f17277fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f172809c600 0x7f172811cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44118/0 (socket says 172.21.15.92:44118) 2023-09-29T23:28:34.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.565+0000 7f17277fe700 1 -- 172.21.15.92:0/2585682277 learned_addr learned my addr 172.21.15.92:0/2585682277 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:34.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.566+0000 7f17277fe700 1 -- 172.21.15.92:0/2585682277 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c009420 con 0x7f172809c600 2023-09-29T23:28:34.568 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.566+0000 7f17277fe700 1 --2- 172.21.15.92:0/2585682277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f172809c600 0x7f172811cd50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f171800cb70 tx=0x7f1718001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:34.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.566+0000 7f170f7fe700 1 -- 172.21.15.92:0/2585682277 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f171800aa50 con 0x7f172809c600 2023-09-29T23:28:34.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.566+0000 7f170f7fe700 1 -- 172.21.15.92:0/2585682277 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171800abb0 con 0x7f172809c600 2023-09-29T23:28:34.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.566+0000 7f172cf45700 1 -- 172.21.15.92:0/2585682277 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172811d430 con 0x7f172809c600 2023-09-29T23:28:34.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.566+0000 7f170f7fe700 1 -- 172.21.15.92:0/2585682277 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f171800ae60 con 0x7f172809c600 2023-09-29T23:28:34.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.566+0000 7f172cf45700 1 -- 172.21.15.92:0/2585682277 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172811abf0 con 0x7f172809c600 2023-09-29T23:28:34.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.567+0000 7f170f7fe700 1 -- 172.21.15.92:0/2585682277 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f17180070f0 con 0x7f172809c600 2023-09-29T23:28:34.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.567+0000 7f170f7fe700 1 --2- 172.21.15.92:0/2585682277 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1714035630 0x7f1714037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:34.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.567+0000 7f172cf45700 1 -- 172.21.15.92:0/2585682277 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172811b5e0 con 0x7f172809c600 2023-09-29T23:28:34.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.567+0000 7f170f7fe700 1 -- 172.21.15.92:0/2585682277 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f17180479c0 con 0x7f172809c600 2023-09-29T23:28:34.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.567+0000 7f1726ffd700 1 --2- 172.21.15.92:0/2585682277 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1714035630 0x7f1714037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:34.569 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.567+0000 7f1726ffd700 1 --2- 172.21.15.92:0/2585682277 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1714035630 0x7f1714037ae0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f171c0091e0 tx=0x7f171c016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:34.571 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.571+0000 7f170f7fe700 1 -- 172.21.15.92:0/2585682277 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17180106c0 con 0x7f172809c600 2023-09-29T23:28:34.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.795+0000 7f172cf45700 1 -- 172.21.15.92:0/2585682277 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1728068b80 con 0x7f172809c600 2023-09-29T23:28:34.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.795+0000 7f170f7fe700 1 -- 172.21.15.92:0/2585682277 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f1718010300 con 0x7f172809c600 2023-09-29T23:28:34.795 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:34.796 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:28:34.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.797+0000 7f172cf45700 1 -- 172.21.15.92:0/2585682277 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1714035630 msgr2=0x7f1714037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:34.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.797+0000 7f172cf45700 1 --2- 172.21.15.92:0/2585682277 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1714035630 0x7f1714037ae0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f171c0091e0 tx=0x7f171c016000 comp rx=0 tx=0).stop 2023-09-29T23:28:34.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.797+0000 7f172cf45700 1 -- 172.21.15.92:0/2585682277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f172809c600 msgr2=0x7f172811cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:34.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.797+0000 7f172cf45700 1 --2- 172.21.15.92:0/2585682277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f172809c600 0x7f172811cd50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f171800cb70 tx=0x7f1718001a30 comp rx=0 tx=0).stop 2023-09-29T23:28:34.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.797+0000 7f172cf45700 1 -- 172.21.15.92:0/2585682277 shutdown_connections 2023-09-29T23:28:34.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.797+0000 7f172cf45700 1 --2- 172.21.15.92:0/2585682277 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1714035630 0x7f1714037ae0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:34.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.797+0000 7f172cf45700 1 --2- 172.21.15.92:0/2585682277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f172809c600 0x7f172811cd50 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:34.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.797+0000 7f172cf45700 1 -- 172.21.15.92:0/2585682277 >> 172.21.15.92:0/2585682277 conn(0x7f1728068080 msgr2=0x7f172809cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:34.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.797+0000 7f172cf45700 1 -- 172.21.15.92:0/2585682277 shutdown_connections 2023-09-29T23:28:34.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:34.797+0000 7f172cf45700 1 -- 172.21.15.92:0/2585682277 wait complete. 2023-09-29T23:28:37.809 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:28:37.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.929+0000 7f10a54be700 1 Processor -- start 2023-09-29T23:28:37.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.929+0000 7f10a54be700 1 -- start start 2023-09-29T23:28:37.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.929+0000 7f10a54be700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f10a006a040 0x7f10a0134540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:37.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.929+0000 7f10a54be700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a00a1580 con 0x7f10a006f210 2023-09-29T23:28:37.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.929+0000 7f10a54be700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a006f5e0 con 0x7f10a006a040 2023-09-29T23:28:37.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.929+0000 7f10967fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f10a006a040 0x7f10a0134540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:37.930 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.929+0000 7f109effd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f10a006f210 0x7f10a0069930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:59710/0 (socket says 172.21.15.92:59710) 2023-09-29T23:28:37.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.929+0000 7f10967fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f10a006a040 0x7f10a0134540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44126/0 (socket says 172.21.15.92:44126) 2023-09-29T23:28:37.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.929+0000 7f109effd700 1 -- 172.21.15.92:0/2419287824 learned_addr learned my addr 172.21.15.92:0/2419287824 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:37.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.929+0000 7f10967fc700 1 -- 172.21.15.92:0/2419287824 >> v1:172.21.15.92:6789/0 conn(0x7f10a006f210 legacy=0x7f10a0069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:37.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.929+0000 7f10967fc700 1 -- 172.21.15.92:0/2419287824 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a009cc70 con 0x7f10a006a040 2023-09-29T23:28:37.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.929+0000 7f109e7fc700 1 -- 172.21.15.92:0/2419287824 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474391790 0 0) 0x7f10a00a1580 con 0x7f10a006f210 2023-09-29T23:28:37.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.930+0000 7f10967fc700 1 --2- 172.21.15.92:0/2419287824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a006a040 0x7f10a0134540 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1088009860 tx=0x7f10880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5b6ebfa61b57cd server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:37.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.930+0000 7f109e7fc700 1 -- 172.21.15.92:0/2419287824 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f108800b680 con 0x7f10a006a040 2023-09-29T23:28:37.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.930+0000 7f109e7fc700 1 -- 172.21.15.92:0/2419287824 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108800b7e0 con 0x7f10a006a040 2023-09-29T23:28:37.931 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.930+0000 7f109e7fc700 1 -- 172.21.15.92:0/2419287824 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f108800bad0 con 0x7f10a006a040 2023-09-29T23:28:37.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.930+0000 7f10a54be700 1 -- 172.21.15.92:0/2419287824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a006a040 msgr2=0x7f10a0134540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:37.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.930+0000 7f10a54be700 1 --2- 172.21.15.92:0/2419287824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a006a040 0x7f10a0134540 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1088009860 tx=0x7f10880091a0 comp rx=0 tx=0).stop 2023-09-29T23:28:37.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.930+0000 7f10a54be700 1 -- 172.21.15.92:0/2419287824 shutdown_connections 2023-09-29T23:28:37.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.930+0000 7f10a54be700 1 --2- 172.21.15.92:0/2419287824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a006a040 0x7f10a0134540 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:37.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.930+0000 7f10a54be700 1 -- 172.21.15.92:0/2419287824 >> 172.21.15.92:0/2419287824 conn(0x7f10a0094a70 msgr2=0x7f10a006eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:37.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.930+0000 7f10a54be700 1 -- 172.21.15.92:0/2419287824 shutdown_connections 2023-09-29T23:28:37.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.930+0000 7f10a54be700 1 -- 172.21.15.92:0/2419287824 wait complete. 2023-09-29T23:28:37.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.931+0000 7f10a54be700 1 Processor -- start 2023-09-29T23:28:37.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.931+0000 7f10a54be700 1 -- start start 2023-09-29T23:28:37.934 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.932+0000 7f10a54be700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a006a040 0x7f10a011dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:37.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.932+0000 7f10a54be700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a011a6a0 con 0x7f10a006a040 2023-09-29T23:28:37.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.932+0000 7f109effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a006a040 0x7f10a011dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:37.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.932+0000 7f109effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a006a040 0x7f10a011dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44140/0 (socket says 172.21.15.92:44140) 2023-09-29T23:28:37.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.932+0000 7f109effd700 1 -- 172.21.15.92:0/2534004115 learned_addr learned my addr 172.21.15.92:0/2534004115 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:37.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.932+0000 7f109effd700 1 -- 172.21.15.92:0/2534004115 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1088009420 con 0x7f10a006a040 2023-09-29T23:28:37.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.932+0000 7f109effd700 1 --2- 172.21.15.92:0/2534004115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a006a040 0x7f10a011dfb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f109000c710 tx=0x7f1090007c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:37.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.932+0000 7f10977fe700 1 -- 172.21.15.92:0/2534004115 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1090007320 con 0x7f10a006a040 2023-09-29T23:28:37.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.932+0000 7f10977fe700 1 -- 172.21.15.92:0/2534004115 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10900074a0 con 0x7f10a006a040 2023-09-29T23:28:37.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.932+0000 7f10a54be700 1 -- 172.21.15.92:0/2534004115 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a011e700 con 0x7f10a006a040 2023-09-29T23:28:37.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.932+0000 7f10977fe700 1 -- 172.21.15.92:0/2534004115 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10900057f0 con 0x7f10a006a040 2023-09-29T23:28:37.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.932+0000 7f10a54be700 1 -- 172.21.15.92:0/2534004115 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a011a940 con 0x7f10a006a040 2023-09-29T23:28:37.935 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.933+0000 7f10977fe700 1 -- 172.21.15.92:0/2534004115 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f1090005a20 con 0x7f10a006a040 2023-09-29T23:28:37.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.933+0000 7f10977fe700 1 --2- 172.21.15.92:0/2534004115 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1080035630 0x7f1080037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:37.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.933+0000 7f10977fe700 1 -- 172.21.15.92:0/2534004115 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f1090001e40 con 0x7f10a006a040 2023-09-29T23:28:37.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.933+0000 7f10967fc700 1 --2- 172.21.15.92:0/2534004115 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1080035630 0x7f1080037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:37.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.933+0000 7f10a54be700 1 -- 172.21.15.92:0/2534004115 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a005f230 con 0x7f10a006a040 2023-09-29T23:28:37.936 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.934+0000 7f10967fc700 1 --2- 172.21.15.92:0/2534004115 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1080035630 0x7f1080037ae0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1088006eb0 tx=0x7f1088016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:37.938 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:37.938+0000 7f10977fe700 1 -- 172.21.15.92:0/2534004115 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1090005d20 con 0x7f10a006a040 2023-09-29T23:28:38.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:38.165+0000 7f10a54be700 1 -- 172.21.15.92:0/2534004115 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f10a009bdd0 con 0x7f10a006a040 2023-09-29T23:28:38.165 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:38.165+0000 7f10977fe700 1 -- 172.21.15.92:0/2534004115 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f109001bb30 con 0x7f10a006a040 2023-09-29T23:28:38.165 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:38.166 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:28:38.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:38.167+0000 7f10a54be700 1 -- 172.21.15.92:0/2534004115 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1080035630 msgr2=0x7f1080037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:38.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:38.167+0000 7f10a54be700 1 --2- 172.21.15.92:0/2534004115 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1080035630 0x7f1080037ae0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1088006eb0 tx=0x7f1088016000 comp rx=0 tx=0).stop 2023-09-29T23:28:38.167 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:38.167+0000 7f10a54be700 1 -- 172.21.15.92:0/2534004115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a006a040 msgr2=0x7f10a011dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:38.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:38.167+0000 7f10a54be700 1 --2- 172.21.15.92:0/2534004115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a006a040 0x7f10a011dfb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f109000c710 tx=0x7f1090007c20 comp rx=0 tx=0).stop 2023-09-29T23:28:38.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:38.167+0000 7f10a54be700 1 -- 172.21.15.92:0/2534004115 shutdown_connections 2023-09-29T23:28:38.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:38.167+0000 7f10a54be700 1 --2- 172.21.15.92:0/2534004115 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f1080035630 0x7f1080037ae0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:38.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:38.167+0000 7f10a54be700 1 --2- 172.21.15.92:0/2534004115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10a006a040 0x7f10a011dfb0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:38.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:38.167+0000 7f10a54be700 1 -- 172.21.15.92:0/2534004115 >> 172.21.15.92:0/2534004115 conn(0x7f10a0094a70 msgr2=0x7f10a012ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:38.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:38.167+0000 7f10a54be700 1 -- 172.21.15.92:0/2534004115 shutdown_connections 2023-09-29T23:28:38.168 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:38.167+0000 7f10a54be700 1 -- 172.21.15.92:0/2534004115 wait complete. 2023-09-29T23:28:41.179 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:28:41.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.299+0000 7fee6f581700 1 Processor -- start 2023-09-29T23:28:41.300 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.299+0000 7fee6f581700 1 -- start start 2023-09-29T23:28:41.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.300+0000 7fee6f581700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fee680a3030 0x7fee6812f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:41.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.300+0000 7fee6f581700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee680997f0 con 0x7fee6812fae0 2023-09-29T23:28:41.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.300+0000 7fee6f581700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee680a3400 con 0x7fee680a3030 2023-09-29T23:28:41.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.300+0000 7fee6d31d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fee680a3030 0x7fee6812f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:41.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.300+0000 7fee6cb1c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fee6812fae0 0x7fee68095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:59238/0 (socket says 172.21.15.92:59238) 2023-09-29T23:28:41.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.300+0000 7fee6cb1c700 1 -- 172.21.15.92:0/2923961179 learned_addr learned my addr 172.21.15.92:0/2923961179 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:41.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.300+0000 7fee6d31d700 1 -- 172.21.15.92:0/2923961179 >> v1:172.21.15.92:6789/0 conn(0x7fee6812fae0 legacy=0x7fee68095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:41.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.300+0000 7fee6d31d700 1 -- 172.21.15.92:0/2923961179 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee680977a0 con 0x7fee680a3030 2023-09-29T23:28:41.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.301+0000 7fee6d31d700 1 --2- 172.21.15.92:0/2923961179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee680a3030 0x7fee6812f5a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fee64009de0 tx=0x7fee64009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ca2eada054e361 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:41.302 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.301+0000 7fee5ffff700 1 -- 172.21.15.92:0/2923961179 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee6400e070 con 0x7fee680a3030 2023-09-29T23:28:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.301+0000 7fee5ffff700 1 -- 172.21.15.92:0/2923961179 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6400bd10 con 0x7fee680a3030 2023-09-29T23:28:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.301+0000 7fee5ffff700 1 -- 172.21.15.92:0/2923961179 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee64012430 con 0x7fee680a3030 2023-09-29T23:28:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.301+0000 7fee6f581700 1 -- 172.21.15.92:0/2923961179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee680a3030 msgr2=0x7fee6812f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.301+0000 7fee6f581700 1 --2- 172.21.15.92:0/2923961179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee680a3030 0x7fee6812f5a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fee64009de0 tx=0x7fee64009780 comp rx=0 tx=0).stop 2023-09-29T23:28:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.301+0000 7fee6f581700 1 -- 172.21.15.92:0/2923961179 shutdown_connections 2023-09-29T23:28:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.301+0000 7fee6f581700 1 --2- 172.21.15.92:0/2923961179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee680a3030 0x7fee6812f5a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.301+0000 7fee6f581700 1 -- 172.21.15.92:0/2923961179 >> 172.21.15.92:0/2923961179 conn(0x7fee68067fc0 msgr2=0x7fee680a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.301+0000 7fee6f581700 1 -- 172.21.15.92:0/2923961179 shutdown_connections 2023-09-29T23:28:41.303 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.301+0000 7fee6f581700 1 -- 172.21.15.92:0/2923961179 wait complete. 2023-09-29T23:28:41.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.302+0000 7fee6f581700 1 Processor -- start 2023-09-29T23:28:41.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.302+0000 7fee6f581700 1 -- start start 2023-09-29T23:28:41.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.303+0000 7fee6f581700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee680a3030 0x7fee6812c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:41.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.303+0000 7fee6f581700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6811daa0 con 0x7fee680a3030 2023-09-29T23:28:41.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.303+0000 7fee6d31d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee680a3030 0x7fee6812c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:41.306 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.303+0000 7fee6d31d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee680a3030 0x7fee6812c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47636/0 (socket says 172.21.15.92:47636) 2023-09-29T23:28:41.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.303+0000 7fee6d31d700 1 -- 172.21.15.92:0/2647532909 learned_addr learned my addr 172.21.15.92:0/2647532909 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:41.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.303+0000 7fee6d31d700 1 -- 172.21.15.92:0/2647532909 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee64009a20 con 0x7fee680a3030 2023-09-29T23:28:41.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.303+0000 7fee6d31d700 1 --2- 172.21.15.92:0/2647532909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee680a3030 0x7fee6812c400 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fee640099f0 tx=0x7fee64018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:41.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.303+0000 7fee5d7fa700 1 -- 172.21.15.92:0/2647532909 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee6401d640 con 0x7fee680a3030 2023-09-29T23:28:41.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.303+0000 7fee5d7fa700 1 -- 172.21.15.92:0/2647532909 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6401d7a0 con 0x7fee680a3030 2023-09-29T23:28:41.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.303+0000 7fee5d7fa700 1 -- 172.21.15.92:0/2647532909 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee6401da90 con 0x7fee680a3030 2023-09-29T23:28:41.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.303+0000 7fee6f581700 1 -- 172.21.15.92:0/2647532909 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6811be40 con 0x7fee680a3030 2023-09-29T23:28:41.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.303+0000 7fee6f581700 1 -- 172.21.15.92:0/2647532909 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6811c6a0 con 0x7fee680a3030 2023-09-29T23:28:41.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.304+0000 7fee5d7fa700 1 -- 172.21.15.92:0/2647532909 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fee64024070 con 0x7fee680a3030 2023-09-29T23:28:41.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.304+0000 7fee6f581700 1 -- 172.21.15.92:0/2647532909 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6811bcb0 con 0x7fee680a3030 2023-09-29T23:28:41.307 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.304+0000 7fee5d7fa700 1 --2- 172.21.15.92:0/2647532909 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fee4c035640 0x7fee4c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:41.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.304+0000 7fee5d7fa700 1 -- 172.21.15.92:0/2647532909 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fee6404a2f0 con 0x7fee680a3030 2023-09-29T23:28:41.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.304+0000 7fee6cb1c700 1 --2- 172.21.15.92:0/2647532909 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fee4c035640 0x7fee4c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:41.308 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.305+0000 7fee6cb1c700 1 --2- 172.21.15.92:0/2647532909 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fee4c035640 0x7fee4c037af0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fee580016a0 tx=0x7fee58007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:41.309 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.309+0000 7fee5d7fa700 1 -- 172.21.15.92:0/2647532909 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee6401cd80 con 0x7fee680a3030 2023-09-29T23:28:41.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.536+0000 7fee6f581700 1 -- 172.21.15.92:0/2647532909 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fee6805f230 con 0x7fee680a3030 2023-09-29T23:28:41.536 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.536+0000 7fee5d7fa700 1 -- 172.21.15.92:0/2647532909 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fee6401cba0 con 0x7fee680a3030 2023-09-29T23:28:41.536 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:41.536 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:28:41.538 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.538+0000 7fee6f581700 1 -- 172.21.15.92:0/2647532909 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fee4c035640 msgr2=0x7fee4c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:41.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.538+0000 7fee6f581700 1 --2- 172.21.15.92:0/2647532909 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fee4c035640 0x7fee4c037af0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fee580016a0 tx=0x7fee58007b30 comp rx=0 tx=0).stop 2023-09-29T23:28:41.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.538+0000 7fee6f581700 1 -- 172.21.15.92:0/2647532909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee680a3030 msgr2=0x7fee6812c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:41.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.538+0000 7fee6f581700 1 --2- 172.21.15.92:0/2647532909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee680a3030 0x7fee6812c400 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fee640099f0 tx=0x7fee64018000 comp rx=0 tx=0).stop 2023-09-29T23:28:41.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.538+0000 7fee6f581700 1 -- 172.21.15.92:0/2647532909 shutdown_connections 2023-09-29T23:28:41.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.538+0000 7fee6f581700 1 --2- 172.21.15.92:0/2647532909 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fee4c035640 0x7fee4c037af0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:41.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.538+0000 7fee6f581700 1 --2- 172.21.15.92:0/2647532909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee680a3030 0x7fee6812c400 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:41.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.538+0000 7fee6f581700 1 -- 172.21.15.92:0/2647532909 >> 172.21.15.92:0/2647532909 conn(0x7fee68067fc0 msgr2=0x7fee6812d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:41.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.538+0000 7fee6f581700 1 -- 172.21.15.92:0/2647532909 shutdown_connections 2023-09-29T23:28:41.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:41.538+0000 7fee6f581700 1 -- 172.21.15.92:0/2647532909 wait complete. 2023-09-29T23:28:44.550 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:28:44.668 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.668+0000 7f599507f700 1 Processor -- start 2023-09-29T23:28:44.669 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.668+0000 7f599507f700 1 -- start start 2023-09-29T23:28:44.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.669+0000 7f599507f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f599006f210 0x7f5990069930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:44.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.669+0000 7f599507f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5990069620 con 0x7f599009b890 2023-09-29T23:28:44.670 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.669+0000 7f599507f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599006f5e0 con 0x7f599006f210 2023-09-29T23:28:44.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.669+0000 7f598ed9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f599006f210 0x7f5990069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:44.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.669+0000 7f598659c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f599009b890 0x7f5990069e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:59242/0 (socket says 172.21.15.92:59242) 2023-09-29T23:28:44.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.669+0000 7f598659c700 1 -- 172.21.15.92:0/1916466195 learned_addr learned my addr 172.21.15.92:0/1916466195 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:44.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.669+0000 7f598ed9d700 1 -- 172.21.15.92:0/1916466195 >> v1:172.21.15.92:6789/0 conn(0x7f599009b890 legacy=0x7f5990069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:44.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.669+0000 7f598ed9d700 1 -- 172.21.15.92:0/1916466195 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599009cc70 con 0x7f599006f210 2023-09-29T23:28:44.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.669+0000 7f598e59c700 1 -- 172.21.15.92:0/1916466195 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784396034 0 0) 0x7f5990069620 con 0x7f599009b890 2023-09-29T23:28:44.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.669+0000 7f598ed9d700 1 --2- 172.21.15.92:0/1916466195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f599006f210 0x7f5990069930 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5980009850 tx=0x7f5980009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1ec8f3b7bb606a server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:44.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.669+0000 7f598e59c700 1 -- 172.21.15.92:0/1916466195 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5980005d50 con 0x7f599006f210 2023-09-29T23:28:44.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.670+0000 7f598e59c700 1 -- 172.21.15.92:0/1916466195 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5980006030 con 0x7f599006f210 2023-09-29T23:28:44.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.670+0000 7f598e59c700 1 -- 172.21.15.92:0/1916466195 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5980006300 con 0x7f599006f210 2023-09-29T23:28:44.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.670+0000 7f599507f700 1 -- 172.21.15.92:0/1916466195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f599006f210 msgr2=0x7f5990069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:44.671 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.670+0000 7f599507f700 1 --2- 172.21.15.92:0/1916466195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f599006f210 0x7f5990069930 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5980009850 tx=0x7f5980009120 comp rx=0 tx=0).stop 2023-09-29T23:28:44.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.670+0000 7f599507f700 1 -- 172.21.15.92:0/1916466195 shutdown_connections 2023-09-29T23:28:44.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.670+0000 7f599507f700 1 --2- 172.21.15.92:0/1916466195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f599006f210 0x7f5990069930 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:44.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.670+0000 7f599507f700 1 -- 172.21.15.92:0/1916466195 >> 172.21.15.92:0/1916466195 conn(0x7f5990094a70 msgr2=0x7f599006eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:44.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.670+0000 7f599507f700 1 -- 172.21.15.92:0/1916466195 shutdown_connections 2023-09-29T23:28:44.672 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.670+0000 7f599507f700 1 -- 172.21.15.92:0/1916466195 wait complete. 2023-09-29T23:28:44.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.671+0000 7f599507f700 1 Processor -- start 2023-09-29T23:28:44.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.671+0000 7f599507f700 1 -- start start 2023-09-29T23:28:44.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.671+0000 7f599507f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f599006f210 0x7f599012bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:44.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.671+0000 7f599507f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599011eaf0 con 0x7f599006f210 2023-09-29T23:28:44.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.671+0000 7f598ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f599006f210 0x7f599012bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:44.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.671+0000 7f598ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f599006f210 0x7f599012bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47652/0 (socket says 172.21.15.92:47652) 2023-09-29T23:28:44.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.671+0000 7f598ed9d700 1 -- 172.21.15.92:0/365909465 learned_addr learned my addr 172.21.15.92:0/365909465 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:44.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.672+0000 7f598ed9d700 1 -- 172.21.15.92:0/365909465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59800093c0 con 0x7f599006f210 2023-09-29T23:28:44.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.672+0000 7f598ed9d700 1 --2- 172.21.15.92:0/365909465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f599006f210 0x7f599012bff0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5980009390 tx=0x7f5980015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:44.674 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.672+0000 7f59877fe700 1 -- 172.21.15.92:0/365909465 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f598000bb00 con 0x7f599006f210 2023-09-29T23:28:44.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.672+0000 7f59877fe700 1 -- 172.21.15.92:0/365909465 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598000bc60 con 0x7f599006f210 2023-09-29T23:28:44.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.672+0000 7f599507f700 1 -- 172.21.15.92:0/365909465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599012cdd0 con 0x7f599006f210 2023-09-29T23:28:44.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.672+0000 7f59877fe700 1 -- 172.21.15.92:0/365909465 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f598001c450 con 0x7f599006f210 2023-09-29T23:28:44.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.672+0000 7f599507f700 1 -- 172.21.15.92:0/365909465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599011e350 con 0x7f599006f210 2023-09-29T23:28:44.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.673+0000 7f59877fe700 1 -- 172.21.15.92:0/365909465 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f5980023030 con 0x7f599006f210 2023-09-29T23:28:44.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.673+0000 7f599507f700 1 -- 172.21.15.92:0/365909465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599011e540 con 0x7f599006f210 2023-09-29T23:28:44.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.673+0000 7f59877fe700 1 --2- 172.21.15.92:0/365909465 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f59700355f0 0x7f5970037aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:44.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.673+0000 7f59877fe700 1 -- 172.21.15.92:0/365909465 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f5980049650 con 0x7f599006f210 2023-09-29T23:28:44.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.673+0000 7f598659c700 1 --2- 172.21.15.92:0/365909465 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f59700355f0 0x7f5970037aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:44.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.674+0000 7f598659c700 1 --2- 172.21.15.92:0/365909465 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f59700355f0 0x7f5970037aa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f59780011e0 tx=0x7f59780079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:44.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.677+0000 7f59877fe700 1 -- 172.21.15.92:0/365909465 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5980010950 con 0x7f599006f210 2023-09-29T23:28:44.899 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.899+0000 7f599507f700 1 -- 172.21.15.92:0/365909465 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f599005f230 con 0x7f599006f210 2023-09-29T23:28:44.900 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.899+0000 7f59877fe700 1 -- 172.21.15.92:0/365909465 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f5980010380 con 0x7f599006f210 2023-09-29T23:28:44.900 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:44.900 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:28:44.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.901+0000 7f599507f700 1 -- 172.21.15.92:0/365909465 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f59700355f0 msgr2=0x7f5970037aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:44.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.901+0000 7f599507f700 1 --2- 172.21.15.92:0/365909465 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f59700355f0 0x7f5970037aa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f59780011e0 tx=0x7f59780079d0 comp rx=0 tx=0).stop 2023-09-29T23:28:44.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.901+0000 7f599507f700 1 -- 172.21.15.92:0/365909465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f599006f210 msgr2=0x7f599012bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:44.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.901+0000 7f599507f700 1 --2- 172.21.15.92:0/365909465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f599006f210 0x7f599012bff0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5980009390 tx=0x7f5980015000 comp rx=0 tx=0).stop 2023-09-29T23:28:44.901 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.901+0000 7f599507f700 1 -- 172.21.15.92:0/365909465 shutdown_connections 2023-09-29T23:28:44.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.901+0000 7f599507f700 1 --2- 172.21.15.92:0/365909465 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f59700355f0 0x7f5970037aa0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:44.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.901+0000 7f599507f700 1 --2- 172.21.15.92:0/365909465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f599006f210 0x7f599012bff0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:44.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.901+0000 7f599507f700 1 -- 172.21.15.92:0/365909465 >> 172.21.15.92:0/365909465 conn(0x7f5990094a70 msgr2=0x7f599006da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:44.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.901+0000 7f599507f700 1 -- 172.21.15.92:0/365909465 shutdown_connections 2023-09-29T23:28:44.902 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:44.901+0000 7f599507f700 1 -- 172.21.15.92:0/365909465 wait complete. 2023-09-29T23:28:47.913 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:28:48.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.039+0000 7f477ddc6700 1 Processor -- start 2023-09-29T23:28:48.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.039+0000 7f477ddc6700 1 -- start start 2023-09-29T23:28:48.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.040+0000 7f477ddc6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f477809fd80 0x7f47780a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:48.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.040+0000 7f477ddc6700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4778098710 con 0x7f477812f8b0 2023-09-29T23:28:48.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.040+0000 7f477ddc6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477812f340 con 0x7f477809fd80 2023-09-29T23:28:48.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.040+0000 7f47777fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f477809fd80 0x7f47780a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:48.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.040+0000 7f4776ffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f477812f8b0 0x7f4778095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:59246/0 (socket says 172.21.15.92:59246) 2023-09-29T23:28:48.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.040+0000 7f4776ffd700 1 -- 172.21.15.92:0/3396730788 learned_addr learned my addr 172.21.15.92:0/3396730788 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:48.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.040+0000 7f47777fe700 1 -- 172.21.15.92:0/3396730788 >> v1:172.21.15.92:6789/0 conn(0x7f477812f8b0 legacy=0x7f4778095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:48.041 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.040+0000 7f47777fe700 1 -- 172.21.15.92:0/3396730788 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47780997e0 con 0x7f477809fd80 2023-09-29T23:28:48.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.040+0000 7f47777fe700 1 --2- 172.21.15.92:0/3396730788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477809fd80 0x7f47780a3090 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4768009de0 tx=0x7f4768009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05e08aad9a168a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:48.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.041+0000 7f47767fc700 1 -- 172.21.15.92:0/3396730788 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f476800e070 con 0x7f477809fd80 2023-09-29T23:28:48.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.041+0000 7f47767fc700 1 -- 172.21.15.92:0/3396730788 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476800bc80 con 0x7f477809fd80 2023-09-29T23:28:48.042 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.041+0000 7f47767fc700 1 -- 172.21.15.92:0/3396730788 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4768012430 con 0x7f477809fd80 2023-09-29T23:28:48.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.041+0000 7f477ddc6700 1 -- 172.21.15.92:0/3396730788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477809fd80 msgr2=0x7f47780a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:48.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.041+0000 7f477ddc6700 1 --2- 172.21.15.92:0/3396730788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477809fd80 0x7f47780a3090 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4768009de0 tx=0x7f4768009780 comp rx=0 tx=0).stop 2023-09-29T23:28:48.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.041+0000 7f477ddc6700 1 -- 172.21.15.92:0/3396730788 shutdown_connections 2023-09-29T23:28:48.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.041+0000 7f477ddc6700 1 --2- 172.21.15.92:0/3396730788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477809fd80 0x7f47780a3090 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:48.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.041+0000 7f477ddc6700 1 -- 172.21.15.92:0/3396730788 >> 172.21.15.92:0/3396730788 conn(0x7f4778068000 msgr2=0x7f47780a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:48.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.041+0000 7f477ddc6700 1 -- 172.21.15.92:0/3396730788 shutdown_connections 2023-09-29T23:28:48.044 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.041+0000 7f477ddc6700 1 -- 172.21.15.92:0/3396730788 wait complete. 2023-09-29T23:28:48.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.042+0000 7f477ddc6700 1 Processor -- start 2023-09-29T23:28:48.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.042+0000 7f477ddc6700 1 -- start start 2023-09-29T23:28:48.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.043+0000 7f477ddc6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477809fd80 0x7f4778119fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:48.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.043+0000 7f477ddc6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477811e610 con 0x7f477809fd80 2023-09-29T23:28:48.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.043+0000 7f47777fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477809fd80 0x7f4778119fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:48.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.043+0000 7f47777fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477809fd80 0x7f4778119fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47670/0 (socket says 172.21.15.92:47670) 2023-09-29T23:28:48.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.043+0000 7f47777fe700 1 -- 172.21.15.92:0/3026374054 learned_addr learned my addr 172.21.15.92:0/3026374054 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:48.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.043+0000 7f47777fe700 1 -- 172.21.15.92:0/3026374054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4768009a20 con 0x7f477809fd80 2023-09-29T23:28:48.045 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.043+0000 7f47777fe700 1 --2- 172.21.15.92:0/3026374054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477809fd80 0x7f4778119fa0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f47680099f0 tx=0x7f4768018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:48.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.043+0000 7f475f7fe700 1 -- 172.21.15.92:0/3026374054 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4768027470 con 0x7f477809fd80 2023-09-29T23:28:48.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.043+0000 7f475f7fe700 1 -- 172.21.15.92:0/3026374054 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47680275d0 con 0x7f477809fd80 2023-09-29T23:28:48.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.043+0000 7f475f7fe700 1 -- 172.21.15.92:0/3026374054 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f47680278c0 con 0x7f477809fd80 2023-09-29T23:28:48.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.043+0000 7f477ddc6700 1 -- 172.21.15.92:0/3026374054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477811ba50 con 0x7f477809fd80 2023-09-29T23:28:48.046 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.043+0000 7f477ddc6700 1 -- 172.21.15.92:0/3026374054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477811d460 con 0x7f477809fd80 2023-09-29T23:28:48.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.044+0000 7f475f7fe700 1 -- 172.21.15.92:0/3026374054 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f4768024070 con 0x7f477809fd80 2023-09-29T23:28:48.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.044+0000 7f477ddc6700 1 -- 172.21.15.92:0/3026374054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477805f230 con 0x7f477809fd80 2023-09-29T23:28:48.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.044+0000 7f475f7fe700 1 --2- 172.21.15.92:0/3026374054 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4764035640 0x7f4764037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:48.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.045+0000 7f475f7fe700 1 -- 172.21.15.92:0/3026374054 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f4768049cc0 con 0x7f477809fd80 2023-09-29T23:28:48.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.045+0000 7f4776ffd700 1 --2- 172.21.15.92:0/3026374054 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4764035640 0x7f4764037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:48.047 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.045+0000 7f4776ffd700 1 --2- 172.21.15.92:0/3026374054 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4764035640 0x7f4764037af0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f476c0016a0 tx=0x7f476c007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:48.049 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.049+0000 7f475f7fe700 1 -- 172.21.15.92:0/3026374054 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f476801d950 con 0x7f477809fd80 2023-09-29T23:28:48.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.269+0000 7f477ddc6700 1 -- 172.21.15.92:0/3026374054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f477804bb40 con 0x7f477809fd80 2023-09-29T23:28:48.270 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.270+0000 7f475f7fe700 1 -- 172.21.15.92:0/3026374054 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f476801cba0 con 0x7f477809fd80 2023-09-29T23:28:48.271 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:48.271 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:28:48.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.272+0000 7f477ddc6700 1 -- 172.21.15.92:0/3026374054 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4764035640 msgr2=0x7f4764037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:48.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.272+0000 7f477ddc6700 1 --2- 172.21.15.92:0/3026374054 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4764035640 0x7f4764037af0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f476c0016a0 tx=0x7f476c007b30 comp rx=0 tx=0).stop 2023-09-29T23:28:48.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.272+0000 7f477ddc6700 1 -- 172.21.15.92:0/3026374054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477809fd80 msgr2=0x7f4778119fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:48.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.272+0000 7f477ddc6700 1 --2- 172.21.15.92:0/3026374054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477809fd80 0x7f4778119fa0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f47680099f0 tx=0x7f4768018000 comp rx=0 tx=0).stop 2023-09-29T23:28:48.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.272+0000 7f477ddc6700 1 -- 172.21.15.92:0/3026374054 shutdown_connections 2023-09-29T23:28:48.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.272+0000 7f477ddc6700 1 --2- 172.21.15.92:0/3026374054 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4764035640 0x7f4764037af0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:48.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.272+0000 7f477ddc6700 1 --2- 172.21.15.92:0/3026374054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477809fd80 0x7f4778119fa0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:48.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.272+0000 7f477ddc6700 1 -- 172.21.15.92:0/3026374054 >> 172.21.15.92:0/3026374054 conn(0x7f4778068000 msgr2=0x7f4778094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:48.274 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.272+0000 7f477ddc6700 1 -- 172.21.15.92:0/3026374054 shutdown_connections 2023-09-29T23:28:48.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:48.272+0000 7f477ddc6700 1 -- 172.21.15.92:0/3026374054 wait complete. 2023-09-29T23:28:51.285 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:28:51.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.403+0000 7f730407d700 1 Processor -- start 2023-09-29T23:28:51.404 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.403+0000 7f730407d700 1 -- start start 2023-09-29T23:28:51.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.404+0000 7f730407d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f72fc0a2e30 0x7f72fc12f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:51.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.404+0000 7f730407d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72fc097ff0 con 0x7f72fc12fa40 2023-09-29T23:28:51.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.404+0000 7f730407d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72fc0a3200 con 0x7f72fc0a2e30 2023-09-29T23:28:51.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.404+0000 7f7301e19700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f72fc0a2e30 0x7f72fc12f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:51.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.404+0000 7f7301618700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f72fc12fa40 0x7f72fc095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:36656/0 (socket says 172.21.15.92:36656) 2023-09-29T23:28:51.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.404+0000 7f7301618700 1 -- 172.21.15.92:0/2709946865 learned_addr learned my addr 172.21.15.92:0/2709946865 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:51.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.404+0000 7f7301e19700 1 -- 172.21.15.92:0/2709946865 >> v1:172.21.15.92:6789/0 conn(0x7f72fc12fa40 legacy=0x7f72fc095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:51.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.404+0000 7f7301e19700 1 -- 172.21.15.92:0/2709946865 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc12f260 con 0x7f72fc0a2e30 2023-09-29T23:28:51.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.404+0000 7f7300e17700 1 -- 172.21.15.92:0/2709946865 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635534929 0 0) 0x7f72fc097ff0 con 0x7f72fc12fa40 2023-09-29T23:28:51.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.404+0000 7f7301e19700 1 --2- 172.21.15.92:0/2709946865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72fc0a2e30 0x7f72fc12f500 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009860 tx=0x7f72f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a8ec9661e8ddf0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:51.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.404+0000 7f7300e17700 1 -- 172.21.15.92:0/2709946865 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72f800b680 con 0x7f72fc0a2e30 2023-09-29T23:28:51.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.404+0000 7f7300e17700 1 -- 172.21.15.92:0/2709946865 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f800b7e0 con 0x7f72fc0a2e30 2023-09-29T23:28:51.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.404+0000 7f7300e17700 1 -- 172.21.15.92:0/2709946865 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72f800bad0 con 0x7f72fc0a2e30 2023-09-29T23:28:51.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.405+0000 7f730407d700 1 -- 172.21.15.92:0/2709946865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72fc0a2e30 msgr2=0x7f72fc12f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:51.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.405+0000 7f730407d700 1 --2- 172.21.15.92:0/2709946865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72fc0a2e30 0x7f72fc12f500 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009860 tx=0x7f72f80091a0 comp rx=0 tx=0).stop 2023-09-29T23:28:51.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.405+0000 7f730407d700 1 -- 172.21.15.92:0/2709946865 shutdown_connections 2023-09-29T23:28:51.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.405+0000 7f730407d700 1 --2- 172.21.15.92:0/2709946865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72fc0a2e30 0x7f72fc12f500 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:51.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.405+0000 7f730407d700 1 -- 172.21.15.92:0/2709946865 >> 172.21.15.92:0/2709946865 conn(0x7f72fc067bf0 msgr2=0x7f72fc0a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:51.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.405+0000 7f730407d700 1 -- 172.21.15.92:0/2709946865 shutdown_connections 2023-09-29T23:28:51.408 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.405+0000 7f730407d700 1 -- 172.21.15.92:0/2709946865 wait complete. 2023-09-29T23:28:51.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.406+0000 7f730407d700 1 Processor -- start 2023-09-29T23:28:51.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.406+0000 7f730407d700 1 -- start start 2023-09-29T23:28:51.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.406+0000 7f730407d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72fc0a2e30 0x7f72fc12bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:51.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.406+0000 7f730407d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc11eac0 con 0x7f72fc0a2e30 2023-09-29T23:28:51.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.406+0000 7f7301e19700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72fc0a2e30 0x7f72fc12bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:51.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.406+0000 7f7301e19700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72fc0a2e30 0x7f72fc12bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33336/0 (socket says 172.21.15.92:33336) 2023-09-29T23:28:51.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.406+0000 7f7301e19700 1 -- 172.21.15.92:0/2083188120 learned_addr learned my addr 172.21.15.92:0/2083188120 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:51.410 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.407+0000 7f7301e19700 1 -- 172.21.15.92:0/2083188120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f8009420 con 0x7f72fc0a2e30 2023-09-29T23:28:51.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.407+0000 7f7301e19700 1 --2- 172.21.15.92:0/2083188120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72fc0a2e30 0x7f72fc12bfc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f72f8000c00 tx=0x7f72f8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:51.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.407+0000 7f72f1ffb700 1 -- 172.21.15.92:0/2083188120 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72f8011d30 con 0x7f72fc0a2e30 2023-09-29T23:28:51.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.407+0000 7f72f1ffb700 1 -- 172.21.15.92:0/2083188120 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8020070 con 0x7f72fc0a2e30 2023-09-29T23:28:51.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.407+0000 7f730407d700 1 -- 172.21.15.92:0/2083188120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc11e7b0 con 0x7f72fc0a2e30 2023-09-29T23:28:51.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.407+0000 7f72f1ffb700 1 -- 172.21.15.92:0/2083188120 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72f801b450 con 0x7f72fc0a2e30 2023-09-29T23:28:51.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.407+0000 7f730407d700 1 -- 172.21.15.92:0/2083188120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72fc11c4d0 con 0x7f72fc0a2e30 2023-09-29T23:28:51.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.408+0000 7f72f1ffb700 1 -- 172.21.15.92:0/2083188120 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f72f8022030 con 0x7f72fc0a2e30 2023-09-29T23:28:51.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.408+0000 7f730407d700 1 -- 172.21.15.92:0/2083188120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72fc05f230 con 0x7f72fc0a2e30 2023-09-29T23:28:51.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.408+0000 7f72f1ffb700 1 --2- 172.21.15.92:0/2083188120 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f72e0035640 0x7f72e0037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:51.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.408+0000 7f72f1ffb700 1 -- 172.21.15.92:0/2083188120 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f72f8049340 con 0x7f72fc0a2e30 2023-09-29T23:28:51.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.408+0000 7f7301618700 1 --2- 172.21.15.92:0/2083188120 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f72e0035640 0x7f72e0037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:51.411 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.409+0000 7f7301618700 1 --2- 172.21.15.92:0/2083188120 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f72e0035640 0x7f72e0037af0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0011e0 tx=0x7f72ec0079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:51.414 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.413+0000 7f72f1ffb700 1 -- 172.21.15.92:0/2083188120 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72f8024790 con 0x7f72fc0a2e30 2023-09-29T23:28:51.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.632+0000 7f730407d700 1 -- 172.21.15.92:0/2083188120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f72fc04bb40 con 0x7f72fc0a2e30 2023-09-29T23:28:51.634 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.633+0000 7f72f1ffb700 1 -- 172.21.15.92:0/2083188120 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f72f80243d0 con 0x7f72fc0a2e30 2023-09-29T23:28:51.635 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:51.635 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:28:51.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.635+0000 7f730407d700 1 -- 172.21.15.92:0/2083188120 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f72e0035640 msgr2=0x7f72e0037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:51.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.635+0000 7f730407d700 1 --2- 172.21.15.92:0/2083188120 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f72e0035640 0x7f72e0037af0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0011e0 tx=0x7f72ec0079d0 comp rx=0 tx=0).stop 2023-09-29T23:28:51.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.635+0000 7f730407d700 1 -- 172.21.15.92:0/2083188120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72fc0a2e30 msgr2=0x7f72fc12bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:51.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.635+0000 7f730407d700 1 --2- 172.21.15.92:0/2083188120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72fc0a2e30 0x7f72fc12bfc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f72f8000c00 tx=0x7f72f8016000 comp rx=0 tx=0).stop 2023-09-29T23:28:51.636 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.635+0000 7f730407d700 1 -- 172.21.15.92:0/2083188120 shutdown_connections 2023-09-29T23:28:51.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.635+0000 7f730407d700 1 --2- 172.21.15.92:0/2083188120 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f72e0035640 0x7f72e0037af0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:51.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.635+0000 7f730407d700 1 --2- 172.21.15.92:0/2083188120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72fc0a2e30 0x7f72fc12bfc0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:51.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.635+0000 7f730407d700 1 -- 172.21.15.92:0/2083188120 >> 172.21.15.92:0/2083188120 conn(0x7f72fc067bf0 msgr2=0x7f72fc094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:51.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.635+0000 7f730407d700 1 -- 172.21.15.92:0/2083188120 shutdown_connections 2023-09-29T23:28:51.637 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:51.635+0000 7f730407d700 1 -- 172.21.15.92:0/2083188120 wait complete. 2023-09-29T23:28:54.648 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:28:54.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.777+0000 7f0c4d0ae700 1 Processor -- start 2023-09-29T23:28:54.778 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.777+0000 7f0c4d0ae700 1 -- start start 2023-09-29T23:28:54.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.777+0000 7f0c4d0ae700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0c480a3030 0x7f0c4812f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:54.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.777+0000 7f0c4d0ae700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c480997f0 con 0x7f0c4812fae0 2023-09-29T23:28:54.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.777+0000 7f0c4d0ae700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c480a3400 con 0x7f0c480a3030 2023-09-29T23:28:54.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.778+0000 7f0c46d9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0c480a3030 0x7f0c4812f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:54.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.778+0000 7f0c3e59c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f0c4812fae0 0x7f0c48095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:36658/0 (socket says 172.21.15.92:36658) 2023-09-29T23:28:54.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.778+0000 7f0c3e59c700 1 -- 172.21.15.92:0/3262315371 learned_addr learned my addr 172.21.15.92:0/3262315371 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:54.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.778+0000 7f0c46d9d700 1 -- 172.21.15.92:0/3262315371 >> v1:172.21.15.92:6789/0 conn(0x7f0c4812fae0 legacy=0x7f0c48095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:54.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.778+0000 7f0c46d9d700 1 -- 172.21.15.92:0/3262315371 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c480977a0 con 0x7f0c480a3030 2023-09-29T23:28:54.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.778+0000 7f0c4659c700 1 -- 172.21.15.92:0/3262315371 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816089705 0 0) 0x7f0c480997f0 con 0x7f0c4812fae0 2023-09-29T23:28:54.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.778+0000 7f0c46d9d700 1 --2- 172.21.15.92:0/3262315371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c480a3030 0x7f0c4812f5a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009860 tx=0x7f0c380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ccf0b0ce6a884a server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:54.779 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.778+0000 7f0c4659c700 1 -- 172.21.15.92:0/3262315371 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c3800b710 con 0x7f0c480a3030 2023-09-29T23:28:54.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.778+0000 7f0c4659c700 1 -- 172.21.15.92:0/3262315371 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3800b870 con 0x7f0c480a3030 2023-09-29T23:28:54.780 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.778+0000 7f0c4659c700 1 -- 172.21.15.92:0/3262315371 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c3800ba20 con 0x7f0c480a3030 2023-09-29T23:28:54.781 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.779+0000 7f0c4d0ae700 1 -- 172.21.15.92:0/3262315371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c480a3030 msgr2=0x7f0c4812f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:54.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.779+0000 7f0c4d0ae700 1 --2- 172.21.15.92:0/3262315371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c480a3030 0x7f0c4812f5a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009860 tx=0x7f0c380091a0 comp rx=0 tx=0).stop 2023-09-29T23:28:54.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.779+0000 7f0c4d0ae700 1 -- 172.21.15.92:0/3262315371 shutdown_connections 2023-09-29T23:28:54.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.779+0000 7f0c4d0ae700 1 --2- 172.21.15.92:0/3262315371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c480a3030 0x7f0c4812f5a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:54.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.779+0000 7f0c4d0ae700 1 -- 172.21.15.92:0/3262315371 >> 172.21.15.92:0/3262315371 conn(0x7f0c48067fc0 msgr2=0x7f0c480a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:54.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.779+0000 7f0c4d0ae700 1 -- 172.21.15.92:0/3262315371 shutdown_connections 2023-09-29T23:28:54.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.779+0000 7f0c4d0ae700 1 -- 172.21.15.92:0/3262315371 wait complete. 2023-09-29T23:28:54.782 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.780+0000 7f0c4d0ae700 1 Processor -- start 2023-09-29T23:28:54.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.780+0000 7f0c4d0ae700 1 -- start start 2023-09-29T23:28:54.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.780+0000 7f0c4d0ae700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c480a3030 0x7f0c4813e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:54.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.780+0000 7f0c4d0ae700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4811e850 con 0x7f0c480a3030 2023-09-29T23:28:54.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.780+0000 7f0c46d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c480a3030 0x7f0c4813e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:54.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.780+0000 7f0c46d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c480a3030 0x7f0c4813e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33362/0 (socket says 172.21.15.92:33362) 2023-09-29T23:28:54.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.780+0000 7f0c46d9d700 1 -- 172.21.15.92:0/3639138275 learned_addr learned my addr 172.21.15.92:0/3639138275 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:54.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.781+0000 7f0c46d9d700 1 -- 172.21.15.92:0/3639138275 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c38009420 con 0x7f0c480a3030 2023-09-29T23:28:54.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.781+0000 7f0c46d9d700 1 --2- 172.21.15.92:0/3639138275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c480a3030 0x7f0c4813e4d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0c38000c00 tx=0x7f0c38016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:54.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.781+0000 7f0c3f7fe700 1 -- 172.21.15.92:0/3639138275 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c38011d30 con 0x7f0c480a3030 2023-09-29T23:28:54.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.781+0000 7f0c3f7fe700 1 -- 172.21.15.92:0/3639138275 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c38020070 con 0x7f0c480a3030 2023-09-29T23:28:54.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.781+0000 7f0c3f7fe700 1 -- 172.21.15.92:0/3639138275 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c3801b450 con 0x7f0c480a3030 2023-09-29T23:28:54.783 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.781+0000 7f0c4d0ae700 1 -- 172.21.15.92:0/3639138275 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4811e540 con 0x7f0c480a3030 2023-09-29T23:28:54.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.781+0000 7f0c4d0ae700 1 -- 172.21.15.92:0/3639138275 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4811dcb0 con 0x7f0c480a3030 2023-09-29T23:28:54.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.782+0000 7f0c3f7fe700 1 -- 172.21.15.92:0/3639138275 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f0c38022030 con 0x7f0c480a3030 2023-09-29T23:28:54.784 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.782+0000 7f0c4d0ae700 1 -- 172.21.15.92:0/3639138275 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4811e2e0 con 0x7f0c480a3030 2023-09-29T23:28:54.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.782+0000 7f0c3f7fe700 1 --2- 172.21.15.92:0/3639138275 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0c28035640 0x7f0c28037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:54.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.782+0000 7f0c3f7fe700 1 -- 172.21.15.92:0/3639138275 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f0c38049440 con 0x7f0c480a3030 2023-09-29T23:28:54.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.782+0000 7f0c3e59c700 1 --2- 172.21.15.92:0/3639138275 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0c28035640 0x7f0c28037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:54.785 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.783+0000 7f0c3e59c700 1 --2- 172.21.15.92:0/3639138275 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0c28035640 0x7f0c28037af0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0c300011e0 tx=0x7f0c300079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:54.787 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:54.787+0000 7f0c3f7fe700 1 -- 172.21.15.92:0/3639138275 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c38006cb0 con 0x7f0c480a3030 2023-09-29T23:28:55.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:55.010+0000 7f0c4d0ae700 1 -- 172.21.15.92:0/3639138275 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0c4805f230 con 0x7f0c480a3030 2023-09-29T23:28:55.010 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:55.010+0000 7f0c3f7fe700 1 -- 172.21.15.92:0/3639138275 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f0c3801a3d0 con 0x7f0c480a3030 2023-09-29T23:28:55.010 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:55.010 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:28:55.012 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:55.012+0000 7f0c4d0ae700 1 -- 172.21.15.92:0/3639138275 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0c28035640 msgr2=0x7f0c28037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:55.012+0000 7f0c4d0ae700 1 --2- 172.21.15.92:0/3639138275 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0c28035640 0x7f0c28037af0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0c300011e0 tx=0x7f0c300079d0 comp rx=0 tx=0).stop 2023-09-29T23:28:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:55.012+0000 7f0c4d0ae700 1 -- 172.21.15.92:0/3639138275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c480a3030 msgr2=0x7f0c4813e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:55.012+0000 7f0c4d0ae700 1 --2- 172.21.15.92:0/3639138275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c480a3030 0x7f0c4813e4d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0c38000c00 tx=0x7f0c38016000 comp rx=0 tx=0).stop 2023-09-29T23:28:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:55.012+0000 7f0c4d0ae700 1 -- 172.21.15.92:0/3639138275 shutdown_connections 2023-09-29T23:28:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:55.012+0000 7f0c4d0ae700 1 --2- 172.21.15.92:0/3639138275 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f0c28035640 0x7f0c28037af0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:55.012+0000 7f0c4d0ae700 1 --2- 172.21.15.92:0/3639138275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c480a3030 0x7f0c4813e4d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:55.012+0000 7f0c4d0ae700 1 -- 172.21.15.92:0/3639138275 >> 172.21.15.92:0/3639138275 conn(0x7f0c48067fc0 msgr2=0x7f0c4812d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:55.012+0000 7f0c4d0ae700 1 -- 172.21.15.92:0/3639138275 shutdown_connections 2023-09-29T23:28:55.013 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:55.012+0000 7f0c4d0ae700 1 -- 172.21.15.92:0/3639138275 wait complete. 2023-09-29T23:28:58.025 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-29T23:28:58.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.146+0000 7f5cef449700 1 Processor -- start 2023-09-29T23:28:58.147 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.147+0000 7f5cef449700 1 -- start start 2023-09-29T23:28:58.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.147+0000 7f5cef449700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5ce8096e80 0x7f5ce8134750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:58.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.147+0000 7f5cef449700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce809c930 con 0x7f5ce8067eb0 2023-09-29T23:28:58.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.147+0000 7f5cef449700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce8095360 con 0x7f5ce8096e80 2023-09-29T23:28:58.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.147+0000 7f5ced1e5700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f5ce8067eb0 0x7f5ce8096770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:36662/0 (socket says 172.21.15.92:36662) 2023-09-29T23:28:58.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.147+0000 7f5ced1e5700 1 -- 172.21.15.92:0/475149322 learned_addr learned my addr 172.21.15.92:0/475149322 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:58.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.147+0000 7f5cec9e4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5ce8096e80 0x7f5ce8134750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:58.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.148+0000 7f5cdffff700 1 -- 172.21.15.92:0/475149322 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767705594 0 0) 0x7f5ce809c930 con 0x7f5ce8067eb0 2023-09-29T23:28:58.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.148+0000 7f5cdffff700 1 -- 172.21.15.92:0/475149322 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cd4003570 con 0x7f5ce8067eb0 2023-09-29T23:28:58.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.148+0000 7f5cec9e4700 1 -- 172.21.15.92:0/475149322 >> v1:172.21.15.92:6789/0 conn(0x7f5ce8067eb0 legacy=0x7f5ce8096770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:58.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.148+0000 7f5cec9e4700 1 -- 172.21.15.92:0/475149322 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce80687f0 con 0x7f5ce8096e80 2023-09-29T23:28:58.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.148+0000 7f5cec9e4700 1 --2- 172.21.15.92:0/475149322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ce8096e80 0x7f5ce8134750 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009860 tx=0x7f5cd80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef66ade93eb0480d server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:58.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.148+0000 7f5cdffff700 1 -- 172.21.15.92:0/475149322 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cd8011630 con 0x7f5ce8096e80 2023-09-29T23:28:58.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.148+0000 7f5cdffff700 1 -- 172.21.15.92:0/475149322 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd8011790 con 0x7f5ce8096e80 2023-09-29T23:28:58.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.148+0000 7f5cdffff700 1 -- 172.21.15.92:0/475149322 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cd8011920 con 0x7f5ce8096e80 2023-09-29T23:28:58.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.148+0000 7f5cef449700 1 -- 172.21.15.92:0/475149322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ce8096e80 msgr2=0x7f5ce8134750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:58.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.148+0000 7f5cef449700 1 --2- 172.21.15.92:0/475149322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ce8096e80 0x7f5ce8134750 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009860 tx=0x7f5cd80091a0 comp rx=0 tx=0).stop 2023-09-29T23:28:58.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.149+0000 7f5cef449700 1 -- 172.21.15.92:0/475149322 shutdown_connections 2023-09-29T23:28:58.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.149+0000 7f5cef449700 1 --2- 172.21.15.92:0/475149322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ce8096e80 0x7f5ce8134750 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:58.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.149+0000 7f5cef449700 1 -- 172.21.15.92:0/475149322 >> 172.21.15.92:0/475149322 conn(0x7f5ce806bbd0 msgr2=0x7f5ce806dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:58.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.149+0000 7f5cef449700 1 -- 172.21.15.92:0/475149322 shutdown_connections 2023-09-29T23:28:58.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.149+0000 7f5cef449700 1 -- 172.21.15.92:0/475149322 wait complete. 2023-09-29T23:28:58.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.149+0000 7f5cef449700 1 Processor -- start 2023-09-29T23:28:58.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.149+0000 7f5cef449700 1 -- start start 2023-09-29T23:28:58.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.150+0000 7f5cef449700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ce8067eb0 0x7f5ce8128d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:58.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.150+0000 7f5cef449700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce811b650 con 0x7f5ce8067eb0 2023-09-29T23:28:58.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.150+0000 7f5ced1e5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ce8067eb0 0x7f5ce8128d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:58.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.150+0000 7f5ced1e5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ce8067eb0 0x7f5ce8128d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33384/0 (socket says 172.21.15.92:33384) 2023-09-29T23:28:58.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.150+0000 7f5ced1e5700 1 -- 172.21.15.92:0/2210514333 learned_addr learned my addr 172.21.15.92:0/2210514333 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:58.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.150+0000 7f5ced1e5700 1 -- 172.21.15.92:0/2210514333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd8009420 con 0x7f5ce8067eb0 2023-09-29T23:28:58.153 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.151+0000 7f5ced1e5700 1 --2- 172.21.15.92:0/2210514333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ce8067eb0 0x7f5ce8128d80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400c800 tx=0x7f5ce4002740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:58.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.151+0000 7f5cdd7fa700 1 -- 172.21.15.92:0/2210514333 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ce4005d80 con 0x7f5ce8067eb0 2023-09-29T23:28:58.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.151+0000 7f5cdd7fa700 1 -- 172.21.15.92:0/2210514333 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce40070f0 con 0x7f5ce8067eb0 2023-09-29T23:28:58.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.151+0000 7f5cef449700 1 -- 172.21.15.92:0/2210514333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce8118b00 con 0x7f5ce8067eb0 2023-09-29T23:28:58.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.151+0000 7f5cdd7fa700 1 -- 172.21.15.92:0/2210514333 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ce40073a0 con 0x7f5ce8067eb0 2023-09-29T23:28:58.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.151+0000 7f5cef449700 1 -- 172.21.15.92:0/2210514333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce811b340 con 0x7f5ce8067eb0 2023-09-29T23:28:58.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.151+0000 7f5cdd7fa700 1 -- 172.21.15.92:0/2210514333 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f5ce4007500 con 0x7f5ce8067eb0 2023-09-29T23:28:58.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.152+0000 7f5cdd7fa700 1 --2- 172.21.15.92:0/2210514333 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5ccc035640 0x7f5ccc037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:58.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.152+0000 7f5cdd7fa700 1 -- 172.21.15.92:0/2210514333 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f5ce4047250 con 0x7f5ce8067eb0 2023-09-29T23:28:58.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.152+0000 7f5cec9e4700 1 --2- 172.21.15.92:0/2210514333 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5ccc035640 0x7f5ccc037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:58.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.152+0000 7f5cef449700 1 -- 172.21.15.92:0/2210514333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce805f230 con 0x7f5ce8067eb0 2023-09-29T23:28:58.154 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.152+0000 7f5cec9e4700 1 --2- 172.21.15.92:0/2210514333 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5ccc035640 0x7f5ccc037af0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80030c0 tx=0x7f5cd8016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:58.156 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.156+0000 7f5cdd7fa700 1 -- 172.21.15.92:0/2210514333 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ce4007990 con 0x7f5ce8067eb0 2023-09-29T23:28:58.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.381+0000 7f5cef449700 1 -- 172.21.15.92:0/2210514333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5ce80a0140 con 0x7f5ce8067eb0 2023-09-29T23:28:58.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.381+0000 7f5cdd7fa700 1 -- 172.21.15.92:0/2210514333 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f5ce4029100 con 0x7f5ce8067eb0 2023-09-29T23:28:58.381 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:58.382 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-29T23:28:58.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.383+0000 7f5cef449700 1 -- 172.21.15.92:0/2210514333 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5ccc035640 msgr2=0x7f5ccc037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:58.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.383+0000 7f5cef449700 1 --2- 172.21.15.92:0/2210514333 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5ccc035640 0x7f5ccc037af0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80030c0 tx=0x7f5cd8016000 comp rx=0 tx=0).stop 2023-09-29T23:28:58.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.383+0000 7f5cef449700 1 -- 172.21.15.92:0/2210514333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ce8067eb0 msgr2=0x7f5ce8128d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:58.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.383+0000 7f5cef449700 1 --2- 172.21.15.92:0/2210514333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ce8067eb0 0x7f5ce8128d80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400c800 tx=0x7f5ce4002740 comp rx=0 tx=0).stop 2023-09-29T23:28:58.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.383+0000 7f5cef449700 1 -- 172.21.15.92:0/2210514333 shutdown_connections 2023-09-29T23:28:58.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.383+0000 7f5cef449700 1 --2- 172.21.15.92:0/2210514333 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5ccc035640 0x7f5ccc037af0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:58.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.383+0000 7f5cef449700 1 --2- 172.21.15.92:0/2210514333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ce8067eb0 0x7f5ce8128d80 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:58.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.383+0000 7f5cef449700 1 -- 172.21.15.92:0/2210514333 >> 172.21.15.92:0/2210514333 conn(0x7f5ce806bbd0 msgr2=0x7f5ce809e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:58.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.383+0000 7f5cef449700 1 -- 172.21.15.92:0/2210514333 shutdown_connections 2023-09-29T23:28:58.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.383+0000 7f5cef449700 1 -- 172.21.15.92:0/2210514333 wait complete. 2023-09-29T23:28:58.397 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-09-29T23:28:58.398 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:28:58.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.511+0000 7f49c4380700 1 Processor -- start 2023-09-29T23:28:58.511 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.511+0000 7f49c4380700 1 -- start start 2023-09-29T23:28:58.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.511+0000 7f49c4380700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f49bc12fcb0 0x7f49bc134620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:58.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.511+0000 7f49c4380700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49bc0997f0 con 0x7f49bc0a3030 2023-09-29T23:28:58.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.511+0000 7f49c4380700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49bc0a3400 con 0x7f49bc12fcb0 2023-09-29T23:28:58.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.512+0000 7f49c191b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f49bc12fcb0 0x7f49bc134620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:58.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.512+0000 7f49c211c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f49bc0a3030 0x7f49bc12f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:36674/0 (socket says 172.21.15.92:36674) 2023-09-29T23:28:58.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.512+0000 7f49c211c700 1 -- 172.21.15.92:0/1676109533 learned_addr learned my addr 172.21.15.92:0/1676109533 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:58.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.512+0000 7f49c191b700 1 -- 172.21.15.92:0/1676109533 >> v1:172.21.15.92:6789/0 conn(0x7f49bc0a3030 legacy=0x7f49bc12f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:58.513 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.512+0000 7f49c191b700 1 -- 172.21.15.92:0/1676109533 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49bc0977a0 con 0x7f49bc12fcb0 2023-09-29T23:28:58.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.512+0000 7f49c111a700 1 -- 172.21.15.92:0/1676109533 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838243725 0 0) 0x7f49bc0997f0 con 0x7f49bc0a3030 2023-09-29T23:28:58.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.512+0000 7f49c191b700 1 --2- 172.21.15.92:0/1676109533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49bc12fcb0 0x7f49bc134620 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009860 tx=0x7f49ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd137ebe618191d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:58.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.512+0000 7f49c111a700 1 -- 172.21.15.92:0/1676109533 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49ac00b710 con 0x7f49bc12fcb0 2023-09-29T23:28:58.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.512+0000 7f49c111a700 1 -- 172.21.15.92:0/1676109533 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ac00b870 con 0x7f49bc12fcb0 2023-09-29T23:28:58.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.512+0000 7f49c111a700 1 -- 172.21.15.92:0/1676109533 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49ac00ba20 con 0x7f49bc12fcb0 2023-09-29T23:28:58.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.513+0000 7f49c4380700 1 -- 172.21.15.92:0/1676109533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49bc12fcb0 msgr2=0x7f49bc134620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:58.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.513+0000 7f49c4380700 1 --2- 172.21.15.92:0/1676109533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49bc12fcb0 0x7f49bc134620 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009860 tx=0x7f49ac0091a0 comp rx=0 tx=0).stop 2023-09-29T23:28:58.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.513+0000 7f49c4380700 1 -- 172.21.15.92:0/1676109533 shutdown_connections 2023-09-29T23:28:58.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.513+0000 7f49c4380700 1 --2- 172.21.15.92:0/1676109533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49bc12fcb0 0x7f49bc134620 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:58.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.513+0000 7f49c4380700 1 -- 172.21.15.92:0/1676109533 >> 172.21.15.92:0/1676109533 conn(0x7f49bc067fc0 msgr2=0x7f49bc0a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:58.514 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.513+0000 7f49c4380700 1 -- 172.21.15.92:0/1676109533 shutdown_connections 2023-09-29T23:28:58.515 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.513+0000 7f49c4380700 1 -- 172.21.15.92:0/1676109533 wait complete. 2023-09-29T23:28:58.516 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.513+0000 7f49c4380700 1 Processor -- start 2023-09-29T23:28:58.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.513+0000 7f49c4380700 1 -- start start 2023-09-29T23:28:58.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.514+0000 7f49c4380700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49bc0a3030 0x7f49bc12c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:58.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.514+0000 7f49c4380700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc11e710 con 0x7f49bc0a3030 2023-09-29T23:28:58.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.514+0000 7f49c211c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49bc0a3030 0x7f49bc12c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:58.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.514+0000 7f49c211c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49bc0a3030 0x7f49bc12c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33406/0 (socket says 172.21.15.92:33406) 2023-09-29T23:28:58.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.514+0000 7f49c211c700 1 -- 172.21.15.92:0/1967489690 learned_addr learned my addr 172.21.15.92:0/1967489690 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:58.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.514+0000 7f49c211c700 1 -- 172.21.15.92:0/1967489690 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac009420 con 0x7f49bc0a3030 2023-09-29T23:28:58.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.514+0000 7f49c211c700 1 --2- 172.21.15.92:0/1967489690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49bc0a3030 0x7f49bc12c150 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f49b800c710 tx=0x7f49b8007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:58.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.514+0000 7f49b27fc700 1 -- 172.21.15.92:0/1967489690 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49b8005c50 con 0x7f49bc0a3030 2023-09-29T23:28:58.517 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.514+0000 7f49b27fc700 1 -- 172.21.15.92:0/1967489690 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b8005db0 con 0x7f49bc0a3030 2023-09-29T23:28:58.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.514+0000 7f49c4380700 1 -- 172.21.15.92:0/1967489690 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49bc11ec50 con 0x7f49bc0a3030 2023-09-29T23:28:58.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.514+0000 7f49b27fc700 1 -- 172.21.15.92:0/1967489690 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49b8007230 con 0x7f49bc0a3030 2023-09-29T23:28:58.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.514+0000 7f49c4380700 1 -- 172.21.15.92:0/1967489690 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49bc11e940 con 0x7f49bc0a3030 2023-09-29T23:28:58.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.515+0000 7f49b27fc700 1 -- 172.21.15.92:0/1967489690 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f49b8007390 con 0x7f49bc0a3030 2023-09-29T23:28:58.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.515+0000 7f49b27fc700 1 --2- 172.21.15.92:0/1967489690 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f49a0035640 0x7f49a0037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:58.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.515+0000 7f49b27fc700 1 -- 172.21.15.92:0/1967489690 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f49b8046a50 con 0x7f49bc0a3030 2023-09-29T23:28:58.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.515+0000 7f49c4380700 1 -- 172.21.15.92:0/1967489690 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49bc11b490 con 0x7f49bc0a3030 2023-09-29T23:28:58.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.515+0000 7f49c191b700 1 --2- 172.21.15.92:0/1967489690 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f49a0035640 0x7f49a0037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:58.518 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.516+0000 7f49c191b700 1 --2- 172.21.15.92:0/1967489690 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f49a0035640 0x7f49a0037af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f49ac006eb0 tx=0x7f49ac016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:58.520 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.520+0000 7f49b27fc700 1 -- 172.21.15.92:0/1967489690 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49b8017020 con 0x7f49bc0a3030 2023-09-29T23:28:58.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.704+0000 7f49c4380700 1 -- 172.21.15.92:0/1967489690 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49bc096410 con 0x7f49bc0a3030 2023-09-29T23:28:58.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.705+0000 7f49b27fc700 1 -- 172.21.15.92:0/1967489690 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+9590 (secure 0 0 0) 0x7f49b800e8e0 con 0x7f49bc0a3030 2023-09-29T23:28:58.706 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:58.706 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"fsid":"5b80eae7-9a7e-4dc0-8ff1-cd1f82a1fa33","created":"2023-09-29T23:23:30.308760+0000","modified":"2023-09-29T23:24:37.276001+0000","last_up_change":"2023-09-29T23:23:37.693186+0000","last_in_change":"2023-09-29T23:23:31.538675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-09-29T23:23:39.227674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-29T23:23:43.363869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-29T23:23:44.406215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea64f859-a36f-4804-810d-2fe7081c9990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":85726},{"type":"v1","addr":"172.21.15.92:6817","nonce":85726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":85726},{"type":"v1","addr":"172.21.15.92:6819","nonce":85726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":85726},{"type":"v1","addr":"172.21.15.92:6823","nonce":85726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":85726},{"type":"v1","addr":"172.21.15.92:6821","nonce":85726}]},"public_addr":"172.21.15.92:6817/85726","cluster_addr":"172.21.15.92:6819/85726","heartbeat_back_addr":"172.21.15.92:6823/85726","heartbeat_front_addr":"172.21.15.92:6821/85726","state":["exists","up"]},{"osd":1,"uuid":"2e9c0837-2887-469f-9dea-db4bde348578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":85705},{"type":"v1","addr":"172.21.15.92:6809","nonce":85705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":85705},{"type":"v1","addr":"172.21.15.92:6811","nonce":85705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":85705},{"type":"v1","addr":"172.21.15.92:6815","nonce":85705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":85705},{"type":"v1","addr":"172.21.15.92:6813","nonce":85705}]},"public_addr":"172.21.15.92:6809/85705","cluster_addr":"172.21.15.92:6811/85705","heartbeat_back_addr":"172.21.15.92:6815/85705","heartbeat_front_addr":"172.21.15.92:6813/85705","state":["exists","up"]},{"osd":2,"uuid":"81ff42a8-c905-48bb-a021-3f5734761a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":85704},{"type":"v1","addr":"172.21.15.92:6801","nonce":85704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":85704},{"type":"v1","addr":"172.21.15.92:6803","nonce":85704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":85704},{"type":"v1","addr":"172.21.15.92:6807","nonce":85704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":85704},{"type":"v1","addr":"172.21.15.92:6805","nonce":85704}]},"public_addr":"172.21.15.92:6801/85704","cluster_addr":"172.21.15.92:6803/85704","heartbeat_back_addr":"172.21.15.92:6807/85704","heartbeat_front_addr":"172.21.15.92:6805/85704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.911756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.874000+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.680977+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1d","mappings":[{"from":0,"to":2}]},{"pgid":"3.b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":0,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:28:58.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.707+0000 7f49c4380700 1 -- 172.21.15.92:0/1967489690 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f49a0035640 msgr2=0x7f49a0037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:58.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.707+0000 7f49c4380700 1 --2- 172.21.15.92:0/1967489690 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f49a0035640 0x7f49a0037af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f49ac006eb0 tx=0x7f49ac016000 comp rx=0 tx=0).stop 2023-09-29T23:28:58.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.707+0000 7f49c4380700 1 -- 172.21.15.92:0/1967489690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49bc0a3030 msgr2=0x7f49bc12c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:58.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.707+0000 7f49c4380700 1 --2- 172.21.15.92:0/1967489690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49bc0a3030 0x7f49bc12c150 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f49b800c710 tx=0x7f49b8007d90 comp rx=0 tx=0).stop 2023-09-29T23:28:58.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.707+0000 7f49c4380700 1 -- 172.21.15.92:0/1967489690 shutdown_connections 2023-09-29T23:28:58.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.707+0000 7f49c4380700 1 --2- 172.21.15.92:0/1967489690 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f49a0035640 0x7f49a0037af0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:58.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.707+0000 7f49c4380700 1 --2- 172.21.15.92:0/1967489690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49bc0a3030 0x7f49bc12c150 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:58.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.707+0000 7f49c4380700 1 -- 172.21.15.92:0/1967489690 >> 172.21.15.92:0/1967489690 conn(0x7f49bc067fc0 msgr2=0x7f49bc12d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:58.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.708+0000 7f49c4380700 1 -- 172.21.15.92:0/1967489690 shutdown_connections 2023-09-29T23:28:58.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.708+0000 7f49c4380700 1 -- 172.21.15.92:0/1967489690 wait complete. 2023-09-29T23:28:58.719 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-29T23:28:58.720 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:28:58.833 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.832+0000 7f944e11f700 1 Processor -- start 2023-09-29T23:28:58.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.832+0000 7f944e11f700 1 -- start start 2023-09-29T23:28:58.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.832+0000 7f944e11f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f94480a3030 0x7f944812f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:58.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.832+0000 7f944e11f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94480997f0 con 0x7f944812fae0 2023-09-29T23:28:58.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.832+0000 7f944e11f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94480a3400 con 0x7f94480a3030 2023-09-29T23:28:58.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.832+0000 7f94477fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f94480a3030 0x7f944812f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:58.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.832+0000 7f9446ffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f944812fae0 0x7f9448095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:36690/0 (socket says 172.21.15.92:36690) 2023-09-29T23:28:58.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.832+0000 7f9446ffd700 1 -- 172.21.15.92:0/1188858310 learned_addr learned my addr 172.21.15.92:0/1188858310 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:58.834 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.832+0000 7f94477fe700 1 -- 172.21.15.92:0/1188858310 >> v1:172.21.15.92:6789/0 conn(0x7f944812fae0 legacy=0x7f9448095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:58.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.832+0000 7f94477fe700 1 -- 172.21.15.92:0/1188858310 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94480977a0 con 0x7f94480a3030 2023-09-29T23:28:58.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.832+0000 7f94467fc700 1 -- 172.21.15.92:0/1188858310 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463645342 0 0) 0x7f94480997f0 con 0x7f944812fae0 2023-09-29T23:28:58.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.833+0000 7f94477fe700 1 --2- 172.21.15.92:0/1188858310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94480a3030 0x7f944812f5a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9438009860 tx=0x7f94380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab87f572a7e947bc server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:58.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.833+0000 7f94467fc700 1 -- 172.21.15.92:0/1188858310 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f943800b710 con 0x7f94480a3030 2023-09-29T23:28:58.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.833+0000 7f94467fc700 1 -- 172.21.15.92:0/1188858310 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943800b870 con 0x7f94480a3030 2023-09-29T23:28:58.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.833+0000 7f94467fc700 1 -- 172.21.15.92:0/1188858310 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f943800ba20 con 0x7f94480a3030 2023-09-29T23:28:58.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.833+0000 7f944e11f700 1 -- 172.21.15.92:0/1188858310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94480a3030 msgr2=0x7f944812f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:58.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.833+0000 7f944e11f700 1 --2- 172.21.15.92:0/1188858310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94480a3030 0x7f944812f5a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9438009860 tx=0x7f94380091a0 comp rx=0 tx=0).stop 2023-09-29T23:28:58.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.833+0000 7f944e11f700 1 -- 172.21.15.92:0/1188858310 shutdown_connections 2023-09-29T23:28:58.835 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.833+0000 7f944e11f700 1 --2- 172.21.15.92:0/1188858310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94480a3030 0x7f944812f5a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:58.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.833+0000 7f944e11f700 1 -- 172.21.15.92:0/1188858310 >> 172.21.15.92:0/1188858310 conn(0x7f9448067fc0 msgr2=0x7f94480a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:58.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.833+0000 7f944e11f700 1 -- 172.21.15.92:0/1188858310 shutdown_connections 2023-09-29T23:28:58.836 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.833+0000 7f944e11f700 1 -- 172.21.15.92:0/1188858310 wait complete. 2023-09-29T23:28:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.834+0000 7f944e11f700 1 Processor -- start 2023-09-29T23:28:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.834+0000 7f944e11f700 1 -- start start 2023-09-29T23:28:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.835+0000 7f944e11f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94480a3030 0x7f944813e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.835+0000 7f944e11f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944811d1f0 con 0x7f94480a3030 2023-09-29T23:28:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.835+0000 7f94477fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94480a3030 0x7f944813e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:58.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.835+0000 7f94477fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94480a3030 0x7f944813e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33426/0 (socket says 172.21.15.92:33426) 2023-09-29T23:28:58.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.835+0000 7f94477fe700 1 -- 172.21.15.92:0/3470735965 learned_addr learned my addr 172.21.15.92:0/3470735965 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:58.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.835+0000 7f94477fe700 1 -- 172.21.15.92:0/3470735965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9438009420 con 0x7f94480a3030 2023-09-29T23:28:58.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.835+0000 7f94477fe700 1 --2- 172.21.15.92:0/3470735965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94480a3030 0x7f944813e4d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f94380093f0 tx=0x7f9438016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:58.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.835+0000 7f943f7fe700 1 -- 172.21.15.92:0/3470735965 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f943801c450 con 0x7f94480a3030 2023-09-29T23:28:58.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.835+0000 7f943f7fe700 1 -- 172.21.15.92:0/3470735965 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943801c5b0 con 0x7f94480a3030 2023-09-29T23:28:58.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.835+0000 7f944e11f700 1 -- 172.21.15.92:0/3470735965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944812ce00 con 0x7f94480a3030 2023-09-29T23:28:58.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.835+0000 7f943f7fe700 1 -- 172.21.15.92:0/3470735965 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f943801c8a0 con 0x7f94480a3030 2023-09-29T23:28:58.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.835+0000 7f944e11f700 1 -- 172.21.15.92:0/3470735965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944811e630 con 0x7f94480a3030 2023-09-29T23:28:58.839 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.836+0000 7f943f7fe700 1 -- 172.21.15.92:0/3470735965 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f943801cb10 con 0x7f94480a3030 2023-09-29T23:28:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.836+0000 7f943f7fe700 1 --2- 172.21.15.92:0/3470735965 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9428035640 0x7f9428037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.836+0000 7f944e11f700 1 -- 172.21.15.92:0/3470735965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f944811d060 con 0x7f94480a3030 2023-09-29T23:28:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.836+0000 7f943f7fe700 1 -- 172.21.15.92:0/3470735965 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f9438049620 con 0x7f94480a3030 2023-09-29T23:28:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.836+0000 7f9446ffd700 1 --2- 172.21.15.92:0/3470735965 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9428035640 0x7f9428037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.837+0000 7f9446ffd700 1 --2- 172.21.15.92:0/3470735965 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9428035640 0x7f9428037af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f94300011e0 tx=0x7f94300079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:58.841+0000 7f943f7fe700 1 -- 172.21.15.92:0/3470735965 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f943802d350 con 0x7f94480a3030 2023-09-29T23:28:59.018 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.018+0000 7f944e11f700 1 -- 172.21.15.92:0/3470735965 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f944811e410 con 0x7f9428035640 2023-09-29T23:28:59.025 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.025+0000 7f943f7fe700 1 -- 172.21.15.92:0/3470735965 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264984 (secure 0 0 0) 0x7f94300058a0 con 0x7f9428035640 2023-09-29T23:28:59.028 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:59.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.028+0000 7f944e11f700 1 -- 172.21.15.92:0/3470735965 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9428035640 msgr2=0x7f9428037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:59.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.028+0000 7f944e11f700 1 --2- 172.21.15.92:0/3470735965 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9428035640 0x7f9428037af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f94300011e0 tx=0x7f94300079d0 comp rx=0 tx=0).stop 2023-09-29T23:28:59.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.028+0000 7f944e11f700 1 -- 172.21.15.92:0/3470735965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94480a3030 msgr2=0x7f944813e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:59.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.028+0000 7f944e11f700 1 --2- 172.21.15.92:0/3470735965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94480a3030 0x7f944813e4d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f94380093f0 tx=0x7f9438016000 comp rx=0 tx=0).stop 2023-09-29T23:28:59.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.028+0000 7f944e11f700 1 -- 172.21.15.92:0/3470735965 shutdown_connections 2023-09-29T23:28:59.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.028+0000 7f944e11f700 1 --2- 172.21.15.92:0/3470735965 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f9428035640 0x7f9428037af0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:59.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.028+0000 7f944e11f700 1 --2- 172.21.15.92:0/3470735965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94480a3030 0x7f944813e4d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:59.031 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.028+0000 7f944e11f700 1 -- 172.21.15.92:0/3470735965 >> 172.21.15.92:0/3470735965 conn(0x7f9448067fc0 msgr2=0x7f944812d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:59.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.028+0000 7f944e11f700 1 -- 172.21.15.92:0/3470735965 shutdown_connections 2023-09-29T23:28:59.032 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.028+0000 7f944e11f700 1 -- 172.21.15.92:0/3470735965 wait complete. 2023-09-29T23:28:59.032 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-09-29T23:28:59.040 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-09-29T23:28:58.108111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":208,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":16696,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":314556104,"statfs":{"total":322122547200,"available":322105450496,"internally_reserved":0,"allocated":557056,"data_stored":160657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002652"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284180+0000","last_change":"2023-09-29T23:23:45.465624+0000","last_active":"2023-09-29T23:24:36.284180+0000","last_peered":"2023-09-29T23:24:36.284180+0000","last_clean":"2023-09-29T23:24:36.284180+0000","last_became_active":"2023-09-29T23:23:45.464271+0000","last_became_peered":"2023-09-29T23:23:45.464271+0000","last_unstale":"2023-09-29T23:24:36.284180+0000","last_undegraded":"2023-09-29T23:24:36.284180+0000","last_fullsized":"2023-09-29T23:24:36.284180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:54:19.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282759+0000","last_change":"2023-09-29T23:23:45.466587+0000","last_active":"2023-09-29T23:24:36.282759+0000","last_peered":"2023-09-29T23:24:36.282759+0000","last_clean":"2023-09-29T23:24:36.282759+0000","last_became_active":"2023-09-29T23:23:45.466338+0000","last_became_peered":"2023-09-29T23:23:45.466338+0000","last_unstale":"2023-09-29T23:24:36.282759+0000","last_undegraded":"2023-09-29T23:24:36.282759+0000","last_fullsized":"2023-09-29T23:24:36.282759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284501+0000","last_change":"2023-09-29T23:23:45.477248+0000","last_active":"2023-09-29T23:24:36.284501+0000","last_peered":"2023-09-29T23:24:36.284501+0000","last_clean":"2023-09-29T23:24:36.284501+0000","last_became_active":"2023-09-29T23:23:45.474129+0000","last_became_peered":"2023-09-29T23:23:45.474129+0000","last_unstale":"2023-09-29T23:24:36.284501+0000","last_undegraded":"2023-09-29T23:24:36.284501+0000","last_fullsized":"2023-09-29T23:24:36.284501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:09:27.600159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278328+0000","last_change":"2023-09-29T23:23:45.471200+0000","last_active":"2023-09-29T23:24:36.278328+0000","last_peered":"2023-09-29T23:24:36.278328+0000","last_clean":"2023-09-29T23:24:36.278328+0000","last_became_active":"2023-09-29T23:23:45.470971+0000","last_became_peered":"2023-09-29T23:23:45.470971+0000","last_unstale":"2023-09-29T23:24:36.278328+0000","last_undegraded":"2023-09-29T23:24:36.278328+0000","last_fullsized":"2023-09-29T23:24:36.278328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:29:34.531515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282900+0000","last_change":"2023-09-29T23:23:45.473831+0000","last_active":"2023-09-29T23:24:36.282900+0000","last_peered":"2023-09-29T23:24:36.282900+0000","last_clean":"2023-09-29T23:24:36.282900+0000","last_became_active":"2023-09-29T23:23:45.473570+0000","last_became_peered":"2023-09-29T23:23:45.473570+0000","last_unstale":"2023-09-29T23:24:36.282900+0000","last_undegraded":"2023-09-29T23:24:36.282900+0000","last_fullsized":"2023-09-29T23:24:36.282900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:51:36.401360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277945+0000","last_change":"2023-09-29T23:23:45.470583+0000","last_active":"2023-09-29T23:24:36.277945+0000","last_peered":"2023-09-29T23:24:36.277945+0000","last_clean":"2023-09-29T23:24:36.277945+0000","last_became_active":"2023-09-29T23:23:45.470349+0000","last_became_peered":"2023-09-29T23:23:45.470349+0000","last_unstale":"2023-09-29T23:24:36.277945+0000","last_undegraded":"2023-09-29T23:24:36.277945+0000","last_fullsized":"2023-09-29T23:24:36.277945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:50:32.868236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282803+0000","last_change":"2023-09-29T23:23:45.465376+0000","last_active":"2023-09-29T23:24:36.282803+0000","last_peered":"2023-09-29T23:24:36.282803+0000","last_clean":"2023-09-29T23:24:36.282803+0000","last_became_active":"2023-09-29T23:23:45.464893+0000","last_became_peered":"2023-09-29T23:23:45.464893+0000","last_unstale":"2023-09-29T23:24:36.282803+0000","last_undegraded":"2023-09-29T23:24:36.282803+0000","last_fullsized":"2023-09-29T23:24:36.282803+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:34:22.460877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277761+0000","last_change":"2023-09-29T23:23:45.463286+0000","last_active":"2023-09-29T23:24:36.277761+0000","last_peered":"2023-09-29T23:24:36.277761+0000","last_clean":"2023-09-29T23:24:36.277761+0000","last_became_active":"2023-09-29T23:23:45.462888+0000","last_became_peered":"2023-09-29T23:23:45.462888+0000","last_unstale":"2023-09-29T23:24:36.277761+0000","last_undegraded":"2023-09-29T23:24:36.277761+0000","last_fullsized":"2023-09-29T23:24:36.277761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281893+0000","last_change":"2023-09-29T23:23:45.468860+0000","last_active":"2023-09-29T23:24:36.281893+0000","last_peered":"2023-09-29T23:24:36.281893+0000","last_clean":"2023-09-29T23:24:36.281893+0000","last_became_active":"2023-09-29T23:23:45.468303+0000","last_became_peered":"2023-09-29T23:23:45.468303+0000","last_unstale":"2023-09-29T23:24:36.281893+0000","last_undegraded":"2023-09-29T23:24:36.281893+0000","last_fullsized":"2023-09-29T23:24:36.281893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:34:22.460877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.285573+0000","last_change":"2023-09-29T23:24:37.285573+0000","last_active":"2023-09-29T23:24:37.285573+0000","last_peered":"2023-09-29T23:24:37.285573+0000","last_clean":"2023-09-29T23:24:37.285573+0000","last_became_active":"2023-09-29T23:24:37.285339+0000","last_became_peered":"2023-09-29T23:24:37.285339+0000","last_unstale":"2023-09-29T23:24:37.285573+0000","last_undegraded":"2023-09-29T23:24:37.285573+0000","last_fullsized":"2023-09-29T23:24:37.285573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:26:49.563741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284446+0000","last_change":"2023-09-29T23:23:45.467858+0000","last_active":"2023-09-29T23:24:36.284446+0000","last_peered":"2023-09-29T23:24:36.284446+0000","last_clean":"2023-09-29T23:24:36.284446+0000","last_became_active":"2023-09-29T23:23:45.464083+0000","last_became_peered":"2023-09-29T23:23:45.464083+0000","last_unstale":"2023-09-29T23:24:36.284446+0000","last_undegraded":"2023-09-29T23:24:36.284446+0000","last_fullsized":"2023-09-29T23:24:36.284446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:30:57.865969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283523+0000","last_change":"2023-09-29T23:23:45.466588+0000","last_active":"2023-09-29T23:24:36.283523+0000","last_peered":"2023-09-29T23:24:36.283523+0000","last_clean":"2023-09-29T23:24:36.283523+0000","last_became_active":"2023-09-29T23:23:45.466161+0000","last_became_peered":"2023-09-29T23:23:45.466161+0000","last_unstale":"2023-09-29T23:24:36.283523+0000","last_undegraded":"2023-09-29T23:24:36.283523+0000","last_fullsized":"2023-09-29T23:24:36.283523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:13.284557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283618+0000","last_change":"2023-09-29T23:23:45.467402+0000","last_active":"2023-09-29T23:24:36.283618+0000","last_peered":"2023-09-29T23:24:36.283618+0000","last_clean":"2023-09-29T23:24:36.283618+0000","last_became_active":"2023-09-29T23:23:45.467178+0000","last_became_peered":"2023-09-29T23:23:45.467178+0000","last_unstale":"2023-09-29T23:24:36.283618+0000","last_undegraded":"2023-09-29T23:24:36.283618+0000","last_fullsized":"2023-09-29T23:24:36.283618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282929+0000","last_change":"2023-09-29T23:23:45.465231+0000","last_active":"2023-09-29T23:24:36.282929+0000","last_peered":"2023-09-29T23:24:36.282929+0000","last_clean":"2023-09-29T23:24:36.282929+0000","last_became_active":"2023-09-29T23:23:45.464523+0000","last_became_peered":"2023-09-29T23:23:45.464523+0000","last_unstale":"2023-09-29T23:24:36.282929+0000","last_undegraded":"2023-09-29T23:24:36.282929+0000","last_fullsized":"2023-09-29T23:24:36.282929+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:32.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280968+0000","last_change":"2023-09-29T23:23:45.470349+0000","last_active":"2023-09-29T23:24:36.280968+0000","last_peered":"2023-09-29T23:24:36.280968+0000","last_clean":"2023-09-29T23:24:36.280968+0000","last_became_active":"2023-09-29T23:23:45.467004+0000","last_became_peered":"2023-09-29T23:23:45.467004+0000","last_unstale":"2023-09-29T23:24:36.280968+0000","last_undegraded":"2023-09-29T23:24:36.280968+0000","last_fullsized":"2023-09-29T23:24:36.280968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277802+0000","last_change":"2023-09-29T23:23:45.471536+0000","last_active":"2023-09-29T23:24:36.277802+0000","last_peered":"2023-09-29T23:24:36.277802+0000","last_clean":"2023-09-29T23:24:36.277802+0000","last_became_active":"2023-09-29T23:23:45.471334+0000","last_became_peered":"2023-09-29T23:23:45.471334+0000","last_unstale":"2023-09-29T23:24:36.277802+0000","last_undegraded":"2023-09-29T23:24:36.277802+0000","last_fullsized":"2023-09-29T23:24:36.277802+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282404+0000","last_change":"2023-09-29T23:23:45.468857+0000","last_active":"2023-09-29T23:24:36.282404+0000","last_peered":"2023-09-29T23:24:36.282404+0000","last_clean":"2023-09-29T23:24:36.282404+0000","last_became_active":"2023-09-29T23:23:45.468001+0000","last_became_peered":"2023-09-29T23:23:45.468001+0000","last_unstale":"2023-09-29T23:24:36.282404+0000","last_undegraded":"2023-09-29T23:24:36.282404+0000","last_fullsized":"2023-09-29T23:24:36.282404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:11.211646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278543+0000","last_change":"2023-09-29T23:23:45.467819+0000","last_active":"2023-09-29T23:24:36.278543+0000","last_peered":"2023-09-29T23:24:36.278543+0000","last_clean":"2023-09-29T23:24:36.278543+0000","last_became_active":"2023-09-29T23:23:45.467434+0000","last_became_peered":"2023-09-29T23:23:45.467434+0000","last_unstale":"2023-09-29T23:24:36.278543+0000","last_undegraded":"2023-09-29T23:24:36.278543+0000","last_fullsized":"2023-09-29T23:24:36.278543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284385+0000","last_change":"2023-09-29T23:23:45.473751+0000","last_active":"2023-09-29T23:24:36.284385+0000","last_peered":"2023-09-29T23:24:36.284385+0000","last_clean":"2023-09-29T23:24:36.284385+0000","last_became_active":"2023-09-29T23:23:45.473326+0000","last_became_peered":"2023-09-29T23:23:45.473326+0000","last_unstale":"2023-09-29T23:24:36.284385+0000","last_undegraded":"2023-09-29T23:24:36.284385+0000","last_fullsized":"2023-09-29T23:24:36.284385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:21:17.261104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283374+0000","last_change":"2023-09-29T23:23:45.467719+0000","last_active":"2023-09-29T23:24:36.283374+0000","last_peered":"2023-09-29T23:24:36.283374+0000","last_clean":"2023-09-29T23:24:36.283374+0000","last_became_active":"2023-09-29T23:23:45.467494+0000","last_became_peered":"2023-09-29T23:23:45.467494+0000","last_unstale":"2023-09-29T23:24:36.283374+0000","last_undegraded":"2023-09-29T23:24:36.283374+0000","last_fullsized":"2023-09-29T23:24:36.283374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284067+0000","last_change":"2023-09-29T23:23:45.478055+0000","last_active":"2023-09-29T23:24:36.284067+0000","last_peered":"2023-09-29T23:24:36.284067+0000","last_clean":"2023-09-29T23:24:36.284067+0000","last_became_active":"2023-09-29T23:23:45.477408+0000","last_became_peered":"2023-09-29T23:23:45.477408+0000","last_unstale":"2023-09-29T23:24:36.284067+0000","last_undegraded":"2023-09-29T23:24:36.284067+0000","last_fullsized":"2023-09-29T23:24:36.284067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:14:56.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280999+0000","last_change":"2023-09-29T23:23:45.471232+0000","last_active":"2023-09-29T23:24:36.280999+0000","last_peered":"2023-09-29T23:24:36.280999+0000","last_clean":"2023-09-29T23:24:36.280999+0000","last_became_active":"2023-09-29T23:23:45.470574+0000","last_became_peered":"2023-09-29T23:23:45.470574+0000","last_unstale":"2023-09-29T23:24:36.280999+0000","last_undegraded":"2023-09-29T23:24:36.280999+0000","last_fullsized":"2023-09-29T23:24:36.280999+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:25:25.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282928+0000","last_change":"2023-09-29T23:23:45.474093+0000","last_active":"2023-09-29T23:24:36.282928+0000","last_peered":"2023-09-29T23:24:36.282928+0000","last_clean":"2023-09-29T23:24:36.282928+0000","last_became_active":"2023-09-29T23:23:45.473789+0000","last_became_peered":"2023-09-29T23:23:45.473789+0000","last_unstale":"2023-09-29T23:24:36.282928+0000","last_undegraded":"2023-09-29T23:24:36.282928+0000","last_fullsized":"2023-09-29T23:24:36.282928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:46.564456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282401+0000","last_change":"2023-09-29T23:23:45.465993+0000","last_active":"2023-09-29T23:24:36.282401+0000","last_peered":"2023-09-29T23:24:36.282401+0000","last_clean":"2023-09-29T23:24:36.282401+0000","last_became_active":"2023-09-29T23:23:45.465443+0000","last_became_peered":"2023-09-29T23:23:45.465443+0000","last_unstale":"2023-09-29T23:24:36.282401+0000","last_undegraded":"2023-09-29T23:24:36.282401+0000","last_fullsized":"2023-09-29T23:24:36.282401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:12:18.769461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278594+0000","last_change":"2023-09-29T23:23:45.458032+0000","last_active":"2023-09-29T23:24:36.278594+0000","last_peered":"2023-09-29T23:24:36.278594+0000","last_clean":"2023-09-29T23:24:36.278594+0000","last_became_active":"2023-09-29T23:23:45.457799+0000","last_became_peered":"2023-09-29T23:23:45.457799+0000","last_unstale":"2023-09-29T23:24:36.278594+0000","last_undegraded":"2023-09-29T23:24:36.278594+0000","last_fullsized":"2023-09-29T23:24:36.278594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:21:07.207937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.279021+0000","last_change":"2023-09-29T23:23:45.467967+0000","last_active":"2023-09-29T23:24:36.279021+0000","last_peered":"2023-09-29T23:24:36.279021+0000","last_clean":"2023-09-29T23:24:36.279021+0000","last_became_active":"2023-09-29T23:23:45.467730+0000","last_became_peered":"2023-09-29T23:23:45.467730+0000","last_unstale":"2023-09-29T23:24:36.279021+0000","last_undegraded":"2023-09-29T23:24:36.279021+0000","last_fullsized":"2023-09-29T23:24:36.279021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:23:19.840400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281305+0000","last_change":"2023-09-29T23:23:45.076072+0000","last_active":"2023-09-29T23:24:36.281305+0000","last_peered":"2023-09-29T23:24:36.281305+0000","last_clean":"2023-09-29T23:24:36.281305+0000","last_became_active":"2023-09-29T23:23:45.075848+0000","last_became_peered":"2023-09-29T23:23:45.075848+0000","last_unstale":"2023-09-29T23:24:36.281305+0000","last_undegraded":"2023-09-29T23:24:36.281305+0000","last_fullsized":"2023-09-29T23:24:36.281305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:29:13.914085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281203+0000","last_change":"2023-09-29T23:23:45.462781+0000","last_active":"2023-09-29T23:24:36.281203+0000","last_peered":"2023-09-29T23:24:36.281203+0000","last_clean":"2023-09-29T23:24:36.281203+0000","last_became_active":"2023-09-29T23:23:45.462155+0000","last_became_peered":"2023-09-29T23:23:45.462155+0000","last_unstale":"2023-09-29T23:24:36.281203+0000","last_undegraded":"2023-09-29T23:24:36.281203+0000","last_fullsized":"2023-09-29T23:24:36.281203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:13.284557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278059+0000","last_change":"2023-09-29T23:23:45.092553+0000","last_active":"2023-09-29T23:24:36.278059+0000","last_peered":"2023-09-29T23:24:36.278059+0000","last_clean":"2023-09-29T23:24:36.278059+0000","last_became_active":"2023-09-29T23:23:45.092273+0000","last_became_peered":"2023-09-29T23:23:45.092273+0000","last_unstale":"2023-09-29T23:24:36.278059+0000","last_undegraded":"2023-09-29T23:24:36.278059+0000","last_fullsized":"2023-09-29T23:24:36.278059+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284089+0000","last_change":"2023-09-29T23:23:45.464637+0000","last_active":"2023-09-29T23:24:36.284089+0000","last_peered":"2023-09-29T23:24:36.284089+0000","last_clean":"2023-09-29T23:24:36.284089+0000","last_became_active":"2023-09-29T23:23:45.464027+0000","last_became_peered":"2023-09-29T23:23:45.464027+0000","last_unstale":"2023-09-29T23:24:36.284089+0000","last_undegraded":"2023-09-29T23:24:36.284089+0000","last_fullsized":"2023-09-29T23:24:36.284089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283126+0000","last_change":"2023-09-29T23:23:45.088658+0000","last_active":"2023-09-29T23:24:36.283126+0000","last_peered":"2023-09-29T23:24:36.283126+0000","last_clean":"2023-09-29T23:24:36.283126+0000","last_became_active":"2023-09-29T23:23:45.088405+0000","last_became_peered":"2023-09-29T23:23:45.088405+0000","last_unstale":"2023-09-29T23:24:36.283126+0000","last_undegraded":"2023-09-29T23:24:36.283126+0000","last_fullsized":"2023-09-29T23:24:36.283126+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277980+0000","last_change":"2023-09-29T23:23:45.471459+0000","last_active":"2023-09-29T23:24:36.277980+0000","last_peered":"2023-09-29T23:24:36.277980+0000","last_clean":"2023-09-29T23:24:36.277980+0000","last_became_active":"2023-09-29T23:23:45.470917+0000","last_became_peered":"2023-09-29T23:23:45.470917+0000","last_unstale":"2023-09-29T23:24:36.277980+0000","last_undegraded":"2023-09-29T23:24:36.277980+0000","last_fullsized":"2023-09-29T23:24:36.277980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:29:34.889615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282482+0000","last_change":"2023-09-29T23:23:45.070764+0000","last_active":"2023-09-29T23:24:36.282482+0000","last_peered":"2023-09-29T23:24:36.282482+0000","last_clean":"2023-09-29T23:24:36.282482+0000","last_became_active":"2023-09-29T23:23:45.070610+0000","last_became_peered":"2023-09-29T23:23:45.070610+0000","last_unstale":"2023-09-29T23:24:36.282482+0000","last_undegraded":"2023-09-29T23:24:36.282482+0000","last_fullsized":"2023-09-29T23:24:36.282482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:26:19.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280943+0000","last_change":"2023-09-29T23:23:45.475877+0000","last_active":"2023-09-29T23:24:36.280943+0000","last_peered":"2023-09-29T23:24:36.280943+0000","last_clean":"2023-09-29T23:24:36.280943+0000","last_became_active":"2023-09-29T23:23:45.475634+0000","last_became_peered":"2023-09-29T23:23:45.475634+0000","last_unstale":"2023-09-29T23:24:36.280943+0000","last_undegraded":"2023-09-29T23:24:36.280943+0000","last_fullsized":"2023-09-29T23:24:36.280943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:59:25.888959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282216+0000","last_change":"2023-09-29T23:23:45.091556+0000","last_active":"2023-09-29T23:24:36.282216+0000","last_peered":"2023-09-29T23:24:36.282216+0000","last_clean":"2023-09-29T23:24:36.282216+0000","last_became_active":"2023-09-29T23:23:45.091317+0000","last_became_peered":"2023-09-29T23:23:45.091317+0000","last_unstale":"2023-09-29T23:24:36.282216+0000","last_undegraded":"2023-09-29T23:24:36.282216+0000","last_fullsized":"2023-09-29T23:24:36.282216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:53.097532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278718+0000","last_change":"2023-09-29T23:23:45.458805+0000","last_active":"2023-09-29T23:24:36.278718+0000","last_peered":"2023-09-29T23:24:36.278718+0000","last_clean":"2023-09-29T23:24:36.278718+0000","last_became_active":"2023-09-29T23:23:45.458585+0000","last_became_peered":"2023-09-29T23:23:45.458585+0000","last_unstale":"2023-09-29T23:24:36.278718+0000","last_undegraded":"2023-09-29T23:24:36.278718+0000","last_fullsized":"2023-09-29T23:24:36.278718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:05:18.350431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283894+0000","last_change":"2023-09-29T23:23:45.071269+0000","last_active":"2023-09-29T23:24:36.283894+0000","last_peered":"2023-09-29T23:24:36.283894+0000","last_clean":"2023-09-29T23:24:36.283894+0000","last_became_active":"2023-09-29T23:23:45.070986+0000","last_became_peered":"2023-09-29T23:23:45.070986+0000","last_unstale":"2023-09-29T23:24:36.283894+0000","last_undegraded":"2023-09-29T23:24:36.283894+0000","last_fullsized":"2023-09-29T23:24:36.283894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:29.355473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283998+0000","last_change":"2023-09-29T23:23:45.464917+0000","last_active":"2023-09-29T23:24:36.283998+0000","last_peered":"2023-09-29T23:24:36.283998+0000","last_clean":"2023-09-29T23:24:36.283998+0000","last_became_active":"2023-09-29T23:23:45.464510+0000","last_became_peered":"2023-09-29T23:23:45.464510+0000","last_unstale":"2023-09-29T23:24:36.283998+0000","last_undegraded":"2023-09-29T23:24:36.283998+0000","last_fullsized":"2023-09-29T23:24:36.283998+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:58:16.565151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"16'3","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281562+0000","last_change":"2023-09-29T23:23:45.077097+0000","last_active":"2023-09-29T23:24:36.281562+0000","last_peered":"2023-09-29T23:24:36.281562+0000","last_clean":"2023-09-29T23:24:36.281562+0000","last_became_active":"2023-09-29T23:23:45.076856+0000","last_became_peered":"2023-09-29T23:23:45.076856+0000","last_unstale":"2023-09-29T23:24:36.281562+0000","last_undegraded":"2023-09-29T23:24:36.281562+0000","last_fullsized":"2023-09-29T23:24:36.281562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:00:28.816753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281523+0000","last_change":"2023-09-29T23:23:45.462198+0000","last_active":"2023-09-29T23:24:36.281523+0000","last_peered":"2023-09-29T23:24:36.281523+0000","last_clean":"2023-09-29T23:24:36.281523+0000","last_became_active":"2023-09-29T23:23:45.461199+0000","last_became_peered":"2023-09-29T23:23:45.461199+0000","last_unstale":"2023-09-29T23:24:36.281523+0000","last_undegraded":"2023-09-29T23:24:36.281523+0000","last_fullsized":"2023-09-29T23:24:36.281523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:33.901646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"16'6","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278414+0000","last_change":"2023-09-29T23:23:45.093720+0000","last_active":"2023-09-29T23:24:36.278414+0000","last_peered":"2023-09-29T23:24:36.278414+0000","last_clean":"2023-09-29T23:24:36.278414+0000","last_became_active":"2023-09-29T23:23:45.093487+0000","last_became_peered":"2023-09-29T23:23:45.093487+0000","last_unstale":"2023-09-29T23:24:36.278414+0000","last_undegraded":"2023-09-29T23:24:36.278414+0000","last_fullsized":"2023-09-29T23:24:36.278414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284422+0000","last_change":"2023-09-29T23:23:45.466875+0000","last_active":"2023-09-29T23:24:36.284422+0000","last_peered":"2023-09-29T23:24:36.284422+0000","last_clean":"2023-09-29T23:24:36.284422+0000","last_became_active":"2023-09-29T23:23:45.466667+0000","last_became_peered":"2023-09-29T23:23:45.466667+0000","last_unstale":"2023-09-29T23:24:36.284422+0000","last_undegraded":"2023-09-29T23:24:36.284422+0000","last_fullsized":"2023-09-29T23:24:36.284422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:19.696930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283809+0000","last_change":"2023-09-29T23:23:45.089727+0000","last_active":"2023-09-29T23:24:36.283809+0000","last_peered":"2023-09-29T23:24:36.283809+0000","last_clean":"2023-09-29T23:24:36.283809+0000","last_became_active":"2023-09-29T23:23:45.089450+0000","last_became_peered":"2023-09-29T23:23:45.089450+0000","last_unstale":"2023-09-29T23:24:36.283809+0000","last_undegraded":"2023-09-29T23:24:36.283809+0000","last_fullsized":"2023-09-29T23:24:36.283809+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283179+0000","last_change":"2023-09-29T23:23:45.468316+0000","last_active":"2023-09-29T23:24:36.283179+0000","last_peered":"2023-09-29T23:24:36.283179+0000","last_clean":"2023-09-29T23:24:36.283179+0000","last_became_active":"2023-09-29T23:23:45.464801+0000","last_became_peered":"2023-09-29T23:23:45.464801+0000","last_unstale":"2023-09-29T23:24:36.283179+0000","last_undegraded":"2023-09-29T23:24:36.283179+0000","last_fullsized":"2023-09-29T23:24:36.283179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277995+0000","last_change":"2023-09-29T23:23:45.093148+0000","last_active":"2023-09-29T23:24:36.277995+0000","last_peered":"2023-09-29T23:24:36.277995+0000","last_clean":"2023-09-29T23:24:36.277995+0000","last_became_active":"2023-09-29T23:23:45.092902+0000","last_became_peered":"2023-09-29T23:23:45.092902+0000","last_unstale":"2023-09-29T23:24:36.277995+0000","last_undegraded":"2023-09-29T23:24:36.277995+0000","last_fullsized":"2023-09-29T23:24:36.277995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281207+0000","last_change":"2023-09-29T23:23:45.466007+0000","last_active":"2023-09-29T23:24:36.281207+0000","last_peered":"2023-09-29T23:24:36.281207+0000","last_clean":"2023-09-29T23:24:36.281207+0000","last_became_active":"2023-09-29T23:23:45.465743+0000","last_became_peered":"2023-09-29T23:23:45.465743+0000","last_unstale":"2023-09-29T23:24:36.281207+0000","last_undegraded":"2023-09-29T23:24:36.281207+0000","last_fullsized":"2023-09-29T23:24:36.281207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283019+0000","last_change":"2023-09-29T23:23:45.072234+0000","last_active":"2023-09-29T23:24:36.283019+0000","last_peered":"2023-09-29T23:24:36.283019+0000","last_clean":"2023-09-29T23:24:36.283019+0000","last_became_active":"2023-09-29T23:23:45.072009+0000","last_became_peered":"2023-09-29T23:23:45.072009+0000","last_unstale":"2023-09-29T23:24:36.283019+0000","last_undegraded":"2023-09-29T23:24:36.283019+0000","last_fullsized":"2023-09-29T23:24:36.283019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280617+0000","last_change":"2023-09-29T23:23:45.466374+0000","last_active":"2023-09-29T23:24:36.280617+0000","last_peered":"2023-09-29T23:24:36.280617+0000","last_clean":"2023-09-29T23:24:36.280617+0000","last_became_active":"2023-09-29T23:23:45.466169+0000","last_became_peered":"2023-09-29T23:23:45.466169+0000","last_unstale":"2023-09-29T23:24:36.280617+0000","last_undegraded":"2023-09-29T23:24:36.280617+0000","last_fullsized":"2023-09-29T23:24:36.280617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"16'8","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278024+0000","last_change":"2023-09-29T23:23:45.091762+0000","last_active":"2023-09-29T23:24:36.278024+0000","last_peered":"2023-09-29T23:24:36.278024+0000","last_clean":"2023-09-29T23:24:36.278024+0000","last_became_active":"2023-09-29T23:23:45.091386+0000","last_became_peered":"2023-09-29T23:23:45.091386+0000","last_unstale":"2023-09-29T23:24:36.278024+0000","last_undegraded":"2023-09-29T23:24:36.278024+0000","last_fullsized":"2023-09-29T23:24:36.278024+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278185+0000","last_change":"2023-09-29T23:23:45.461421+0000","last_active":"2023-09-29T23:24:36.278185+0000","last_peered":"2023-09-29T23:24:36.278185+0000","last_clean":"2023-09-29T23:24:36.278185+0000","last_became_active":"2023-09-29T23:23:45.460643+0000","last_became_peered":"2023-09-29T23:23:45.460643+0000","last_unstale":"2023-09-29T23:24:36.278185+0000","last_undegraded":"2023-09-29T23:24:36.278185+0000","last_fullsized":"2023-09-29T23:24:36.278185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:12:32.105911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284002+0000","last_change":"2023-09-29T23:23:45.078091+0000","last_active":"2023-09-29T23:24:36.284002+0000","last_peered":"2023-09-29T23:24:36.284002+0000","last_clean":"2023-09-29T23:24:36.284002+0000","last_became_active":"2023-09-29T23:23:45.077734+0000","last_became_peered":"2023-09-29T23:23:45.077734+0000","last_unstale":"2023-09-29T23:24:36.284002+0000","last_undegraded":"2023-09-29T23:24:36.284002+0000","last_fullsized":"2023-09-29T23:24:36.284002+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:53.097532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278792+0000","last_change":"2023-09-29T23:23:45.467950+0000","last_active":"2023-09-29T23:24:36.278792+0000","last_peered":"2023-09-29T23:24:36.278792+0000","last_clean":"2023-09-29T23:24:36.278792+0000","last_became_active":"2023-09-29T23:23:45.467555+0000","last_became_peered":"2023-09-29T23:23:45.467555+0000","last_unstale":"2023-09-29T23:24:36.278792+0000","last_undegraded":"2023-09-29T23:24:36.278792+0000","last_fullsized":"2023-09-29T23:24:36.278792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278873+0000","last_change":"2023-09-29T23:23:45.092471+0000","last_active":"2023-09-29T23:24:36.278873+0000","last_peered":"2023-09-29T23:24:36.278873+0000","last_clean":"2023-09-29T23:24:36.278873+0000","last_became_active":"2023-09-29T23:23:45.092185+0000","last_became_peered":"2023-09-29T23:23:45.092185+0000","last_unstale":"2023-09-29T23:24:36.278873+0000","last_undegraded":"2023-09-29T23:24:36.278873+0000","last_fullsized":"2023-09-29T23:24:36.278873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284089+0000","last_change":"2023-09-29T23:23:45.464504+0000","last_active":"2023-09-29T23:24:36.284089+0000","last_peered":"2023-09-29T23:24:36.284089+0000","last_clean":"2023-09-29T23:24:36.284089+0000","last_became_active":"2023-09-29T23:23:45.463806+0000","last_became_peered":"2023-09-29T23:23:45.463806+0000","last_unstale":"2023-09-29T23:24:36.284089+0000","last_undegraded":"2023-09-29T23:24:36.284089+0000","last_fullsized":"2023-09-29T23:24:36.284089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:25:25.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281453+0000","last_change":"2023-09-29T23:23:45.088776+0000","last_active":"2023-09-29T23:24:36.281453+0000","last_peered":"2023-09-29T23:24:36.281453+0000","last_clean":"2023-09-29T23:24:36.281453+0000","last_became_active":"2023-09-29T23:23:45.088535+0000","last_became_peered":"2023-09-29T23:23:45.088535+0000","last_unstale":"2023-09-29T23:24:36.281453+0000","last_undegraded":"2023-09-29T23:24:36.281453+0000","last_fullsized":"2023-09-29T23:24:36.281453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:35:07.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283419+0000","last_change":"2023-09-29T23:23:45.466379+0000","last_active":"2023-09-29T23:24:36.283419+0000","last_peered":"2023-09-29T23:24:36.283419+0000","last_clean":"2023-09-29T23:24:36.283419+0000","last_became_active":"2023-09-29T23:23:45.465855+0000","last_became_peered":"2023-09-29T23:23:45.465855+0000","last_unstale":"2023-09-29T23:24:36.283419+0000","last_undegraded":"2023-09-29T23:24:36.283419+0000","last_fullsized":"2023-09-29T23:24:36.283419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:06.275738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278346+0000","last_change":"2023-09-29T23:23:45.092714+0000","last_active":"2023-09-29T23:24:36.278346+0000","last_peered":"2023-09-29T23:24:36.278346+0000","last_clean":"2023-09-29T23:24:36.278346+0000","last_became_active":"2023-09-29T23:23:45.092476+0000","last_became_peered":"2023-09-29T23:23:45.092476+0000","last_unstale":"2023-09-29T23:24:36.278346+0000","last_undegraded":"2023-09-29T23:24:36.278346+0000","last_fullsized":"2023-09-29T23:24:36.278346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:20:23.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281616+0000","last_change":"2023-09-29T23:23:45.467010+0000","last_active":"2023-09-29T23:24:36.281616+0000","last_peered":"2023-09-29T23:24:36.281616+0000","last_clean":"2023-09-29T23:24:36.281616+0000","last_became_active":"2023-09-29T23:23:45.466694+0000","last_became_peered":"2023-09-29T23:23:45.466694+0000","last_unstale":"2023-09-29T23:24:36.281616+0000","last_undegraded":"2023-09-29T23:24:36.281616+0000","last_fullsized":"2023-09-29T23:24:36.281616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283738+0000","last_change":"2023-09-29T23:23:45.089622+0000","last_active":"2023-09-29T23:24:36.283738+0000","last_peered":"2023-09-29T23:24:36.283738+0000","last_clean":"2023-09-29T23:24:36.283738+0000","last_became_active":"2023-09-29T23:23:45.089176+0000","last_became_peered":"2023-09-29T23:23:45.089176+0000","last_unstale":"2023-09-29T23:24:36.283738+0000","last_undegraded":"2023-09-29T23:24:36.283738+0000","last_fullsized":"2023-09-29T23:24:36.283738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283257+0000","last_change":"2023-09-29T23:23:45.465798+0000","last_active":"2023-09-29T23:24:36.283257+0000","last_peered":"2023-09-29T23:24:36.283257+0000","last_clean":"2023-09-29T23:24:36.283257+0000","last_became_active":"2023-09-29T23:23:45.465127+0000","last_became_peered":"2023-09-29T23:23:45.465127+0000","last_unstale":"2023-09-29T23:24:36.283257+0000","last_undegraded":"2023-09-29T23:24:36.283257+0000","last_fullsized":"2023-09-29T23:24:36.283257+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:33.901646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281240+0000","last_change":"2023-09-29T23:23:45.075630+0000","last_active":"2023-09-29T23:24:36.281240+0000","last_peered":"2023-09-29T23:24:36.281240+0000","last_clean":"2023-09-29T23:24:36.281240+0000","last_became_active":"2023-09-29T23:23:45.075313+0000","last_became_peered":"2023-09-29T23:23:45.075313+0000","last_unstale":"2023-09-29T23:24:36.281240+0000","last_undegraded":"2023-09-29T23:24:36.281240+0000","last_fullsized":"2023-09-29T23:24:36.281240+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:59:03.439349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.288465+0000","last_change":"2023-09-29T23:24:37.288465+0000","last_active":"2023-09-29T23:24:37.288465+0000","last_peered":"2023-09-29T23:24:37.288465+0000","last_clean":"2023-09-29T23:24:37.288465+0000","last_became_active":"2023-09-29T23:24:37.288220+0000","last_became_peered":"2023-09-29T23:24:37.288220+0000","last_unstale":"2023-09-29T23:24:37.288465+0000","last_undegraded":"2023-09-29T23:24:37.288465+0000","last_fullsized":"2023-09-29T23:24:37.288465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:13:03.586738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280872+0000","last_change":"2023-09-29T23:23:45.075998+0000","last_active":"2023-09-29T23:24:36.280872+0000","last_peered":"2023-09-29T23:24:36.280872+0000","last_clean":"2023-09-29T23:24:36.280872+0000","last_became_active":"2023-09-29T23:23:45.075772+0000","last_became_peered":"2023-09-29T23:23:45.075772+0000","last_unstale":"2023-09-29T23:24:36.280872+0000","last_undegraded":"2023-09-29T23:24:36.280872+0000","last_fullsized":"2023-09-29T23:24:36.280872+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:12:24.809572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277847+0000","last_change":"2023-09-29T23:23:45.463124+0000","last_active":"2023-09-29T23:24:36.277847+0000","last_peered":"2023-09-29T23:24:36.277847+0000","last_clean":"2023-09-29T23:24:36.277847+0000","last_became_active":"2023-09-29T23:23:45.462583+0000","last_became_peered":"2023-09-29T23:23:45.462583+0000","last_unstale":"2023-09-29T23:24:36.277847+0000","last_undegraded":"2023-09-29T23:24:36.277847+0000","last_fullsized":"2023-09-29T23:24:36.277847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:01:57.571277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282321+0000","last_change":"2023-09-29T23:23:45.088750+0000","last_active":"2023-09-29T23:24:36.282321+0000","last_peered":"2023-09-29T23:24:36.282321+0000","last_clean":"2023-09-29T23:24:36.282321+0000","last_became_active":"2023-09-29T23:23:45.088506+0000","last_became_peered":"2023-09-29T23:23:45.088506+0000","last_unstale":"2023-09-29T23:24:36.282321+0000","last_undegraded":"2023-09-29T23:24:36.282321+0000","last_fullsized":"2023-09-29T23:24:36.282321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283202+0000","last_change":"2023-09-29T23:23:45.477617+0000","last_active":"2023-09-29T23:24:36.283202+0000","last_peered":"2023-09-29T23:24:36.283202+0000","last_clean":"2023-09-29T23:24:36.283202+0000","last_became_active":"2023-09-29T23:23:45.477335+0000","last_became_peered":"2023-09-29T23:23:45.477335+0000","last_unstale":"2023-09-29T23:24:36.283202+0000","last_undegraded":"2023-09-29T23:24:36.283202+0000","last_fullsized":"2023-09-29T23:24:36.283202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:44:09.599636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278631+0000","last_change":"2023-09-29T23:23:41.047954+0000","last_active":"2023-09-29T23:24:36.278631+0000","last_peered":"2023-09-29T23:24:36.278631+0000","last_clean":"2023-09-29T23:24:36.278631+0000","last_became_active":"2023-09-29T23:23:41.047701+0000","last_became_peered":"2023-09-29T23:23:41.047701+0000","last_unstale":"2023-09-29T23:24:36.278631+0000","last_undegraded":"2023-09-29T23:24:36.278631+0000","last_fullsized":"2023-09-29T23:24:36.278631+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:08:35.252580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"17'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282609+0000","last_change":"2023-09-29T23:23:45.075607+0000","last_active":"2023-09-29T23:24:36.282609+0000","last_peered":"2023-09-29T23:24:36.282609+0000","last_clean":"2023-09-29T23:24:36.282609+0000","last_became_active":"2023-09-29T23:23:45.075249+0000","last_became_peered":"2023-09-29T23:23:45.075249+0000","last_unstale":"2023-09-29T23:24:36.282609+0000","last_undegraded":"2023-09-29T23:24:36.282609+0000","last_fullsized":"2023-09-29T23:24:36.282609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:55:12.692421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278637+0000","last_change":"2023-09-29T23:23:45.460164+0000","last_active":"2023-09-29T23:24:36.278637+0000","last_peered":"2023-09-29T23:24:36.278637+0000","last_clean":"2023-09-29T23:24:36.278637+0000","last_became_active":"2023-09-29T23:23:45.459933+0000","last_became_peered":"2023-09-29T23:23:45.459933+0000","last_unstale":"2023-09-29T23:24:36.278637+0000","last_undegraded":"2023-09-29T23:24:36.278637+0000","last_fullsized":"2023-09-29T23:24:36.278637+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:25:22.017530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281404+0000","last_change":"2023-09-29T23:23:41.051640+0000","last_active":"2023-09-29T23:24:36.281404+0000","last_peered":"2023-09-29T23:24:36.281404+0000","last_clean":"2023-09-29T23:24:36.281404+0000","last_became_active":"2023-09-29T23:23:41.051398+0000","last_became_peered":"2023-09-29T23:23:41.051398+0000","last_unstale":"2023-09-29T23:24:36.281404+0000","last_undegraded":"2023-09-29T23:24:36.281404+0000","last_fullsized":"2023-09-29T23:24:36.281404+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:49:47.548120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281939+0000","last_change":"2023-09-29T23:23:45.076540+0000","last_active":"2023-09-29T23:24:36.281939+0000","last_peered":"2023-09-29T23:24:36.281939+0000","last_clean":"2023-09-29T23:24:36.281939+0000","last_became_active":"2023-09-29T23:23:45.076293+0000","last_became_peered":"2023-09-29T23:23:45.076293+0000","last_unstale":"2023-09-29T23:24:36.281939+0000","last_undegraded":"2023-09-29T23:24:36.281939+0000","last_fullsized":"2023-09-29T23:24:36.281939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:09.131795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283955+0000","last_change":"2023-09-29T23:23:45.466336+0000","last_active":"2023-09-29T23:24:36.283955+0000","last_peered":"2023-09-29T23:24:36.283955+0000","last_clean":"2023-09-29T23:24:36.283955+0000","last_became_active":"2023-09-29T23:23:45.466115+0000","last_became_peered":"2023-09-29T23:23:45.466115+0000","last_unstale":"2023-09-29T23:24:36.283955+0000","last_undegraded":"2023-09-29T23:24:36.283955+0000","last_fullsized":"2023-09-29T23:24:36.283955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:11.211646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281143+0000","last_change":"2023-09-29T23:23:41.050066+0000","last_active":"2023-09-29T23:24:36.281143+0000","last_peered":"2023-09-29T23:24:36.281143+0000","last_clean":"2023-09-29T23:24:36.281143+0000","last_became_active":"2023-09-29T23:23:41.049786+0000","last_became_peered":"2023-09-29T23:23:41.049786+0000","last_unstale":"2023-09-29T23:24:36.281143+0000","last_undegraded":"2023-09-29T23:24:36.281143+0000","last_fullsized":"2023-09-29T23:24:36.281143+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:22:54.699446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277892+0000","last_change":"2023-09-29T23:23:45.091590+0000","last_active":"2023-09-29T23:24:36.277892+0000","last_peered":"2023-09-29T23:24:36.277892+0000","last_clean":"2023-09-29T23:24:36.277892+0000","last_became_active":"2023-09-29T23:23:45.091162+0000","last_became_peered":"2023-09-29T23:23:45.091162+0000","last_unstale":"2023-09-29T23:24:36.277892+0000","last_undegraded":"2023-09-29T23:24:36.277892+0000","last_fullsized":"2023-09-29T23:24:36.277892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:29:38.240697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283194+0000","last_change":"2023-09-29T23:23:45.474238+0000","last_active":"2023-09-29T23:24:36.283194+0000","last_peered":"2023-09-29T23:24:36.283194+0000","last_clean":"2023-09-29T23:24:36.283194+0000","last_became_active":"2023-09-29T23:23:45.473861+0000","last_became_peered":"2023-09-29T23:23:45.473861+0000","last_unstale":"2023-09-29T23:24:36.283194+0000","last_undegraded":"2023-09-29T23:24:36.283194+0000","last_fullsized":"2023-09-29T23:24:36.283194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:39:43.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283014+0000","last_change":"2023-09-29T23:23:41.049685+0000","last_active":"2023-09-29T23:24:36.283014+0000","last_peered":"2023-09-29T23:24:36.283014+0000","last_clean":"2023-09-29T23:24:36.283014+0000","last_became_active":"2023-09-29T23:23:41.049442+0000","last_became_peered":"2023-09-29T23:23:41.049442+0000","last_unstale":"2023-09-29T23:24:36.283014+0000","last_undegraded":"2023-09-29T23:24:36.283014+0000","last_fullsized":"2023-09-29T23:24:36.283014+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:52:33.065724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277891+0000","last_change":"2023-09-29T23:23:45.092293+0000","last_active":"2023-09-29T23:24:36.277891+0000","last_peered":"2023-09-29T23:24:36.277891+0000","last_clean":"2023-09-29T23:24:36.277891+0000","last_became_active":"2023-09-29T23:23:45.092042+0000","last_became_peered":"2023-09-29T23:23:45.092042+0000","last_unstale":"2023-09-29T23:24:36.277891+0000","last_undegraded":"2023-09-29T23:24:36.277891+0000","last_fullsized":"2023-09-29T23:24:36.277891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:07:16.838088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280566+0000","last_change":"2023-09-29T23:23:45.461917+0000","last_active":"2023-09-29T23:24:36.280566+0000","last_peered":"2023-09-29T23:24:36.280566+0000","last_clean":"2023-09-29T23:24:36.280566+0000","last_became_active":"2023-09-29T23:23:45.461228+0000","last_became_peered":"2023-09-29T23:23:45.461228+0000","last_unstale":"2023-09-29T23:24:36.280566+0000","last_undegraded":"2023-09-29T23:24:36.280566+0000","last_fullsized":"2023-09-29T23:24:36.280566+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:54:19.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280520+0000","last_change":"2023-09-29T23:23:41.051041+0000","last_active":"2023-09-29T23:24:36.280520+0000","last_peered":"2023-09-29T23:24:36.280520+0000","last_clean":"2023-09-29T23:24:36.280520+0000","last_became_active":"2023-09-29T23:23:41.050731+0000","last_became_peered":"2023-09-29T23:23:41.050731+0000","last_unstale":"2023-09-29T23:24:36.280520+0000","last_undegraded":"2023-09-29T23:24:36.280520+0000","last_fullsized":"2023-09-29T23:24:36.280520+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:20.303147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281103+0000","last_change":"2023-09-29T23:23:45.088759+0000","last_active":"2023-09-29T23:24:36.281103+0000","last_peered":"2023-09-29T23:24:36.281103+0000","last_clean":"2023-09-29T23:24:36.281103+0000","last_became_active":"2023-09-29T23:23:45.088510+0000","last_became_peered":"2023-09-29T23:23:45.088510+0000","last_unstale":"2023-09-29T23:24:36.281103+0000","last_undegraded":"2023-09-29T23:24:36.281103+0000","last_fullsized":"2023-09-29T23:24:36.281103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:27:56.918672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281062+0000","last_change":"2023-09-29T23:23:45.472092+0000","last_active":"2023-09-29T23:24:36.281062+0000","last_peered":"2023-09-29T23:24:36.281062+0000","last_clean":"2023-09-29T23:24:36.281062+0000","last_became_active":"2023-09-29T23:23:45.461672+0000","last_became_peered":"2023-09-29T23:23:45.461672+0000","last_unstale":"2023-09-29T23:24:36.281062+0000","last_undegraded":"2023-09-29T23:24:36.281062+0000","last_fullsized":"2023-09-29T23:24:36.281062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:58:16.565151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278081+0000","last_change":"2023-09-29T23:23:41.047062+0000","last_active":"2023-09-29T23:24:36.278081+0000","last_peered":"2023-09-29T23:24:36.278081+0000","last_clean":"2023-09-29T23:24:36.278081+0000","last_became_active":"2023-09-29T23:23:41.046803+0000","last_became_peered":"2023-09-29T23:23:41.046803+0000","last_unstale":"2023-09-29T23:24:36.278081+0000","last_undegraded":"2023-09-29T23:24:36.278081+0000","last_fullsized":"2023-09-29T23:24:36.278081+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:22:14.657466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283094+0000","last_change":"2023-09-29T23:23:45.073226+0000","last_active":"2023-09-29T23:24:36.283094+0000","last_peered":"2023-09-29T23:24:36.283094+0000","last_clean":"2023-09-29T23:24:36.283094+0000","last_became_active":"2023-09-29T23:23:45.072973+0000","last_became_peered":"2023-09-29T23:23:45.072973+0000","last_unstale":"2023-09-29T23:24:36.283094+0000","last_undegraded":"2023-09-29T23:24:36.283094+0000","last_fullsized":"2023-09-29T23:24:36.283094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:27:56.918672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283910+0000","last_change":"2023-09-29T23:23:45.477628+0000","last_active":"2023-09-29T23:24:36.283910+0000","last_peered":"2023-09-29T23:24:36.283910+0000","last_clean":"2023-09-29T23:24:36.283910+0000","last_became_active":"2023-09-29T23:23:45.474318+0000","last_became_peered":"2023-09-29T23:23:45.474318+0000","last_unstale":"2023-09-29T23:24:36.283910+0000","last_undegraded":"2023-09-29T23:24:36.283910+0000","last_fullsized":"2023-09-29T23:24:36.283910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:46:02.634499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282673+0000","last_change":"2023-09-29T23:23:41.050883+0000","last_active":"2023-09-29T23:24:36.282673+0000","last_peered":"2023-09-29T23:24:36.282673+0000","last_clean":"2023-09-29T23:24:36.282673+0000","last_became_active":"2023-09-29T23:23:41.050639+0000","last_became_peered":"2023-09-29T23:23:41.050639+0000","last_unstale":"2023-09-29T23:24:36.282673+0000","last_undegraded":"2023-09-29T23:24:36.282673+0000","last_fullsized":"2023-09-29T23:24:36.282673+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:35:26.897753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281455+0000","last_change":"2023-09-29T23:23:45.077040+0000","last_active":"2023-09-29T23:24:36.281455+0000","last_peered":"2023-09-29T23:24:36.281455+0000","last_clean":"2023-09-29T23:24:36.281455+0000","last_became_active":"2023-09-29T23:23:45.076806+0000","last_became_peered":"2023-09-29T23:23:45.076806+0000","last_unstale":"2023-09-29T23:24:36.281455+0000","last_undegraded":"2023-09-29T23:24:36.281455+0000","last_fullsized":"2023-09-29T23:24:36.281455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:26:19.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281570+0000","last_change":"2023-09-29T23:23:45.462067+0000","last_active":"2023-09-29T23:24:36.281570+0000","last_peered":"2023-09-29T23:24:36.281570+0000","last_clean":"2023-09-29T23:24:36.281570+0000","last_became_active":"2023-09-29T23:23:45.460913+0000","last_became_peered":"2023-09-29T23:23:45.460913+0000","last_unstale":"2023-09-29T23:24:36.281570+0000","last_undegraded":"2023-09-29T23:24:36.281570+0000","last_fullsized":"2023-09-29T23:24:36.281570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:06.275738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282020+0000","last_change":"2023-09-29T23:23:41.050074+0000","last_active":"2023-09-29T23:24:36.282020+0000","last_peered":"2023-09-29T23:24:36.282020+0000","last_clean":"2023-09-29T23:24:36.282020+0000","last_became_active":"2023-09-29T23:23:41.049783+0000","last_became_peered":"2023-09-29T23:23:41.049783+0000","last_unstale":"2023-09-29T23:24:36.282020+0000","last_undegraded":"2023-09-29T23:24:36.282020+0000","last_fullsized":"2023-09-29T23:24:36.282020+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:37:01.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281488+0000","last_change":"2023-09-29T23:23:45.076087+0000","last_active":"2023-09-29T23:24:36.281488+0000","last_peered":"2023-09-29T23:24:36.281488+0000","last_clean":"2023-09-29T23:24:36.281488+0000","last_became_active":"2023-09-29T23:23:45.075273+0000","last_became_peered":"2023-09-29T23:23:45.075273+0000","last_unstale":"2023-09-29T23:24:36.281488+0000","last_undegraded":"2023-09-29T23:24:36.281488+0000","last_fullsized":"2023-09-29T23:24:36.281488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:27.356997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278693+0000","last_change":"2023-09-29T23:23:45.459071+0000","last_active":"2023-09-29T23:24:36.278693+0000","last_peered":"2023-09-29T23:24:36.278693+0000","last_clean":"2023-09-29T23:24:36.278693+0000","last_became_active":"2023-09-29T23:23:45.458250+0000","last_became_peered":"2023-09-29T23:23:45.458250+0000","last_unstale":"2023-09-29T23:24:36.278693+0000","last_undegraded":"2023-09-29T23:24:36.278693+0000","last_fullsized":"2023-09-29T23:24:36.278693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283297+0000","last_change":"2023-09-29T23:23:45.076932+0000","last_active":"2023-09-29T23:24:36.283297+0000","last_peered":"2023-09-29T23:24:36.283297+0000","last_clean":"2023-09-29T23:24:36.283297+0000","last_became_active":"2023-09-29T23:23:45.076638+0000","last_became_peered":"2023-09-29T23:23:45.076638+0000","last_unstale":"2023-09-29T23:24:36.283297+0000","last_undegraded":"2023-09-29T23:24:36.283297+0000","last_fullsized":"2023-09-29T23:24:36.283297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:35:07.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278736+0000","last_change":"2023-09-29T23:23:45.471332+0000","last_active":"2023-09-29T23:24:36.278736+0000","last_peered":"2023-09-29T23:24:36.278736+0000","last_clean":"2023-09-29T23:24:36.278736+0000","last_became_active":"2023-09-29T23:23:45.471013+0000","last_became_peered":"2023-09-29T23:23:45.471013+0000","last_unstale":"2023-09-29T23:24:36.278736+0000","last_undegraded":"2023-09-29T23:24:36.278736+0000","last_fullsized":"2023-09-29T23:24:36.278736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"16'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.295660+0000","last_change":"2023-09-29T23:24:37.295660+0000","last_active":"2023-09-29T23:24:37.295660+0000","last_peered":"2023-09-29T23:24:37.295660+0000","last_clean":"2023-09-29T23:24:37.295660+0000","last_became_active":"2023-09-29T23:24:37.292123+0000","last_became_peered":"2023-09-29T23:24:37.292123+0000","last_unstale":"2023-09-29T23:24:37.295660+0000","last_undegraded":"2023-09-29T23:24:37.295660+0000","last_fullsized":"2023-09-29T23:24:37.295660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:31:58.939763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281307+0000","last_change":"2023-09-29T23:23:45.471929+0000","last_active":"2023-09-29T23:24:36.281307+0000","last_peered":"2023-09-29T23:24:36.281307+0000","last_clean":"2023-09-29T23:24:36.281307+0000","last_became_active":"2023-09-29T23:23:45.471673+0000","last_became_peered":"2023-09-29T23:23:45.471673+0000","last_unstale":"2023-09-29T23:24:36.281307+0000","last_undegraded":"2023-09-29T23:24:36.281307+0000","last_fullsized":"2023-09-29T23:24:36.281307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278632+0000","last_change":"2023-09-29T23:23:45.092434+0000","last_active":"2023-09-29T23:24:36.278632+0000","last_peered":"2023-09-29T23:24:36.278632+0000","last_clean":"2023-09-29T23:24:36.278632+0000","last_became_active":"2023-09-29T23:23:45.092203+0000","last_became_peered":"2023-09-29T23:23:45.092203+0000","last_unstale":"2023-09-29T23:24:36.278632+0000","last_undegraded":"2023-09-29T23:24:36.278632+0000","last_fullsized":"2023-09-29T23:24:36.278632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284145+0000","last_change":"2023-09-29T23:23:45.464734+0000","last_active":"2023-09-29T23:24:36.284145+0000","last_peered":"2023-09-29T23:24:36.284145+0000","last_clean":"2023-09-29T23:24:36.284145+0000","last_became_active":"2023-09-29T23:23:45.464202+0000","last_became_peered":"2023-09-29T23:23:45.464202+0000","last_unstale":"2023-09-29T23:24:36.284145+0000","last_undegraded":"2023-09-29T23:24:36.284145+0000","last_fullsized":"2023-09-29T23:24:36.284145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:59:25.888959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1f","version":"16'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284086+0000","last_change":"2023-09-29T23:23:45.074017+0000","last_active":"2023-09-29T23:24:36.284086+0000","last_peered":"2023-09-29T23:24:36.284086+0000","last_clean":"2023-09-29T23:24:36.284086+0000","last_became_active":"2023-09-29T23:23:45.073772+0000","last_became_peered":"2023-09-29T23:23:45.073772+0000","last_unstale":"2023-09-29T23:24:36.284086+0000","last_undegraded":"2023-09-29T23:24:36.284086+0000","last_fullsized":"2023-09-29T23:24:36.284086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278944+0000","last_change":"2023-09-29T23:23:45.460786+0000","last_active":"2023-09-29T23:24:36.278944+0000","last_peered":"2023-09-29T23:24:36.278944+0000","last_clean":"2023-09-29T23:24:36.278944+0000","last_became_active":"2023-09-29T23:23:45.460548+0000","last_became_peered":"2023-09-29T23:23:45.460548+0000","last_unstale":"2023-09-29T23:24:36.278944+0000","last_undegraded":"2023-09-29T23:24:36.278944+0000","last_fullsized":"2023-09-29T23:24:36.278944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:09:25.160546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278067+0000","last_change":"2023-09-29T23:23:45.471512+0000","last_active":"2023-09-29T23:24:36.278067+0000","last_peered":"2023-09-29T23:24:36.278067+0000","last_clean":"2023-09-29T23:24:36.278067+0000","last_became_active":"2023-09-29T23:23:45.471294+0000","last_became_peered":"2023-09-29T23:23:45.471294+0000","last_unstale":"2023-09-29T23:24:36.278067+0000","last_undegraded":"2023-09-29T23:24:36.278067+0000","last_fullsized":"2023-09-29T23:24:36.278067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:29:14.066786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278131+0000","last_change":"2023-09-29T23:23:45.462314+0000","last_active":"2023-09-29T23:24:36.278131+0000","last_peered":"2023-09-29T23:24:36.278131+0000","last_clean":"2023-09-29T23:24:36.278131+0000","last_became_active":"2023-09-29T23:23:45.461188+0000","last_became_peered":"2023-09-29T23:23:45.461188+0000","last_unstale":"2023-09-29T23:24:36.278131+0000","last_undegraded":"2023-09-29T23:24:36.278131+0000","last_fullsized":"2023-09-29T23:24:36.278131+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:01:06.913634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283328+0000","last_change":"2023-09-29T23:23:45.473685+0000","last_active":"2023-09-29T23:24:36.283328+0000","last_peered":"2023-09-29T23:24:36.283328+0000","last_clean":"2023-09-29T23:24:36.283328+0000","last_became_active":"2023-09-29T23:23:45.473438+0000","last_became_peered":"2023-09-29T23:23:45.473438+0000","last_unstale":"2023-09-29T23:24:36.283328+0000","last_undegraded":"2023-09-29T23:24:36.283328+0000","last_fullsized":"2023-09-29T23:24:36.283328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:39:59.923188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283991+0000","last_change":"2023-09-29T23:23:45.477880+0000","last_active":"2023-09-29T23:24:36.283991+0000","last_peered":"2023-09-29T23:24:36.283991+0000","last_clean":"2023-09-29T23:24:36.283991+0000","last_became_active":"2023-09-29T23:23:45.474163+0000","last_became_peered":"2023-09-29T23:23:45.474163+0000","last_unstale":"2023-09-29T23:24:36.283991+0000","last_undegraded":"2023-09-29T23:24:36.283991+0000","last_fullsized":"2023-09-29T23:24:36.283991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:40:09.175714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283486+0000","last_change":"2023-09-29T23:23:45.473292+0000","last_active":"2023-09-29T23:24:36.283486+0000","last_peered":"2023-09-29T23:24:36.283486+0000","last_clean":"2023-09-29T23:24:36.283486+0000","last_became_active":"2023-09-29T23:23:45.473063+0000","last_became_peered":"2023-09-29T23:23:45.473063+0000","last_unstale":"2023-09-29T23:24:36.283486+0000","last_undegraded":"2023-09-29T23:24:36.283486+0000","last_fullsized":"2023-09-29T23:24:36.283486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:06:47.738713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281692+0000","last_change":"2023-09-29T23:23:45.463712+0000","last_active":"2023-09-29T23:24:36.281692+0000","last_peered":"2023-09-29T23:24:36.281692+0000","last_clean":"2023-09-29T23:24:36.281692+0000","last_became_active":"2023-09-29T23:23:45.463269+0000","last_became_peered":"2023-09-29T23:23:45.463269+0000","last_unstale":"2023-09-29T23:24:36.281692+0000","last_undegraded":"2023-09-29T23:24:36.281692+0000","last_fullsized":"2023-09-29T23:24:36.281692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:32.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705731,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5572,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852028,"statfs":{"total":107374182400,"available":107368476672,"internally_reserved":0,"allocated":192512,"data_stored":54287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 29 23:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.27600000000000002},"min":{"1min":0.191,"5min":0.14499999999999999,"15min":0.14499999999999999},"max":{"1min":0.39800000000000002,"5min":0.435,"15min":0.435},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.29099999999999998,"15min":0.27400000000000002},"min":{"1min":0.20100000000000001,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.42799999999999999,"5min":0.437,"15min":0.437},"last":0.25600000000000001}]},{"osd":2,"last update":"Fri Sep 29 23:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.29599999999999999,"15min":0.27800000000000002},"min":{"1min":0.216,"5min":0.186,"15min":0.186},"max":{"1min":0.42599999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.223},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.309,"15min":0.29299999999999998},"min":{"1min":0.20899999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.45100000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.27800000000000002}]}]},{"osd":2,"up_from":8,"seq":34359738434,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5500,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":104852100,"statfs":{"total":107374182400,"available":107368550400,"internally_reserved":0,"allocated":184320,"data_stored":53655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 29 23:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.28299999999999997,"15min":0.28899999999999998},"min":{"1min":0.19700000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.29099999999999998,"15min":0.29699999999999999},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.433,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.374}]},{"osd":1,"last update":"Fri Sep 29 23:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.21199999999999999,"5min":0.189,"15min":0.189},"max":{"1min":0.46200000000000002,"5min":0.498,"15min":0.498},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.307,"5min":0.313,"15min":0.317},"min":{"1min":0.23499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48099999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.38800000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5624,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":104851976,"statfs":{"total":107374182400,"available":107368423424,"internally_reserved":0,"allocated":180224,"data_stored":52715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 29 23:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.27800000000000002,"15min":0.28399999999999997},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.39900000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.315},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.28199999999999997,"15min":0.27000000000000002},"min":{"1min":0.221,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.41599999999999998,"5min":0.44,"15min":0.44},"last":0.27300000000000002}]},{"osd":2,"last update":"Fri Sep 29 23:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.28100000000000003,"5min":0.28699999999999998,"15min":0.26900000000000002},"min":{"1min":0.22,"5min":0.191,"15min":0.191},"max":{"1min":0.438,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.29099999999999998,"5min":0.29799999999999999,"15min":0.28799999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.45300000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-29T23:28:59.048 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:28:59.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.193+0000 7fc2daffd700 1 Processor -- start 2023-09-29T23:28:59.193 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.193+0000 7fc2daffd700 1 -- start start 2023-09-29T23:28:59.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.193+0000 7fc2daffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc2d4095ab0 0x7fc2d4132440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:59.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.193+0000 7fc2daffd700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d406f700 con 0x7fc2d4094fd0 2023-09-29T23:28:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.193+0000 7fc2daffd700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d4099e30 con 0x7fc2d4095ab0 2023-09-29T23:28:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.193+0000 7fc2d97fa700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc2d4095ab0 0x7fc2d4132440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.194+0000 7fc2d9ffb700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fc2d4094fd0 0x7fc2d40953a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:36698/0 (socket says 172.21.15.92:36698) 2023-09-29T23:28:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.194+0000 7fc2d9ffb700 1 -- 172.21.15.92:0/1907426341 learned_addr learned my addr 172.21.15.92:0/1907426341 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.194+0000 7fc2d97fa700 1 -- 172.21.15.92:0/1907426341 >> v1:172.21.15.92:6789/0 conn(0x7fc2d4094fd0 legacy=0x7fc2d40953a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.194+0000 7fc2d97fa700 1 -- 172.21.15.92:0/1907426341 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d409f1d0 con 0x7fc2d4095ab0 2023-09-29T23:28:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.194+0000 7fc2d97fa700 1 --2- 172.21.15.92:0/1907426341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2d4095ab0 0x7fc2d4132440 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009860 tx=0x7fc2c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de90d552732649d server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.194+0000 7fc2d8ff9700 1 -- 172.21.15.92:0/1907426341 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2c400b680 con 0x7fc2d4095ab0 2023-09-29T23:28:59.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.194+0000 7fc2d8ff9700 1 -- 172.21.15.92:0/1907426341 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c400b7e0 con 0x7fc2d4095ab0 2023-09-29T23:28:59.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.194+0000 7fc2d8ff9700 1 -- 172.21.15.92:0/1907426341 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2c400b990 con 0x7fc2d4095ab0 2023-09-29T23:28:59.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.195+0000 7fc2daffd700 1 -- 172.21.15.92:0/1907426341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2d4095ab0 msgr2=0x7fc2d4132440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:59.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.195+0000 7fc2daffd700 1 --2- 172.21.15.92:0/1907426341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2d4095ab0 0x7fc2d4132440 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009860 tx=0x7fc2c40091a0 comp rx=0 tx=0).stop 2023-09-29T23:28:59.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.195+0000 7fc2daffd700 1 -- 172.21.15.92:0/1907426341 shutdown_connections 2023-09-29T23:28:59.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.195+0000 7fc2daffd700 1 --2- 172.21.15.92:0/1907426341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2d4095ab0 0x7fc2d4132440 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:59.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.195+0000 7fc2daffd700 1 -- 172.21.15.92:0/1907426341 >> 172.21.15.92:0/1907426341 conn(0x7fc2d406b270 msgr2=0x7fc2d406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:59.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.195+0000 7fc2daffd700 1 -- 172.21.15.92:0/1907426341 shutdown_connections 2023-09-29T23:28:59.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.195+0000 7fc2daffd700 1 -- 172.21.15.92:0/1907426341 wait complete. 2023-09-29T23:28:59.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.195+0000 7fc2daffd700 1 Processor -- start 2023-09-29T23:28:59.197 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.196+0000 7fc2daffd700 1 -- start start 2023-09-29T23:28:59.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.196+0000 7fc2daffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2d4094fd0 0x7fc2d40933d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:59.199 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.196+0000 7fc2daffd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d4092a60 con 0x7fc2d4094fd0 2023-09-29T23:28:59.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.196+0000 7fc2d9ffb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2d4094fd0 0x7fc2d40933d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:59.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.196+0000 7fc2d9ffb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2d4094fd0 0x7fc2d40933d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33440/0 (socket says 172.21.15.92:33440) 2023-09-29T23:28:59.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.196+0000 7fc2d9ffb700 1 -- 172.21.15.92:0/1424792133 learned_addr learned my addr 172.21.15.92:0/1424792133 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:59.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.196+0000 7fc2d9ffb700 1 -- 172.21.15.92:0/1424792133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c4009420 con 0x7fc2d4094fd0 2023-09-29T23:28:59.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.196+0000 7fc2d9ffb700 1 --2- 172.21.15.92:0/1424792133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2d4094fd0 0x7fc2d40933d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00ca40 tx=0x7fc2cc001790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:59.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.196+0000 7fc2c9ffb700 1 -- 172.21.15.92:0/1424792133 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2cc003100 con 0x7fc2d4094fd0 2023-09-29T23:28:59.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.196+0000 7fc2c9ffb700 1 -- 172.21.15.92:0/1424792133 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2cc005d80 con 0x7fc2d4094fd0 2023-09-29T23:28:59.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.196+0000 7fc2daffd700 1 -- 172.21.15.92:0/1424792133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d4097590 con 0x7fc2d4094fd0 2023-09-29T23:28:59.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.196+0000 7fc2c9ffb700 1 -- 172.21.15.92:0/1424792133 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2cc00a800 con 0x7fc2d4094fd0 2023-09-29T23:28:59.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.197+0000 7fc2daffd700 1 -- 172.21.15.92:0/1424792133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d4092fa0 con 0x7fc2d4094fd0 2023-09-29T23:28:59.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.197+0000 7fc2c9ffb700 1 -- 172.21.15.92:0/1424792133 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fc2cc00a960 con 0x7fc2d4094fd0 2023-09-29T23:28:59.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.198+0000 7fc2c9ffb700 1 --2- 172.21.15.92:0/1424792133 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc2b8035640 0x7fc2b8037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:59.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.198+0000 7fc2daffd700 1 -- 172.21.15.92:0/1424792133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d40909b0 con 0x7fc2d4094fd0 2023-09-29T23:28:59.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.198+0000 7fc2c9ffb700 1 -- 172.21.15.92:0/1424792133 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fc2cc046b60 con 0x7fc2d4094fd0 2023-09-29T23:28:59.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.198+0000 7fc2d97fa700 1 --2- 172.21.15.92:0/1424792133 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc2b8035640 0x7fc2b8037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:59.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.198+0000 7fc2d97fa700 1 --2- 172.21.15.92:0/1424792133 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc2b8035640 0x7fc2b8037af0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40091e0 tx=0x7fc2c4016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:59.202 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.202+0000 7fc2c9ffb700 1 -- 172.21.15.92:0/1424792133 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2cc0106c0 con 0x7fc2d4094fd0 2023-09-29T23:28:59.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.378+0000 7fc2daffd700 1 -- 172.21.15.92:0/1424792133 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2d4097590 con 0x7fc2b8035640 2023-09-29T23:28:59.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.385+0000 7fc2c9ffb700 1 -- 172.21.15.92:0/1424792133 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264984 (secure 0 0 0) 0x7fc2d4097590 con 0x7fc2b8035640 2023-09-29T23:28:59.388 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:59.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.388+0000 7fc2daffd700 1 -- 172.21.15.92:0/1424792133 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc2b8035640 msgr2=0x7fc2b8037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:59.390 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.388+0000 7fc2daffd700 1 --2- 172.21.15.92:0/1424792133 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc2b8035640 0x7fc2b8037af0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40091e0 tx=0x7fc2c4016000 comp rx=0 tx=0).stop 2023-09-29T23:28:59.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.388+0000 7fc2daffd700 1 -- 172.21.15.92:0/1424792133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2d4094fd0 msgr2=0x7fc2d40933d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:59.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.388+0000 7fc2daffd700 1 --2- 172.21.15.92:0/1424792133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2d4094fd0 0x7fc2d40933d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00ca40 tx=0x7fc2cc001790 comp rx=0 tx=0).stop 2023-09-29T23:28:59.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.388+0000 7fc2daffd700 1 -- 172.21.15.92:0/1424792133 shutdown_connections 2023-09-29T23:28:59.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.388+0000 7fc2daffd700 1 --2- 172.21.15.92:0/1424792133 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc2b8035640 0x7fc2b8037af0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:59.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.388+0000 7fc2daffd700 1 --2- 172.21.15.92:0/1424792133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2d4094fd0 0x7fc2d40933d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:59.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.388+0000 7fc2daffd700 1 -- 172.21.15.92:0/1424792133 >> 172.21.15.92:0/1424792133 conn(0x7fc2d406b270 msgr2=0x7fc2d4086000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:59.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.388+0000 7fc2daffd700 1 -- 172.21.15.92:0/1424792133 shutdown_connections 2023-09-29T23:28:59.391 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.388+0000 7fc2daffd700 1 -- 172.21.15.92:0/1424792133 wait complete. 2023-09-29T23:28:59.391 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-09-29T23:28:59.400 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-09-29T23:28:58.108111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":208,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":16696,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":314556104,"statfs":{"total":322122547200,"available":322105450496,"internally_reserved":0,"allocated":557056,"data_stored":160657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002652"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284180+0000","last_change":"2023-09-29T23:23:45.465624+0000","last_active":"2023-09-29T23:24:36.284180+0000","last_peered":"2023-09-29T23:24:36.284180+0000","last_clean":"2023-09-29T23:24:36.284180+0000","last_became_active":"2023-09-29T23:23:45.464271+0000","last_became_peered":"2023-09-29T23:23:45.464271+0000","last_unstale":"2023-09-29T23:24:36.284180+0000","last_undegraded":"2023-09-29T23:24:36.284180+0000","last_fullsized":"2023-09-29T23:24:36.284180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:54:19.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282759+0000","last_change":"2023-09-29T23:23:45.466587+0000","last_active":"2023-09-29T23:24:36.282759+0000","last_peered":"2023-09-29T23:24:36.282759+0000","last_clean":"2023-09-29T23:24:36.282759+0000","last_became_active":"2023-09-29T23:23:45.466338+0000","last_became_peered":"2023-09-29T23:23:45.466338+0000","last_unstale":"2023-09-29T23:24:36.282759+0000","last_undegraded":"2023-09-29T23:24:36.282759+0000","last_fullsized":"2023-09-29T23:24:36.282759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284501+0000","last_change":"2023-09-29T23:23:45.477248+0000","last_active":"2023-09-29T23:24:36.284501+0000","last_peered":"2023-09-29T23:24:36.284501+0000","last_clean":"2023-09-29T23:24:36.284501+0000","last_became_active":"2023-09-29T23:23:45.474129+0000","last_became_peered":"2023-09-29T23:23:45.474129+0000","last_unstale":"2023-09-29T23:24:36.284501+0000","last_undegraded":"2023-09-29T23:24:36.284501+0000","last_fullsized":"2023-09-29T23:24:36.284501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:09:27.600159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278328+0000","last_change":"2023-09-29T23:23:45.471200+0000","last_active":"2023-09-29T23:24:36.278328+0000","last_peered":"2023-09-29T23:24:36.278328+0000","last_clean":"2023-09-29T23:24:36.278328+0000","last_became_active":"2023-09-29T23:23:45.470971+0000","last_became_peered":"2023-09-29T23:23:45.470971+0000","last_unstale":"2023-09-29T23:24:36.278328+0000","last_undegraded":"2023-09-29T23:24:36.278328+0000","last_fullsized":"2023-09-29T23:24:36.278328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:29:34.531515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282900+0000","last_change":"2023-09-29T23:23:45.473831+0000","last_active":"2023-09-29T23:24:36.282900+0000","last_peered":"2023-09-29T23:24:36.282900+0000","last_clean":"2023-09-29T23:24:36.282900+0000","last_became_active":"2023-09-29T23:23:45.473570+0000","last_became_peered":"2023-09-29T23:23:45.473570+0000","last_unstale":"2023-09-29T23:24:36.282900+0000","last_undegraded":"2023-09-29T23:24:36.282900+0000","last_fullsized":"2023-09-29T23:24:36.282900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:51:36.401360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277945+0000","last_change":"2023-09-29T23:23:45.470583+0000","last_active":"2023-09-29T23:24:36.277945+0000","last_peered":"2023-09-29T23:24:36.277945+0000","last_clean":"2023-09-29T23:24:36.277945+0000","last_became_active":"2023-09-29T23:23:45.470349+0000","last_became_peered":"2023-09-29T23:23:45.470349+0000","last_unstale":"2023-09-29T23:24:36.277945+0000","last_undegraded":"2023-09-29T23:24:36.277945+0000","last_fullsized":"2023-09-29T23:24:36.277945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:50:32.868236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282803+0000","last_change":"2023-09-29T23:23:45.465376+0000","last_active":"2023-09-29T23:24:36.282803+0000","last_peered":"2023-09-29T23:24:36.282803+0000","last_clean":"2023-09-29T23:24:36.282803+0000","last_became_active":"2023-09-29T23:23:45.464893+0000","last_became_peered":"2023-09-29T23:23:45.464893+0000","last_unstale":"2023-09-29T23:24:36.282803+0000","last_undegraded":"2023-09-29T23:24:36.282803+0000","last_fullsized":"2023-09-29T23:24:36.282803+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:34:22.460877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277761+0000","last_change":"2023-09-29T23:23:45.463286+0000","last_active":"2023-09-29T23:24:36.277761+0000","last_peered":"2023-09-29T23:24:36.277761+0000","last_clean":"2023-09-29T23:24:36.277761+0000","last_became_active":"2023-09-29T23:23:45.462888+0000","last_became_peered":"2023-09-29T23:23:45.462888+0000","last_unstale":"2023-09-29T23:24:36.277761+0000","last_undegraded":"2023-09-29T23:24:36.277761+0000","last_fullsized":"2023-09-29T23:24:36.277761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281893+0000","last_change":"2023-09-29T23:23:45.468860+0000","last_active":"2023-09-29T23:24:36.281893+0000","last_peered":"2023-09-29T23:24:36.281893+0000","last_clean":"2023-09-29T23:24:36.281893+0000","last_became_active":"2023-09-29T23:23:45.468303+0000","last_became_peered":"2023-09-29T23:23:45.468303+0000","last_unstale":"2023-09-29T23:24:36.281893+0000","last_undegraded":"2023-09-29T23:24:36.281893+0000","last_fullsized":"2023-09-29T23:24:36.281893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:34:22.460877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.285573+0000","last_change":"2023-09-29T23:24:37.285573+0000","last_active":"2023-09-29T23:24:37.285573+0000","last_peered":"2023-09-29T23:24:37.285573+0000","last_clean":"2023-09-29T23:24:37.285573+0000","last_became_active":"2023-09-29T23:24:37.285339+0000","last_became_peered":"2023-09-29T23:24:37.285339+0000","last_unstale":"2023-09-29T23:24:37.285573+0000","last_undegraded":"2023-09-29T23:24:37.285573+0000","last_fullsized":"2023-09-29T23:24:37.285573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:26:49.563741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284446+0000","last_change":"2023-09-29T23:23:45.467858+0000","last_active":"2023-09-29T23:24:36.284446+0000","last_peered":"2023-09-29T23:24:36.284446+0000","last_clean":"2023-09-29T23:24:36.284446+0000","last_became_active":"2023-09-29T23:23:45.464083+0000","last_became_peered":"2023-09-29T23:23:45.464083+0000","last_unstale":"2023-09-29T23:24:36.284446+0000","last_undegraded":"2023-09-29T23:24:36.284446+0000","last_fullsized":"2023-09-29T23:24:36.284446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:30:57.865969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283523+0000","last_change":"2023-09-29T23:23:45.466588+0000","last_active":"2023-09-29T23:24:36.283523+0000","last_peered":"2023-09-29T23:24:36.283523+0000","last_clean":"2023-09-29T23:24:36.283523+0000","last_became_active":"2023-09-29T23:23:45.466161+0000","last_became_peered":"2023-09-29T23:23:45.466161+0000","last_unstale":"2023-09-29T23:24:36.283523+0000","last_undegraded":"2023-09-29T23:24:36.283523+0000","last_fullsized":"2023-09-29T23:24:36.283523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:13.284557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283618+0000","last_change":"2023-09-29T23:23:45.467402+0000","last_active":"2023-09-29T23:24:36.283618+0000","last_peered":"2023-09-29T23:24:36.283618+0000","last_clean":"2023-09-29T23:24:36.283618+0000","last_became_active":"2023-09-29T23:23:45.467178+0000","last_became_peered":"2023-09-29T23:23:45.467178+0000","last_unstale":"2023-09-29T23:24:36.283618+0000","last_undegraded":"2023-09-29T23:24:36.283618+0000","last_fullsized":"2023-09-29T23:24:36.283618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282929+0000","last_change":"2023-09-29T23:23:45.465231+0000","last_active":"2023-09-29T23:24:36.282929+0000","last_peered":"2023-09-29T23:24:36.282929+0000","last_clean":"2023-09-29T23:24:36.282929+0000","last_became_active":"2023-09-29T23:23:45.464523+0000","last_became_peered":"2023-09-29T23:23:45.464523+0000","last_unstale":"2023-09-29T23:24:36.282929+0000","last_undegraded":"2023-09-29T23:24:36.282929+0000","last_fullsized":"2023-09-29T23:24:36.282929+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:32.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280968+0000","last_change":"2023-09-29T23:23:45.470349+0000","last_active":"2023-09-29T23:24:36.280968+0000","last_peered":"2023-09-29T23:24:36.280968+0000","last_clean":"2023-09-29T23:24:36.280968+0000","last_became_active":"2023-09-29T23:23:45.467004+0000","last_became_peered":"2023-09-29T23:23:45.467004+0000","last_unstale":"2023-09-29T23:24:36.280968+0000","last_undegraded":"2023-09-29T23:24:36.280968+0000","last_fullsized":"2023-09-29T23:24:36.280968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277802+0000","last_change":"2023-09-29T23:23:45.471536+0000","last_active":"2023-09-29T23:24:36.277802+0000","last_peered":"2023-09-29T23:24:36.277802+0000","last_clean":"2023-09-29T23:24:36.277802+0000","last_became_active":"2023-09-29T23:23:45.471334+0000","last_became_peered":"2023-09-29T23:23:45.471334+0000","last_unstale":"2023-09-29T23:24:36.277802+0000","last_undegraded":"2023-09-29T23:24:36.277802+0000","last_fullsized":"2023-09-29T23:24:36.277802+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282404+0000","last_change":"2023-09-29T23:23:45.468857+0000","last_active":"2023-09-29T23:24:36.282404+0000","last_peered":"2023-09-29T23:24:36.282404+0000","last_clean":"2023-09-29T23:24:36.282404+0000","last_became_active":"2023-09-29T23:23:45.468001+0000","last_became_peered":"2023-09-29T23:23:45.468001+0000","last_unstale":"2023-09-29T23:24:36.282404+0000","last_undegraded":"2023-09-29T23:24:36.282404+0000","last_fullsized":"2023-09-29T23:24:36.282404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:11.211646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278543+0000","last_change":"2023-09-29T23:23:45.467819+0000","last_active":"2023-09-29T23:24:36.278543+0000","last_peered":"2023-09-29T23:24:36.278543+0000","last_clean":"2023-09-29T23:24:36.278543+0000","last_became_active":"2023-09-29T23:23:45.467434+0000","last_became_peered":"2023-09-29T23:23:45.467434+0000","last_unstale":"2023-09-29T23:24:36.278543+0000","last_undegraded":"2023-09-29T23:24:36.278543+0000","last_fullsized":"2023-09-29T23:24:36.278543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284385+0000","last_change":"2023-09-29T23:23:45.473751+0000","last_active":"2023-09-29T23:24:36.284385+0000","last_peered":"2023-09-29T23:24:36.284385+0000","last_clean":"2023-09-29T23:24:36.284385+0000","last_became_active":"2023-09-29T23:23:45.473326+0000","last_became_peered":"2023-09-29T23:23:45.473326+0000","last_unstale":"2023-09-29T23:24:36.284385+0000","last_undegraded":"2023-09-29T23:24:36.284385+0000","last_fullsized":"2023-09-29T23:24:36.284385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:21:17.261104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283374+0000","last_change":"2023-09-29T23:23:45.467719+0000","last_active":"2023-09-29T23:24:36.283374+0000","last_peered":"2023-09-29T23:24:36.283374+0000","last_clean":"2023-09-29T23:24:36.283374+0000","last_became_active":"2023-09-29T23:23:45.467494+0000","last_became_peered":"2023-09-29T23:23:45.467494+0000","last_unstale":"2023-09-29T23:24:36.283374+0000","last_undegraded":"2023-09-29T23:24:36.283374+0000","last_fullsized":"2023-09-29T23:24:36.283374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284067+0000","last_change":"2023-09-29T23:23:45.478055+0000","last_active":"2023-09-29T23:24:36.284067+0000","last_peered":"2023-09-29T23:24:36.284067+0000","last_clean":"2023-09-29T23:24:36.284067+0000","last_became_active":"2023-09-29T23:23:45.477408+0000","last_became_peered":"2023-09-29T23:23:45.477408+0000","last_unstale":"2023-09-29T23:24:36.284067+0000","last_undegraded":"2023-09-29T23:24:36.284067+0000","last_fullsized":"2023-09-29T23:24:36.284067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:14:56.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280999+0000","last_change":"2023-09-29T23:23:45.471232+0000","last_active":"2023-09-29T23:24:36.280999+0000","last_peered":"2023-09-29T23:24:36.280999+0000","last_clean":"2023-09-29T23:24:36.280999+0000","last_became_active":"2023-09-29T23:23:45.470574+0000","last_became_peered":"2023-09-29T23:23:45.470574+0000","last_unstale":"2023-09-29T23:24:36.280999+0000","last_undegraded":"2023-09-29T23:24:36.280999+0000","last_fullsized":"2023-09-29T23:24:36.280999+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:25:25.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282928+0000","last_change":"2023-09-29T23:23:45.474093+0000","last_active":"2023-09-29T23:24:36.282928+0000","last_peered":"2023-09-29T23:24:36.282928+0000","last_clean":"2023-09-29T23:24:36.282928+0000","last_became_active":"2023-09-29T23:23:45.473789+0000","last_became_peered":"2023-09-29T23:23:45.473789+0000","last_unstale":"2023-09-29T23:24:36.282928+0000","last_undegraded":"2023-09-29T23:24:36.282928+0000","last_fullsized":"2023-09-29T23:24:36.282928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:46.564456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282401+0000","last_change":"2023-09-29T23:23:45.465993+0000","last_active":"2023-09-29T23:24:36.282401+0000","last_peered":"2023-09-29T23:24:36.282401+0000","last_clean":"2023-09-29T23:24:36.282401+0000","last_became_active":"2023-09-29T23:23:45.465443+0000","last_became_peered":"2023-09-29T23:23:45.465443+0000","last_unstale":"2023-09-29T23:24:36.282401+0000","last_undegraded":"2023-09-29T23:24:36.282401+0000","last_fullsized":"2023-09-29T23:24:36.282401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:12:18.769461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278594+0000","last_change":"2023-09-29T23:23:45.458032+0000","last_active":"2023-09-29T23:24:36.278594+0000","last_peered":"2023-09-29T23:24:36.278594+0000","last_clean":"2023-09-29T23:24:36.278594+0000","last_became_active":"2023-09-29T23:23:45.457799+0000","last_became_peered":"2023-09-29T23:23:45.457799+0000","last_unstale":"2023-09-29T23:24:36.278594+0000","last_undegraded":"2023-09-29T23:24:36.278594+0000","last_fullsized":"2023-09-29T23:24:36.278594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:21:07.207937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.279021+0000","last_change":"2023-09-29T23:23:45.467967+0000","last_active":"2023-09-29T23:24:36.279021+0000","last_peered":"2023-09-29T23:24:36.279021+0000","last_clean":"2023-09-29T23:24:36.279021+0000","last_became_active":"2023-09-29T23:23:45.467730+0000","last_became_peered":"2023-09-29T23:23:45.467730+0000","last_unstale":"2023-09-29T23:24:36.279021+0000","last_undegraded":"2023-09-29T23:24:36.279021+0000","last_fullsized":"2023-09-29T23:24:36.279021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:23:19.840400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281305+0000","last_change":"2023-09-29T23:23:45.076072+0000","last_active":"2023-09-29T23:24:36.281305+0000","last_peered":"2023-09-29T23:24:36.281305+0000","last_clean":"2023-09-29T23:24:36.281305+0000","last_became_active":"2023-09-29T23:23:45.075848+0000","last_became_peered":"2023-09-29T23:23:45.075848+0000","last_unstale":"2023-09-29T23:24:36.281305+0000","last_undegraded":"2023-09-29T23:24:36.281305+0000","last_fullsized":"2023-09-29T23:24:36.281305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:29:13.914085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281203+0000","last_change":"2023-09-29T23:23:45.462781+0000","last_active":"2023-09-29T23:24:36.281203+0000","last_peered":"2023-09-29T23:24:36.281203+0000","last_clean":"2023-09-29T23:24:36.281203+0000","last_became_active":"2023-09-29T23:23:45.462155+0000","last_became_peered":"2023-09-29T23:23:45.462155+0000","last_unstale":"2023-09-29T23:24:36.281203+0000","last_undegraded":"2023-09-29T23:24:36.281203+0000","last_fullsized":"2023-09-29T23:24:36.281203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:13.284557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278059+0000","last_change":"2023-09-29T23:23:45.092553+0000","last_active":"2023-09-29T23:24:36.278059+0000","last_peered":"2023-09-29T23:24:36.278059+0000","last_clean":"2023-09-29T23:24:36.278059+0000","last_became_active":"2023-09-29T23:23:45.092273+0000","last_became_peered":"2023-09-29T23:23:45.092273+0000","last_unstale":"2023-09-29T23:24:36.278059+0000","last_undegraded":"2023-09-29T23:24:36.278059+0000","last_fullsized":"2023-09-29T23:24:36.278059+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284089+0000","last_change":"2023-09-29T23:23:45.464637+0000","last_active":"2023-09-29T23:24:36.284089+0000","last_peered":"2023-09-29T23:24:36.284089+0000","last_clean":"2023-09-29T23:24:36.284089+0000","last_became_active":"2023-09-29T23:23:45.464027+0000","last_became_peered":"2023-09-29T23:23:45.464027+0000","last_unstale":"2023-09-29T23:24:36.284089+0000","last_undegraded":"2023-09-29T23:24:36.284089+0000","last_fullsized":"2023-09-29T23:24:36.284089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283126+0000","last_change":"2023-09-29T23:23:45.088658+0000","last_active":"2023-09-29T23:24:36.283126+0000","last_peered":"2023-09-29T23:24:36.283126+0000","last_clean":"2023-09-29T23:24:36.283126+0000","last_became_active":"2023-09-29T23:23:45.088405+0000","last_became_peered":"2023-09-29T23:23:45.088405+0000","last_unstale":"2023-09-29T23:24:36.283126+0000","last_undegraded":"2023-09-29T23:24:36.283126+0000","last_fullsized":"2023-09-29T23:24:36.283126+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277980+0000","last_change":"2023-09-29T23:23:45.471459+0000","last_active":"2023-09-29T23:24:36.277980+0000","last_peered":"2023-09-29T23:24:36.277980+0000","last_clean":"2023-09-29T23:24:36.277980+0000","last_became_active":"2023-09-29T23:23:45.470917+0000","last_became_peered":"2023-09-29T23:23:45.470917+0000","last_unstale":"2023-09-29T23:24:36.277980+0000","last_undegraded":"2023-09-29T23:24:36.277980+0000","last_fullsized":"2023-09-29T23:24:36.277980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:29:34.889615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282482+0000","last_change":"2023-09-29T23:23:45.070764+0000","last_active":"2023-09-29T23:24:36.282482+0000","last_peered":"2023-09-29T23:24:36.282482+0000","last_clean":"2023-09-29T23:24:36.282482+0000","last_became_active":"2023-09-29T23:23:45.070610+0000","last_became_peered":"2023-09-29T23:23:45.070610+0000","last_unstale":"2023-09-29T23:24:36.282482+0000","last_undegraded":"2023-09-29T23:24:36.282482+0000","last_fullsized":"2023-09-29T23:24:36.282482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:26:19.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280943+0000","last_change":"2023-09-29T23:23:45.475877+0000","last_active":"2023-09-29T23:24:36.280943+0000","last_peered":"2023-09-29T23:24:36.280943+0000","last_clean":"2023-09-29T23:24:36.280943+0000","last_became_active":"2023-09-29T23:23:45.475634+0000","last_became_peered":"2023-09-29T23:23:45.475634+0000","last_unstale":"2023-09-29T23:24:36.280943+0000","last_undegraded":"2023-09-29T23:24:36.280943+0000","last_fullsized":"2023-09-29T23:24:36.280943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:59:25.888959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282216+0000","last_change":"2023-09-29T23:23:45.091556+0000","last_active":"2023-09-29T23:24:36.282216+0000","last_peered":"2023-09-29T23:24:36.282216+0000","last_clean":"2023-09-29T23:24:36.282216+0000","last_became_active":"2023-09-29T23:23:45.091317+0000","last_became_peered":"2023-09-29T23:23:45.091317+0000","last_unstale":"2023-09-29T23:24:36.282216+0000","last_undegraded":"2023-09-29T23:24:36.282216+0000","last_fullsized":"2023-09-29T23:24:36.282216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:53.097532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278718+0000","last_change":"2023-09-29T23:23:45.458805+0000","last_active":"2023-09-29T23:24:36.278718+0000","last_peered":"2023-09-29T23:24:36.278718+0000","last_clean":"2023-09-29T23:24:36.278718+0000","last_became_active":"2023-09-29T23:23:45.458585+0000","last_became_peered":"2023-09-29T23:23:45.458585+0000","last_unstale":"2023-09-29T23:24:36.278718+0000","last_undegraded":"2023-09-29T23:24:36.278718+0000","last_fullsized":"2023-09-29T23:24:36.278718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:05:18.350431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283894+0000","last_change":"2023-09-29T23:23:45.071269+0000","last_active":"2023-09-29T23:24:36.283894+0000","last_peered":"2023-09-29T23:24:36.283894+0000","last_clean":"2023-09-29T23:24:36.283894+0000","last_became_active":"2023-09-29T23:23:45.070986+0000","last_became_peered":"2023-09-29T23:23:45.070986+0000","last_unstale":"2023-09-29T23:24:36.283894+0000","last_undegraded":"2023-09-29T23:24:36.283894+0000","last_fullsized":"2023-09-29T23:24:36.283894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:29.355473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283998+0000","last_change":"2023-09-29T23:23:45.464917+0000","last_active":"2023-09-29T23:24:36.283998+0000","last_peered":"2023-09-29T23:24:36.283998+0000","last_clean":"2023-09-29T23:24:36.283998+0000","last_became_active":"2023-09-29T23:23:45.464510+0000","last_became_peered":"2023-09-29T23:23:45.464510+0000","last_unstale":"2023-09-29T23:24:36.283998+0000","last_undegraded":"2023-09-29T23:24:36.283998+0000","last_fullsized":"2023-09-29T23:24:36.283998+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:58:16.565151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"16'3","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281562+0000","last_change":"2023-09-29T23:23:45.077097+0000","last_active":"2023-09-29T23:24:36.281562+0000","last_peered":"2023-09-29T23:24:36.281562+0000","last_clean":"2023-09-29T23:24:36.281562+0000","last_became_active":"2023-09-29T23:23:45.076856+0000","last_became_peered":"2023-09-29T23:23:45.076856+0000","last_unstale":"2023-09-29T23:24:36.281562+0000","last_undegraded":"2023-09-29T23:24:36.281562+0000","last_fullsized":"2023-09-29T23:24:36.281562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:00:28.816753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281523+0000","last_change":"2023-09-29T23:23:45.462198+0000","last_active":"2023-09-29T23:24:36.281523+0000","last_peered":"2023-09-29T23:24:36.281523+0000","last_clean":"2023-09-29T23:24:36.281523+0000","last_became_active":"2023-09-29T23:23:45.461199+0000","last_became_peered":"2023-09-29T23:23:45.461199+0000","last_unstale":"2023-09-29T23:24:36.281523+0000","last_undegraded":"2023-09-29T23:24:36.281523+0000","last_fullsized":"2023-09-29T23:24:36.281523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:33.901646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"16'6","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278414+0000","last_change":"2023-09-29T23:23:45.093720+0000","last_active":"2023-09-29T23:24:36.278414+0000","last_peered":"2023-09-29T23:24:36.278414+0000","last_clean":"2023-09-29T23:24:36.278414+0000","last_became_active":"2023-09-29T23:23:45.093487+0000","last_became_peered":"2023-09-29T23:23:45.093487+0000","last_unstale":"2023-09-29T23:24:36.278414+0000","last_undegraded":"2023-09-29T23:24:36.278414+0000","last_fullsized":"2023-09-29T23:24:36.278414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284422+0000","last_change":"2023-09-29T23:23:45.466875+0000","last_active":"2023-09-29T23:24:36.284422+0000","last_peered":"2023-09-29T23:24:36.284422+0000","last_clean":"2023-09-29T23:24:36.284422+0000","last_became_active":"2023-09-29T23:23:45.466667+0000","last_became_peered":"2023-09-29T23:23:45.466667+0000","last_unstale":"2023-09-29T23:24:36.284422+0000","last_undegraded":"2023-09-29T23:24:36.284422+0000","last_fullsized":"2023-09-29T23:24:36.284422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:19.696930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283809+0000","last_change":"2023-09-29T23:23:45.089727+0000","last_active":"2023-09-29T23:24:36.283809+0000","last_peered":"2023-09-29T23:24:36.283809+0000","last_clean":"2023-09-29T23:24:36.283809+0000","last_became_active":"2023-09-29T23:23:45.089450+0000","last_became_peered":"2023-09-29T23:23:45.089450+0000","last_unstale":"2023-09-29T23:24:36.283809+0000","last_undegraded":"2023-09-29T23:24:36.283809+0000","last_fullsized":"2023-09-29T23:24:36.283809+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283179+0000","last_change":"2023-09-29T23:23:45.468316+0000","last_active":"2023-09-29T23:24:36.283179+0000","last_peered":"2023-09-29T23:24:36.283179+0000","last_clean":"2023-09-29T23:24:36.283179+0000","last_became_active":"2023-09-29T23:23:45.464801+0000","last_became_peered":"2023-09-29T23:23:45.464801+0000","last_unstale":"2023-09-29T23:24:36.283179+0000","last_undegraded":"2023-09-29T23:24:36.283179+0000","last_fullsized":"2023-09-29T23:24:36.283179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277995+0000","last_change":"2023-09-29T23:23:45.093148+0000","last_active":"2023-09-29T23:24:36.277995+0000","last_peered":"2023-09-29T23:24:36.277995+0000","last_clean":"2023-09-29T23:24:36.277995+0000","last_became_active":"2023-09-29T23:23:45.092902+0000","last_became_peered":"2023-09-29T23:23:45.092902+0000","last_unstale":"2023-09-29T23:24:36.277995+0000","last_undegraded":"2023-09-29T23:24:36.277995+0000","last_fullsized":"2023-09-29T23:24:36.277995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281207+0000","last_change":"2023-09-29T23:23:45.466007+0000","last_active":"2023-09-29T23:24:36.281207+0000","last_peered":"2023-09-29T23:24:36.281207+0000","last_clean":"2023-09-29T23:24:36.281207+0000","last_became_active":"2023-09-29T23:23:45.465743+0000","last_became_peered":"2023-09-29T23:23:45.465743+0000","last_unstale":"2023-09-29T23:24:36.281207+0000","last_undegraded":"2023-09-29T23:24:36.281207+0000","last_fullsized":"2023-09-29T23:24:36.281207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283019+0000","last_change":"2023-09-29T23:23:45.072234+0000","last_active":"2023-09-29T23:24:36.283019+0000","last_peered":"2023-09-29T23:24:36.283019+0000","last_clean":"2023-09-29T23:24:36.283019+0000","last_became_active":"2023-09-29T23:23:45.072009+0000","last_became_peered":"2023-09-29T23:23:45.072009+0000","last_unstale":"2023-09-29T23:24:36.283019+0000","last_undegraded":"2023-09-29T23:24:36.283019+0000","last_fullsized":"2023-09-29T23:24:36.283019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280617+0000","last_change":"2023-09-29T23:23:45.466374+0000","last_active":"2023-09-29T23:24:36.280617+0000","last_peered":"2023-09-29T23:24:36.280617+0000","last_clean":"2023-09-29T23:24:36.280617+0000","last_became_active":"2023-09-29T23:23:45.466169+0000","last_became_peered":"2023-09-29T23:23:45.466169+0000","last_unstale":"2023-09-29T23:24:36.280617+0000","last_undegraded":"2023-09-29T23:24:36.280617+0000","last_fullsized":"2023-09-29T23:24:36.280617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"16'8","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278024+0000","last_change":"2023-09-29T23:23:45.091762+0000","last_active":"2023-09-29T23:24:36.278024+0000","last_peered":"2023-09-29T23:24:36.278024+0000","last_clean":"2023-09-29T23:24:36.278024+0000","last_became_active":"2023-09-29T23:23:45.091386+0000","last_became_peered":"2023-09-29T23:23:45.091386+0000","last_unstale":"2023-09-29T23:24:36.278024+0000","last_undegraded":"2023-09-29T23:24:36.278024+0000","last_fullsized":"2023-09-29T23:24:36.278024+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278185+0000","last_change":"2023-09-29T23:23:45.461421+0000","last_active":"2023-09-29T23:24:36.278185+0000","last_peered":"2023-09-29T23:24:36.278185+0000","last_clean":"2023-09-29T23:24:36.278185+0000","last_became_active":"2023-09-29T23:23:45.460643+0000","last_became_peered":"2023-09-29T23:23:45.460643+0000","last_unstale":"2023-09-29T23:24:36.278185+0000","last_undegraded":"2023-09-29T23:24:36.278185+0000","last_fullsized":"2023-09-29T23:24:36.278185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:12:32.105911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284002+0000","last_change":"2023-09-29T23:23:45.078091+0000","last_active":"2023-09-29T23:24:36.284002+0000","last_peered":"2023-09-29T23:24:36.284002+0000","last_clean":"2023-09-29T23:24:36.284002+0000","last_became_active":"2023-09-29T23:23:45.077734+0000","last_became_peered":"2023-09-29T23:23:45.077734+0000","last_unstale":"2023-09-29T23:24:36.284002+0000","last_undegraded":"2023-09-29T23:24:36.284002+0000","last_fullsized":"2023-09-29T23:24:36.284002+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:53.097532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278792+0000","last_change":"2023-09-29T23:23:45.467950+0000","last_active":"2023-09-29T23:24:36.278792+0000","last_peered":"2023-09-29T23:24:36.278792+0000","last_clean":"2023-09-29T23:24:36.278792+0000","last_became_active":"2023-09-29T23:23:45.467555+0000","last_became_peered":"2023-09-29T23:23:45.467555+0000","last_unstale":"2023-09-29T23:24:36.278792+0000","last_undegraded":"2023-09-29T23:24:36.278792+0000","last_fullsized":"2023-09-29T23:24:36.278792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278873+0000","last_change":"2023-09-29T23:23:45.092471+0000","last_active":"2023-09-29T23:24:36.278873+0000","last_peered":"2023-09-29T23:24:36.278873+0000","last_clean":"2023-09-29T23:24:36.278873+0000","last_became_active":"2023-09-29T23:23:45.092185+0000","last_became_peered":"2023-09-29T23:23:45.092185+0000","last_unstale":"2023-09-29T23:24:36.278873+0000","last_undegraded":"2023-09-29T23:24:36.278873+0000","last_fullsized":"2023-09-29T23:24:36.278873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284089+0000","last_change":"2023-09-29T23:23:45.464504+0000","last_active":"2023-09-29T23:24:36.284089+0000","last_peered":"2023-09-29T23:24:36.284089+0000","last_clean":"2023-09-29T23:24:36.284089+0000","last_became_active":"2023-09-29T23:23:45.463806+0000","last_became_peered":"2023-09-29T23:23:45.463806+0000","last_unstale":"2023-09-29T23:24:36.284089+0000","last_undegraded":"2023-09-29T23:24:36.284089+0000","last_fullsized":"2023-09-29T23:24:36.284089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:25:25.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281453+0000","last_change":"2023-09-29T23:23:45.088776+0000","last_active":"2023-09-29T23:24:36.281453+0000","last_peered":"2023-09-29T23:24:36.281453+0000","last_clean":"2023-09-29T23:24:36.281453+0000","last_became_active":"2023-09-29T23:23:45.088535+0000","last_became_peered":"2023-09-29T23:23:45.088535+0000","last_unstale":"2023-09-29T23:24:36.281453+0000","last_undegraded":"2023-09-29T23:24:36.281453+0000","last_fullsized":"2023-09-29T23:24:36.281453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:35:07.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283419+0000","last_change":"2023-09-29T23:23:45.466379+0000","last_active":"2023-09-29T23:24:36.283419+0000","last_peered":"2023-09-29T23:24:36.283419+0000","last_clean":"2023-09-29T23:24:36.283419+0000","last_became_active":"2023-09-29T23:23:45.465855+0000","last_became_peered":"2023-09-29T23:23:45.465855+0000","last_unstale":"2023-09-29T23:24:36.283419+0000","last_undegraded":"2023-09-29T23:24:36.283419+0000","last_fullsized":"2023-09-29T23:24:36.283419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:06.275738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278346+0000","last_change":"2023-09-29T23:23:45.092714+0000","last_active":"2023-09-29T23:24:36.278346+0000","last_peered":"2023-09-29T23:24:36.278346+0000","last_clean":"2023-09-29T23:24:36.278346+0000","last_became_active":"2023-09-29T23:23:45.092476+0000","last_became_peered":"2023-09-29T23:23:45.092476+0000","last_unstale":"2023-09-29T23:24:36.278346+0000","last_undegraded":"2023-09-29T23:24:36.278346+0000","last_fullsized":"2023-09-29T23:24:36.278346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:20:23.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281616+0000","last_change":"2023-09-29T23:23:45.467010+0000","last_active":"2023-09-29T23:24:36.281616+0000","last_peered":"2023-09-29T23:24:36.281616+0000","last_clean":"2023-09-29T23:24:36.281616+0000","last_became_active":"2023-09-29T23:23:45.466694+0000","last_became_peered":"2023-09-29T23:23:45.466694+0000","last_unstale":"2023-09-29T23:24:36.281616+0000","last_undegraded":"2023-09-29T23:24:36.281616+0000","last_fullsized":"2023-09-29T23:24:36.281616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283738+0000","last_change":"2023-09-29T23:23:45.089622+0000","last_active":"2023-09-29T23:24:36.283738+0000","last_peered":"2023-09-29T23:24:36.283738+0000","last_clean":"2023-09-29T23:24:36.283738+0000","last_became_active":"2023-09-29T23:23:45.089176+0000","last_became_peered":"2023-09-29T23:23:45.089176+0000","last_unstale":"2023-09-29T23:24:36.283738+0000","last_undegraded":"2023-09-29T23:24:36.283738+0000","last_fullsized":"2023-09-29T23:24:36.283738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283257+0000","last_change":"2023-09-29T23:23:45.465798+0000","last_active":"2023-09-29T23:24:36.283257+0000","last_peered":"2023-09-29T23:24:36.283257+0000","last_clean":"2023-09-29T23:24:36.283257+0000","last_became_active":"2023-09-29T23:23:45.465127+0000","last_became_peered":"2023-09-29T23:23:45.465127+0000","last_unstale":"2023-09-29T23:24:36.283257+0000","last_undegraded":"2023-09-29T23:24:36.283257+0000","last_fullsized":"2023-09-29T23:24:36.283257+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:33.901646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281240+0000","last_change":"2023-09-29T23:23:45.075630+0000","last_active":"2023-09-29T23:24:36.281240+0000","last_peered":"2023-09-29T23:24:36.281240+0000","last_clean":"2023-09-29T23:24:36.281240+0000","last_became_active":"2023-09-29T23:23:45.075313+0000","last_became_peered":"2023-09-29T23:23:45.075313+0000","last_unstale":"2023-09-29T23:24:36.281240+0000","last_undegraded":"2023-09-29T23:24:36.281240+0000","last_fullsized":"2023-09-29T23:24:36.281240+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:59:03.439349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.288465+0000","last_change":"2023-09-29T23:24:37.288465+0000","last_active":"2023-09-29T23:24:37.288465+0000","last_peered":"2023-09-29T23:24:37.288465+0000","last_clean":"2023-09-29T23:24:37.288465+0000","last_became_active":"2023-09-29T23:24:37.288220+0000","last_became_peered":"2023-09-29T23:24:37.288220+0000","last_unstale":"2023-09-29T23:24:37.288465+0000","last_undegraded":"2023-09-29T23:24:37.288465+0000","last_fullsized":"2023-09-29T23:24:37.288465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:13:03.586738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280872+0000","last_change":"2023-09-29T23:23:45.075998+0000","last_active":"2023-09-29T23:24:36.280872+0000","last_peered":"2023-09-29T23:24:36.280872+0000","last_clean":"2023-09-29T23:24:36.280872+0000","last_became_active":"2023-09-29T23:23:45.075772+0000","last_became_peered":"2023-09-29T23:23:45.075772+0000","last_unstale":"2023-09-29T23:24:36.280872+0000","last_undegraded":"2023-09-29T23:24:36.280872+0000","last_fullsized":"2023-09-29T23:24:36.280872+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:12:24.809572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277847+0000","last_change":"2023-09-29T23:23:45.463124+0000","last_active":"2023-09-29T23:24:36.277847+0000","last_peered":"2023-09-29T23:24:36.277847+0000","last_clean":"2023-09-29T23:24:36.277847+0000","last_became_active":"2023-09-29T23:23:45.462583+0000","last_became_peered":"2023-09-29T23:23:45.462583+0000","last_unstale":"2023-09-29T23:24:36.277847+0000","last_undegraded":"2023-09-29T23:24:36.277847+0000","last_fullsized":"2023-09-29T23:24:36.277847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:01:57.571277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282321+0000","last_change":"2023-09-29T23:23:45.088750+0000","last_active":"2023-09-29T23:24:36.282321+0000","last_peered":"2023-09-29T23:24:36.282321+0000","last_clean":"2023-09-29T23:24:36.282321+0000","last_became_active":"2023-09-29T23:23:45.088506+0000","last_became_peered":"2023-09-29T23:23:45.088506+0000","last_unstale":"2023-09-29T23:24:36.282321+0000","last_undegraded":"2023-09-29T23:24:36.282321+0000","last_fullsized":"2023-09-29T23:24:36.282321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283202+0000","last_change":"2023-09-29T23:23:45.477617+0000","last_active":"2023-09-29T23:24:36.283202+0000","last_peered":"2023-09-29T23:24:36.283202+0000","last_clean":"2023-09-29T23:24:36.283202+0000","last_became_active":"2023-09-29T23:23:45.477335+0000","last_became_peered":"2023-09-29T23:23:45.477335+0000","last_unstale":"2023-09-29T23:24:36.283202+0000","last_undegraded":"2023-09-29T23:24:36.283202+0000","last_fullsized":"2023-09-29T23:24:36.283202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:44:09.599636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278631+0000","last_change":"2023-09-29T23:23:41.047954+0000","last_active":"2023-09-29T23:24:36.278631+0000","last_peered":"2023-09-29T23:24:36.278631+0000","last_clean":"2023-09-29T23:24:36.278631+0000","last_became_active":"2023-09-29T23:23:41.047701+0000","last_became_peered":"2023-09-29T23:23:41.047701+0000","last_unstale":"2023-09-29T23:24:36.278631+0000","last_undegraded":"2023-09-29T23:24:36.278631+0000","last_fullsized":"2023-09-29T23:24:36.278631+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:08:35.252580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"17'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282609+0000","last_change":"2023-09-29T23:23:45.075607+0000","last_active":"2023-09-29T23:24:36.282609+0000","last_peered":"2023-09-29T23:24:36.282609+0000","last_clean":"2023-09-29T23:24:36.282609+0000","last_became_active":"2023-09-29T23:23:45.075249+0000","last_became_peered":"2023-09-29T23:23:45.075249+0000","last_unstale":"2023-09-29T23:24:36.282609+0000","last_undegraded":"2023-09-29T23:24:36.282609+0000","last_fullsized":"2023-09-29T23:24:36.282609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:55:12.692421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278637+0000","last_change":"2023-09-29T23:23:45.460164+0000","last_active":"2023-09-29T23:24:36.278637+0000","last_peered":"2023-09-29T23:24:36.278637+0000","last_clean":"2023-09-29T23:24:36.278637+0000","last_became_active":"2023-09-29T23:23:45.459933+0000","last_became_peered":"2023-09-29T23:23:45.459933+0000","last_unstale":"2023-09-29T23:24:36.278637+0000","last_undegraded":"2023-09-29T23:24:36.278637+0000","last_fullsized":"2023-09-29T23:24:36.278637+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:25:22.017530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281404+0000","last_change":"2023-09-29T23:23:41.051640+0000","last_active":"2023-09-29T23:24:36.281404+0000","last_peered":"2023-09-29T23:24:36.281404+0000","last_clean":"2023-09-29T23:24:36.281404+0000","last_became_active":"2023-09-29T23:23:41.051398+0000","last_became_peered":"2023-09-29T23:23:41.051398+0000","last_unstale":"2023-09-29T23:24:36.281404+0000","last_undegraded":"2023-09-29T23:24:36.281404+0000","last_fullsized":"2023-09-29T23:24:36.281404+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:49:47.548120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281939+0000","last_change":"2023-09-29T23:23:45.076540+0000","last_active":"2023-09-29T23:24:36.281939+0000","last_peered":"2023-09-29T23:24:36.281939+0000","last_clean":"2023-09-29T23:24:36.281939+0000","last_became_active":"2023-09-29T23:23:45.076293+0000","last_became_peered":"2023-09-29T23:23:45.076293+0000","last_unstale":"2023-09-29T23:24:36.281939+0000","last_undegraded":"2023-09-29T23:24:36.281939+0000","last_fullsized":"2023-09-29T23:24:36.281939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:09.131795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283955+0000","last_change":"2023-09-29T23:23:45.466336+0000","last_active":"2023-09-29T23:24:36.283955+0000","last_peered":"2023-09-29T23:24:36.283955+0000","last_clean":"2023-09-29T23:24:36.283955+0000","last_became_active":"2023-09-29T23:23:45.466115+0000","last_became_peered":"2023-09-29T23:23:45.466115+0000","last_unstale":"2023-09-29T23:24:36.283955+0000","last_undegraded":"2023-09-29T23:24:36.283955+0000","last_fullsized":"2023-09-29T23:24:36.283955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:11.211646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281143+0000","last_change":"2023-09-29T23:23:41.050066+0000","last_active":"2023-09-29T23:24:36.281143+0000","last_peered":"2023-09-29T23:24:36.281143+0000","last_clean":"2023-09-29T23:24:36.281143+0000","last_became_active":"2023-09-29T23:23:41.049786+0000","last_became_peered":"2023-09-29T23:23:41.049786+0000","last_unstale":"2023-09-29T23:24:36.281143+0000","last_undegraded":"2023-09-29T23:24:36.281143+0000","last_fullsized":"2023-09-29T23:24:36.281143+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:22:54.699446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277892+0000","last_change":"2023-09-29T23:23:45.091590+0000","last_active":"2023-09-29T23:24:36.277892+0000","last_peered":"2023-09-29T23:24:36.277892+0000","last_clean":"2023-09-29T23:24:36.277892+0000","last_became_active":"2023-09-29T23:23:45.091162+0000","last_became_peered":"2023-09-29T23:23:45.091162+0000","last_unstale":"2023-09-29T23:24:36.277892+0000","last_undegraded":"2023-09-29T23:24:36.277892+0000","last_fullsized":"2023-09-29T23:24:36.277892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:29:38.240697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283194+0000","last_change":"2023-09-29T23:23:45.474238+0000","last_active":"2023-09-29T23:24:36.283194+0000","last_peered":"2023-09-29T23:24:36.283194+0000","last_clean":"2023-09-29T23:24:36.283194+0000","last_became_active":"2023-09-29T23:23:45.473861+0000","last_became_peered":"2023-09-29T23:23:45.473861+0000","last_unstale":"2023-09-29T23:24:36.283194+0000","last_undegraded":"2023-09-29T23:24:36.283194+0000","last_fullsized":"2023-09-29T23:24:36.283194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:39:43.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283014+0000","last_change":"2023-09-29T23:23:41.049685+0000","last_active":"2023-09-29T23:24:36.283014+0000","last_peered":"2023-09-29T23:24:36.283014+0000","last_clean":"2023-09-29T23:24:36.283014+0000","last_became_active":"2023-09-29T23:23:41.049442+0000","last_became_peered":"2023-09-29T23:23:41.049442+0000","last_unstale":"2023-09-29T23:24:36.283014+0000","last_undegraded":"2023-09-29T23:24:36.283014+0000","last_fullsized":"2023-09-29T23:24:36.283014+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:52:33.065724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277891+0000","last_change":"2023-09-29T23:23:45.092293+0000","last_active":"2023-09-29T23:24:36.277891+0000","last_peered":"2023-09-29T23:24:36.277891+0000","last_clean":"2023-09-29T23:24:36.277891+0000","last_became_active":"2023-09-29T23:23:45.092042+0000","last_became_peered":"2023-09-29T23:23:45.092042+0000","last_unstale":"2023-09-29T23:24:36.277891+0000","last_undegraded":"2023-09-29T23:24:36.277891+0000","last_fullsized":"2023-09-29T23:24:36.277891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:07:16.838088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280566+0000","last_change":"2023-09-29T23:23:45.461917+0000","last_active":"2023-09-29T23:24:36.280566+0000","last_peered":"2023-09-29T23:24:36.280566+0000","last_clean":"2023-09-29T23:24:36.280566+0000","last_became_active":"2023-09-29T23:23:45.461228+0000","last_became_peered":"2023-09-29T23:23:45.461228+0000","last_unstale":"2023-09-29T23:24:36.280566+0000","last_undegraded":"2023-09-29T23:24:36.280566+0000","last_fullsized":"2023-09-29T23:24:36.280566+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:54:19.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280520+0000","last_change":"2023-09-29T23:23:41.051041+0000","last_active":"2023-09-29T23:24:36.280520+0000","last_peered":"2023-09-29T23:24:36.280520+0000","last_clean":"2023-09-29T23:24:36.280520+0000","last_became_active":"2023-09-29T23:23:41.050731+0000","last_became_peered":"2023-09-29T23:23:41.050731+0000","last_unstale":"2023-09-29T23:24:36.280520+0000","last_undegraded":"2023-09-29T23:24:36.280520+0000","last_fullsized":"2023-09-29T23:24:36.280520+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:20.303147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281103+0000","last_change":"2023-09-29T23:23:45.088759+0000","last_active":"2023-09-29T23:24:36.281103+0000","last_peered":"2023-09-29T23:24:36.281103+0000","last_clean":"2023-09-29T23:24:36.281103+0000","last_became_active":"2023-09-29T23:23:45.088510+0000","last_became_peered":"2023-09-29T23:23:45.088510+0000","last_unstale":"2023-09-29T23:24:36.281103+0000","last_undegraded":"2023-09-29T23:24:36.281103+0000","last_fullsized":"2023-09-29T23:24:36.281103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:27:56.918672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281062+0000","last_change":"2023-09-29T23:23:45.472092+0000","last_active":"2023-09-29T23:24:36.281062+0000","last_peered":"2023-09-29T23:24:36.281062+0000","last_clean":"2023-09-29T23:24:36.281062+0000","last_became_active":"2023-09-29T23:23:45.461672+0000","last_became_peered":"2023-09-29T23:23:45.461672+0000","last_unstale":"2023-09-29T23:24:36.281062+0000","last_undegraded":"2023-09-29T23:24:36.281062+0000","last_fullsized":"2023-09-29T23:24:36.281062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:58:16.565151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278081+0000","last_change":"2023-09-29T23:23:41.047062+0000","last_active":"2023-09-29T23:24:36.278081+0000","last_peered":"2023-09-29T23:24:36.278081+0000","last_clean":"2023-09-29T23:24:36.278081+0000","last_became_active":"2023-09-29T23:23:41.046803+0000","last_became_peered":"2023-09-29T23:23:41.046803+0000","last_unstale":"2023-09-29T23:24:36.278081+0000","last_undegraded":"2023-09-29T23:24:36.278081+0000","last_fullsized":"2023-09-29T23:24:36.278081+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:22:14.657466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283094+0000","last_change":"2023-09-29T23:23:45.073226+0000","last_active":"2023-09-29T23:24:36.283094+0000","last_peered":"2023-09-29T23:24:36.283094+0000","last_clean":"2023-09-29T23:24:36.283094+0000","last_became_active":"2023-09-29T23:23:45.072973+0000","last_became_peered":"2023-09-29T23:23:45.072973+0000","last_unstale":"2023-09-29T23:24:36.283094+0000","last_undegraded":"2023-09-29T23:24:36.283094+0000","last_fullsized":"2023-09-29T23:24:36.283094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:27:56.918672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283910+0000","last_change":"2023-09-29T23:23:45.477628+0000","last_active":"2023-09-29T23:24:36.283910+0000","last_peered":"2023-09-29T23:24:36.283910+0000","last_clean":"2023-09-29T23:24:36.283910+0000","last_became_active":"2023-09-29T23:23:45.474318+0000","last_became_peered":"2023-09-29T23:23:45.474318+0000","last_unstale":"2023-09-29T23:24:36.283910+0000","last_undegraded":"2023-09-29T23:24:36.283910+0000","last_fullsized":"2023-09-29T23:24:36.283910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:46:02.634499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282673+0000","last_change":"2023-09-29T23:23:41.050883+0000","last_active":"2023-09-29T23:24:36.282673+0000","last_peered":"2023-09-29T23:24:36.282673+0000","last_clean":"2023-09-29T23:24:36.282673+0000","last_became_active":"2023-09-29T23:23:41.050639+0000","last_became_peered":"2023-09-29T23:23:41.050639+0000","last_unstale":"2023-09-29T23:24:36.282673+0000","last_undegraded":"2023-09-29T23:24:36.282673+0000","last_fullsized":"2023-09-29T23:24:36.282673+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:35:26.897753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281455+0000","last_change":"2023-09-29T23:23:45.077040+0000","last_active":"2023-09-29T23:24:36.281455+0000","last_peered":"2023-09-29T23:24:36.281455+0000","last_clean":"2023-09-29T23:24:36.281455+0000","last_became_active":"2023-09-29T23:23:45.076806+0000","last_became_peered":"2023-09-29T23:23:45.076806+0000","last_unstale":"2023-09-29T23:24:36.281455+0000","last_undegraded":"2023-09-29T23:24:36.281455+0000","last_fullsized":"2023-09-29T23:24:36.281455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:26:19.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281570+0000","last_change":"2023-09-29T23:23:45.462067+0000","last_active":"2023-09-29T23:24:36.281570+0000","last_peered":"2023-09-29T23:24:36.281570+0000","last_clean":"2023-09-29T23:24:36.281570+0000","last_became_active":"2023-09-29T23:23:45.460913+0000","last_became_peered":"2023-09-29T23:23:45.460913+0000","last_unstale":"2023-09-29T23:24:36.281570+0000","last_undegraded":"2023-09-29T23:24:36.281570+0000","last_fullsized":"2023-09-29T23:24:36.281570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:06.275738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282020+0000","last_change":"2023-09-29T23:23:41.050074+0000","last_active":"2023-09-29T23:24:36.282020+0000","last_peered":"2023-09-29T23:24:36.282020+0000","last_clean":"2023-09-29T23:24:36.282020+0000","last_became_active":"2023-09-29T23:23:41.049783+0000","last_became_peered":"2023-09-29T23:23:41.049783+0000","last_unstale":"2023-09-29T23:24:36.282020+0000","last_undegraded":"2023-09-29T23:24:36.282020+0000","last_fullsized":"2023-09-29T23:24:36.282020+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:37:01.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281488+0000","last_change":"2023-09-29T23:23:45.076087+0000","last_active":"2023-09-29T23:24:36.281488+0000","last_peered":"2023-09-29T23:24:36.281488+0000","last_clean":"2023-09-29T23:24:36.281488+0000","last_became_active":"2023-09-29T23:23:45.075273+0000","last_became_peered":"2023-09-29T23:23:45.075273+0000","last_unstale":"2023-09-29T23:24:36.281488+0000","last_undegraded":"2023-09-29T23:24:36.281488+0000","last_fullsized":"2023-09-29T23:24:36.281488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:27.356997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278693+0000","last_change":"2023-09-29T23:23:45.459071+0000","last_active":"2023-09-29T23:24:36.278693+0000","last_peered":"2023-09-29T23:24:36.278693+0000","last_clean":"2023-09-29T23:24:36.278693+0000","last_became_active":"2023-09-29T23:23:45.458250+0000","last_became_peered":"2023-09-29T23:23:45.458250+0000","last_unstale":"2023-09-29T23:24:36.278693+0000","last_undegraded":"2023-09-29T23:24:36.278693+0000","last_fullsized":"2023-09-29T23:24:36.278693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283297+0000","last_change":"2023-09-29T23:23:45.076932+0000","last_active":"2023-09-29T23:24:36.283297+0000","last_peered":"2023-09-29T23:24:36.283297+0000","last_clean":"2023-09-29T23:24:36.283297+0000","last_became_active":"2023-09-29T23:23:45.076638+0000","last_became_peered":"2023-09-29T23:23:45.076638+0000","last_unstale":"2023-09-29T23:24:36.283297+0000","last_undegraded":"2023-09-29T23:24:36.283297+0000","last_fullsized":"2023-09-29T23:24:36.283297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:35:07.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278736+0000","last_change":"2023-09-29T23:23:45.471332+0000","last_active":"2023-09-29T23:24:36.278736+0000","last_peered":"2023-09-29T23:24:36.278736+0000","last_clean":"2023-09-29T23:24:36.278736+0000","last_became_active":"2023-09-29T23:23:45.471013+0000","last_became_peered":"2023-09-29T23:23:45.471013+0000","last_unstale":"2023-09-29T23:24:36.278736+0000","last_undegraded":"2023-09-29T23:24:36.278736+0000","last_fullsized":"2023-09-29T23:24:36.278736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"16'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.295660+0000","last_change":"2023-09-29T23:24:37.295660+0000","last_active":"2023-09-29T23:24:37.295660+0000","last_peered":"2023-09-29T23:24:37.295660+0000","last_clean":"2023-09-29T23:24:37.295660+0000","last_became_active":"2023-09-29T23:24:37.292123+0000","last_became_peered":"2023-09-29T23:24:37.292123+0000","last_unstale":"2023-09-29T23:24:37.295660+0000","last_undegraded":"2023-09-29T23:24:37.295660+0000","last_fullsized":"2023-09-29T23:24:37.295660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:31:58.939763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281307+0000","last_change":"2023-09-29T23:23:45.471929+0000","last_active":"2023-09-29T23:24:36.281307+0000","last_peered":"2023-09-29T23:24:36.281307+0000","last_clean":"2023-09-29T23:24:36.281307+0000","last_became_active":"2023-09-29T23:23:45.471673+0000","last_became_peered":"2023-09-29T23:23:45.471673+0000","last_unstale":"2023-09-29T23:24:36.281307+0000","last_undegraded":"2023-09-29T23:24:36.281307+0000","last_fullsized":"2023-09-29T23:24:36.281307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278632+0000","last_change":"2023-09-29T23:23:45.092434+0000","last_active":"2023-09-29T23:24:36.278632+0000","last_peered":"2023-09-29T23:24:36.278632+0000","last_clean":"2023-09-29T23:24:36.278632+0000","last_became_active":"2023-09-29T23:23:45.092203+0000","last_became_peered":"2023-09-29T23:23:45.092203+0000","last_unstale":"2023-09-29T23:24:36.278632+0000","last_undegraded":"2023-09-29T23:24:36.278632+0000","last_fullsized":"2023-09-29T23:24:36.278632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284145+0000","last_change":"2023-09-29T23:23:45.464734+0000","last_active":"2023-09-29T23:24:36.284145+0000","last_peered":"2023-09-29T23:24:36.284145+0000","last_clean":"2023-09-29T23:24:36.284145+0000","last_became_active":"2023-09-29T23:23:45.464202+0000","last_became_peered":"2023-09-29T23:23:45.464202+0000","last_unstale":"2023-09-29T23:24:36.284145+0000","last_undegraded":"2023-09-29T23:24:36.284145+0000","last_fullsized":"2023-09-29T23:24:36.284145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:59:25.888959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1f","version":"16'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284086+0000","last_change":"2023-09-29T23:23:45.074017+0000","last_active":"2023-09-29T23:24:36.284086+0000","last_peered":"2023-09-29T23:24:36.284086+0000","last_clean":"2023-09-29T23:24:36.284086+0000","last_became_active":"2023-09-29T23:23:45.073772+0000","last_became_peered":"2023-09-29T23:23:45.073772+0000","last_unstale":"2023-09-29T23:24:36.284086+0000","last_undegraded":"2023-09-29T23:24:36.284086+0000","last_fullsized":"2023-09-29T23:24:36.284086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278944+0000","last_change":"2023-09-29T23:23:45.460786+0000","last_active":"2023-09-29T23:24:36.278944+0000","last_peered":"2023-09-29T23:24:36.278944+0000","last_clean":"2023-09-29T23:24:36.278944+0000","last_became_active":"2023-09-29T23:23:45.460548+0000","last_became_peered":"2023-09-29T23:23:45.460548+0000","last_unstale":"2023-09-29T23:24:36.278944+0000","last_undegraded":"2023-09-29T23:24:36.278944+0000","last_fullsized":"2023-09-29T23:24:36.278944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:09:25.160546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278067+0000","last_change":"2023-09-29T23:23:45.471512+0000","last_active":"2023-09-29T23:24:36.278067+0000","last_peered":"2023-09-29T23:24:36.278067+0000","last_clean":"2023-09-29T23:24:36.278067+0000","last_became_active":"2023-09-29T23:23:45.471294+0000","last_became_peered":"2023-09-29T23:23:45.471294+0000","last_unstale":"2023-09-29T23:24:36.278067+0000","last_undegraded":"2023-09-29T23:24:36.278067+0000","last_fullsized":"2023-09-29T23:24:36.278067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:29:14.066786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278131+0000","last_change":"2023-09-29T23:23:45.462314+0000","last_active":"2023-09-29T23:24:36.278131+0000","last_peered":"2023-09-29T23:24:36.278131+0000","last_clean":"2023-09-29T23:24:36.278131+0000","last_became_active":"2023-09-29T23:23:45.461188+0000","last_became_peered":"2023-09-29T23:23:45.461188+0000","last_unstale":"2023-09-29T23:24:36.278131+0000","last_undegraded":"2023-09-29T23:24:36.278131+0000","last_fullsized":"2023-09-29T23:24:36.278131+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:01:06.913634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283328+0000","last_change":"2023-09-29T23:23:45.473685+0000","last_active":"2023-09-29T23:24:36.283328+0000","last_peered":"2023-09-29T23:24:36.283328+0000","last_clean":"2023-09-29T23:24:36.283328+0000","last_became_active":"2023-09-29T23:23:45.473438+0000","last_became_peered":"2023-09-29T23:23:45.473438+0000","last_unstale":"2023-09-29T23:24:36.283328+0000","last_undegraded":"2023-09-29T23:24:36.283328+0000","last_fullsized":"2023-09-29T23:24:36.283328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:39:59.923188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283991+0000","last_change":"2023-09-29T23:23:45.477880+0000","last_active":"2023-09-29T23:24:36.283991+0000","last_peered":"2023-09-29T23:24:36.283991+0000","last_clean":"2023-09-29T23:24:36.283991+0000","last_became_active":"2023-09-29T23:23:45.474163+0000","last_became_peered":"2023-09-29T23:23:45.474163+0000","last_unstale":"2023-09-29T23:24:36.283991+0000","last_undegraded":"2023-09-29T23:24:36.283991+0000","last_fullsized":"2023-09-29T23:24:36.283991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:40:09.175714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283486+0000","last_change":"2023-09-29T23:23:45.473292+0000","last_active":"2023-09-29T23:24:36.283486+0000","last_peered":"2023-09-29T23:24:36.283486+0000","last_clean":"2023-09-29T23:24:36.283486+0000","last_became_active":"2023-09-29T23:23:45.473063+0000","last_became_peered":"2023-09-29T23:23:45.473063+0000","last_unstale":"2023-09-29T23:24:36.283486+0000","last_undegraded":"2023-09-29T23:24:36.283486+0000","last_fullsized":"2023-09-29T23:24:36.283486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:06:47.738713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281692+0000","last_change":"2023-09-29T23:23:45.463712+0000","last_active":"2023-09-29T23:24:36.281692+0000","last_peered":"2023-09-29T23:24:36.281692+0000","last_clean":"2023-09-29T23:24:36.281692+0000","last_became_active":"2023-09-29T23:23:45.463269+0000","last_became_peered":"2023-09-29T23:23:45.463269+0000","last_unstale":"2023-09-29T23:24:36.281692+0000","last_undegraded":"2023-09-29T23:24:36.281692+0000","last_fullsized":"2023-09-29T23:24:36.281692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:32.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705731,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5572,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852028,"statfs":{"total":107374182400,"available":107368476672,"internally_reserved":0,"allocated":192512,"data_stored":54287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 29 23:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.27600000000000002},"min":{"1min":0.191,"5min":0.14499999999999999,"15min":0.14499999999999999},"max":{"1min":0.39800000000000002,"5min":0.435,"15min":0.435},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.29099999999999998,"15min":0.27400000000000002},"min":{"1min":0.20100000000000001,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.42799999999999999,"5min":0.437,"15min":0.437},"last":0.25600000000000001}]},{"osd":2,"last update":"Fri Sep 29 23:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.29599999999999999,"15min":0.27800000000000002},"min":{"1min":0.216,"5min":0.186,"15min":0.186},"max":{"1min":0.42599999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.223},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.309,"15min":0.29299999999999998},"min":{"1min":0.20899999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.45100000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.27800000000000002}]}]},{"osd":2,"up_from":8,"seq":34359738434,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5500,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":104852100,"statfs":{"total":107374182400,"available":107368550400,"internally_reserved":0,"allocated":184320,"data_stored":53655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 29 23:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.28299999999999997,"15min":0.28899999999999998},"min":{"1min":0.19700000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.29099999999999998,"15min":0.29699999999999999},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.433,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.374}]},{"osd":1,"last update":"Fri Sep 29 23:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.21199999999999999,"5min":0.189,"15min":0.189},"max":{"1min":0.46200000000000002,"5min":0.498,"15min":0.498},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.307,"5min":0.313,"15min":0.317},"min":{"1min":0.23499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48099999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.38800000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5624,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":104851976,"statfs":{"total":107374182400,"available":107368423424,"internally_reserved":0,"allocated":180224,"data_stored":52715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 29 23:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.27800000000000002,"15min":0.28399999999999997},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.39900000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.315},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.28199999999999997,"15min":0.27000000000000002},"min":{"1min":0.221,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.41599999999999998,"5min":0.44,"15min":0.44},"last":0.27300000000000002}]},{"osd":2,"last update":"Fri Sep 29 23:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.28100000000000003,"5min":0.28699999999999998,"15min":0.26900000000000002},"min":{"1min":0.22,"5min":0.191,"15min":0.191},"max":{"1min":0.438,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.29099999999999998,"5min":0.29799999999999999,"15min":0.28799999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.45300000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-29T23:28:59.406 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-29T23:28:59.406 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:28:59.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.553+0000 7f364645b700 1 Processor -- start 2023-09-29T23:28:59.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.553+0000 7f364645b700 1 -- start start 2023-09-29T23:28:59.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.553+0000 7f364645b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f36401304e0 0x7f36401328c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:59.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.553+0000 7f364645b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364012d180 con 0x7f364012d5d0 2023-09-29T23:28:59.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.553+0000 7f364645b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364009aa90 con 0x7f36401304e0 2023-09-29T23:28:59.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.553+0000 7f363f7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f36401304e0 0x7f36401328c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:59.554 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.553+0000 7f363ffff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f364012d5d0 0x7f364012d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:36700/0 (socket says 172.21.15.92:36700) 2023-09-29T23:28:59.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.553+0000 7f363ffff700 1 -- 172.21.15.92:0/2255936782 learned_addr learned my addr 172.21.15.92:0/2255936782 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:59.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.554+0000 7f363f7fe700 1 -- 172.21.15.92:0/2255936782 >> v1:172.21.15.92:6789/0 conn(0x7f364012d5d0 legacy=0x7f364012d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:59.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.554+0000 7f363f7fe700 1 -- 172.21.15.92:0/2255936782 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364012e0b0 con 0x7f36401304e0 2023-09-29T23:28:59.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.554+0000 7f363effd700 1 -- 172.21.15.92:0/2255936782 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353378413 0 0) 0x7f364012d180 con 0x7f364012d5d0 2023-09-29T23:28:59.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.554+0000 7f363f7fe700 1 --2- 172.21.15.92:0/2255936782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36401304e0 0x7f36401328c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3634009860 tx=0x7f36340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9943e37e0b465eb server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:59.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.554+0000 7f363effd700 1 -- 172.21.15.92:0/2255936782 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f363400b680 con 0x7f36401304e0 2023-09-29T23:28:59.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.554+0000 7f363effd700 1 -- 172.21.15.92:0/2255936782 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363400b7e0 con 0x7f36401304e0 2023-09-29T23:28:59.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.554+0000 7f363effd700 1 -- 172.21.15.92:0/2255936782 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f363400bad0 con 0x7f36401304e0 2023-09-29T23:28:59.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.554+0000 7f364645b700 1 -- 172.21.15.92:0/2255936782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36401304e0 msgr2=0x7f36401328c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:59.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.554+0000 7f364645b700 1 --2- 172.21.15.92:0/2255936782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36401304e0 0x7f36401328c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3634009860 tx=0x7f36340091a0 comp rx=0 tx=0).stop 2023-09-29T23:28:59.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.554+0000 7f364645b700 1 -- 172.21.15.92:0/2255936782 shutdown_connections 2023-09-29T23:28:59.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.554+0000 7f364645b700 1 --2- 172.21.15.92:0/2255936782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36401304e0 0x7f36401328c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:59.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.554+0000 7f364645b700 1 -- 172.21.15.92:0/2255936782 >> 172.21.15.92:0/2255936782 conn(0x7f364006bbd0 msgr2=0x7f364006dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:59.557 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.554+0000 7f364645b700 1 -- 172.21.15.92:0/2255936782 shutdown_connections 2023-09-29T23:28:59.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.554+0000 7f364645b700 1 -- 172.21.15.92:0/2255936782 wait complete. 2023-09-29T23:28:59.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.555+0000 7f364645b700 1 Processor -- start 2023-09-29T23:28:59.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.555+0000 7f364645b700 1 -- start start 2023-09-29T23:28:59.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.556+0000 7f364645b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f364012d5d0 0x7f364013f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:59.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.556+0000 7f364645b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3640131ad0 con 0x7f364012d5d0 2023-09-29T23:28:59.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.556+0000 7f363ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f364012d5d0 0x7f364013f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:59.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.556+0000 7f363ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f364012d5d0 0x7f364013f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33464/0 (socket says 172.21.15.92:33464) 2023-09-29T23:28:59.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.556+0000 7f363ffff700 1 -- 172.21.15.92:0/1461698932 learned_addr learned my addr 172.21.15.92:0/1461698932 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:59.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.556+0000 7f363ffff700 1 -- 172.21.15.92:0/1461698932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3634009420 con 0x7f364012d5d0 2023-09-29T23:28:59.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.556+0000 7f363ffff700 1 --2- 172.21.15.92:0/1461698932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f364012d5d0 0x7f364013f300 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f363000c690 tx=0x7f3630007c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:59.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.556+0000 7f3627fff700 1 -- 172.21.15.92:0/1461698932 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3630007320 con 0x7f364012d5d0 2023-09-29T23:28:59.558 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.556+0000 7f3627fff700 1 -- 172.21.15.92:0/1461698932 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36300074a0 con 0x7f364012d5d0 2023-09-29T23:28:59.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.556+0000 7f364645b700 1 -- 172.21.15.92:0/1461698932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36400952f0 con 0x7f364012d5d0 2023-09-29T23:28:59.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.556+0000 7f3627fff700 1 -- 172.21.15.92:0/1461698932 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36300057f0 con 0x7f364012d5d0 2023-09-29T23:28:59.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.556+0000 7f364645b700 1 -- 172.21.15.92:0/1461698932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3640099970 con 0x7f364012d5d0 2023-09-29T23:28:59.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.557+0000 7f3627fff700 1 -- 172.21.15.92:0/1461698932 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f3630005950 con 0x7f364012d5d0 2023-09-29T23:28:59.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.557+0000 7f3627fff700 1 --2- 172.21.15.92:0/1461698932 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f362c035640 0x7f362c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:59.559 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.557+0000 7f364645b700 1 -- 172.21.15.92:0/1461698932 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364011b070 con 0x7f364012d5d0 2023-09-29T23:28:59.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.557+0000 7f3627fff700 1 -- 172.21.15.92:0/1461698932 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f3630047250 con 0x7f364012d5d0 2023-09-29T23:28:59.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.558+0000 7f363f7fe700 1 --2- 172.21.15.92:0/1461698932 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f362c035640 0x7f362c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:59.560 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.558+0000 7f363f7fe700 1 --2- 172.21.15.92:0/1461698932 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f362c035640 0x7f362c037af0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f364006b070 tx=0x7f3634016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:59.562 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.562+0000 7f3627fff700 1 -- 172.21.15.92:0/1461698932 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3630005c50 con 0x7f364012d5d0 2023-09-29T23:28:59.739 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.739+0000 7f364645b700 1 -- 172.21.15.92:0/1461698932 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f364005f230 con 0x7f362c035640 2023-09-29T23:28:59.745 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.745+0000 7f3627fff700 1 -- 172.21.15.92:0/1461698932 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264984 (secure 0 0 0) 0x7f364005f230 con 0x7f362c035640 2023-09-29T23:28:59.749 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:28:59.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.748+0000 7f364645b700 1 -- 172.21.15.92:0/1461698932 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f362c035640 msgr2=0x7f362c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:59.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.748+0000 7f364645b700 1 --2- 172.21.15.92:0/1461698932 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f362c035640 0x7f362c037af0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f364006b070 tx=0x7f3634016000 comp rx=0 tx=0).stop 2023-09-29T23:28:59.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.748+0000 7f364645b700 1 -- 172.21.15.92:0/1461698932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f364012d5d0 msgr2=0x7f364013f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:59.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.748+0000 7f364645b700 1 --2- 172.21.15.92:0/1461698932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f364012d5d0 0x7f364013f300 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f363000c690 tx=0x7f3630007c40 comp rx=0 tx=0).stop 2023-09-29T23:28:59.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.748+0000 7f364645b700 1 -- 172.21.15.92:0/1461698932 shutdown_connections 2023-09-29T23:28:59.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.748+0000 7f364645b700 1 --2- 172.21.15.92:0/1461698932 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f362c035640 0x7f362c037af0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:59.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.748+0000 7f364645b700 1 --2- 172.21.15.92:0/1461698932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f364012d5d0 0x7f364013f300 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:59.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.748+0000 7f364645b700 1 -- 172.21.15.92:0/1461698932 >> 172.21.15.92:0/1461698932 conn(0x7f364006bbd0 msgr2=0x7f36401308b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:59.751 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.748+0000 7f364645b700 1 -- 172.21.15.92:0/1461698932 shutdown_connections 2023-09-29T23:28:59.752 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.748+0000 7f364645b700 1 -- 172.21.15.92:0/1461698932 wait complete. 2023-09-29T23:28:59.752 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-09-29T23:28:59.760 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-09-29T23:28:58.108111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":208,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":16696,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":314556104,"statfs":{"total":322122547200,"available":322105450496,"internally_reserved":0,"allocated":557056,"data_stored":160657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002652"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284180+0000","last_change":"2023-09-29T23:23:45.465624+0000","last_active":"2023-09-29T23:24:36.284180+0000","last_peered":"2023-09-29T23:24:36.284180+0000","last_clean":"2023-09-29T23:24:36.284180+0000","last_became_active":"2023-09-29T23:23:45.464271+0000","last_became_peered":"2023-09-29T23:23:45.464271+0000","last_unstale":"2023-09-29T23:24:36.284180+0000","last_undegraded":"2023-09-29T23:24:36.284180+0000","last_fullsized":"2023-09-29T23:24:36.284180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:54:19.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282759+0000","last_change":"2023-09-29T23:23:45.466587+0000","last_active":"2023-09-29T23:24:36.282759+0000","last_peered":"2023-09-29T23:24:36.282759+0000","last_clean":"2023-09-29T23:24:36.282759+0000","last_became_active":"2023-09-29T23:23:45.466338+0000","last_became_peered":"2023-09-29T23:23:45.466338+0000","last_unstale":"2023-09-29T23:24:36.282759+0000","last_undegraded":"2023-09-29T23:24:36.282759+0000","last_fullsized":"2023-09-29T23:24:36.282759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284501+0000","last_change":"2023-09-29T23:23:45.477248+0000","last_active":"2023-09-29T23:24:36.284501+0000","last_peered":"2023-09-29T23:24:36.284501+0000","last_clean":"2023-09-29T23:24:36.284501+0000","last_became_active":"2023-09-29T23:23:45.474129+0000","last_became_peered":"2023-09-29T23:23:45.474129+0000","last_unstale":"2023-09-29T23:24:36.284501+0000","last_undegraded":"2023-09-29T23:24:36.284501+0000","last_fullsized":"2023-09-29T23:24:36.284501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:09:27.600159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278328+0000","last_change":"2023-09-29T23:23:45.471200+0000","last_active":"2023-09-29T23:24:36.278328+0000","last_peered":"2023-09-29T23:24:36.278328+0000","last_clean":"2023-09-29T23:24:36.278328+0000","last_became_active":"2023-09-29T23:23:45.470971+0000","last_became_peered":"2023-09-29T23:23:45.470971+0000","last_unstale":"2023-09-29T23:24:36.278328+0000","last_undegraded":"2023-09-29T23:24:36.278328+0000","last_fullsized":"2023-09-29T23:24:36.278328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:29:34.531515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282900+0000","last_change":"2023-09-29T23:23:45.473831+0000","last_active":"2023-09-29T23:24:36.282900+0000","last_peered":"2023-09-29T23:24:36.282900+0000","last_clean":"2023-09-29T23:24:36.282900+0000","last_became_active":"2023-09-29T23:23:45.473570+0000","last_became_peered":"2023-09-29T23:23:45.473570+0000","last_unstale":"2023-09-29T23:24:36.282900+0000","last_undegraded":"2023-09-29T23:24:36.282900+0000","last_fullsized":"2023-09-29T23:24:36.282900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:51:36.401360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277945+0000","last_change":"2023-09-29T23:23:45.470583+0000","last_active":"2023-09-29T23:24:36.277945+0000","last_peered":"2023-09-29T23:24:36.277945+0000","last_clean":"2023-09-29T23:24:36.277945+0000","last_became_active":"2023-09-29T23:23:45.470349+0000","last_became_peered":"2023-09-29T23:23:45.470349+0000","last_unstale":"2023-09-29T23:24:36.277945+0000","last_undegraded":"2023-09-29T23:24:36.277945+0000","last_fullsized":"2023-09-29T23:24:36.277945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:50:32.868236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282803+0000","last_change":"2023-09-29T23:23:45.465376+0000","last_active":"2023-09-29T23:24:36.282803+0000","last_peered":"2023-09-29T23:24:36.282803+0000","last_clean":"2023-09-29T23:24:36.282803+0000","last_became_active":"2023-09-29T23:23:45.464893+0000","last_became_peered":"2023-09-29T23:23:45.464893+0000","last_unstale":"2023-09-29T23:24:36.282803+0000","last_undegraded":"2023-09-29T23:24:36.282803+0000","last_fullsized":"2023-09-29T23:24:36.282803+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:34:22.460877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277761+0000","last_change":"2023-09-29T23:23:45.463286+0000","last_active":"2023-09-29T23:24:36.277761+0000","last_peered":"2023-09-29T23:24:36.277761+0000","last_clean":"2023-09-29T23:24:36.277761+0000","last_became_active":"2023-09-29T23:23:45.462888+0000","last_became_peered":"2023-09-29T23:23:45.462888+0000","last_unstale":"2023-09-29T23:24:36.277761+0000","last_undegraded":"2023-09-29T23:24:36.277761+0000","last_fullsized":"2023-09-29T23:24:36.277761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281893+0000","last_change":"2023-09-29T23:23:45.468860+0000","last_active":"2023-09-29T23:24:36.281893+0000","last_peered":"2023-09-29T23:24:36.281893+0000","last_clean":"2023-09-29T23:24:36.281893+0000","last_became_active":"2023-09-29T23:23:45.468303+0000","last_became_peered":"2023-09-29T23:23:45.468303+0000","last_unstale":"2023-09-29T23:24:36.281893+0000","last_undegraded":"2023-09-29T23:24:36.281893+0000","last_fullsized":"2023-09-29T23:24:36.281893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:34:22.460877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.285573+0000","last_change":"2023-09-29T23:24:37.285573+0000","last_active":"2023-09-29T23:24:37.285573+0000","last_peered":"2023-09-29T23:24:37.285573+0000","last_clean":"2023-09-29T23:24:37.285573+0000","last_became_active":"2023-09-29T23:24:37.285339+0000","last_became_peered":"2023-09-29T23:24:37.285339+0000","last_unstale":"2023-09-29T23:24:37.285573+0000","last_undegraded":"2023-09-29T23:24:37.285573+0000","last_fullsized":"2023-09-29T23:24:37.285573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:26:49.563741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284446+0000","last_change":"2023-09-29T23:23:45.467858+0000","last_active":"2023-09-29T23:24:36.284446+0000","last_peered":"2023-09-29T23:24:36.284446+0000","last_clean":"2023-09-29T23:24:36.284446+0000","last_became_active":"2023-09-29T23:23:45.464083+0000","last_became_peered":"2023-09-29T23:23:45.464083+0000","last_unstale":"2023-09-29T23:24:36.284446+0000","last_undegraded":"2023-09-29T23:24:36.284446+0000","last_fullsized":"2023-09-29T23:24:36.284446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:30:57.865969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283523+0000","last_change":"2023-09-29T23:23:45.466588+0000","last_active":"2023-09-29T23:24:36.283523+0000","last_peered":"2023-09-29T23:24:36.283523+0000","last_clean":"2023-09-29T23:24:36.283523+0000","last_became_active":"2023-09-29T23:23:45.466161+0000","last_became_peered":"2023-09-29T23:23:45.466161+0000","last_unstale":"2023-09-29T23:24:36.283523+0000","last_undegraded":"2023-09-29T23:24:36.283523+0000","last_fullsized":"2023-09-29T23:24:36.283523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:13.284557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283618+0000","last_change":"2023-09-29T23:23:45.467402+0000","last_active":"2023-09-29T23:24:36.283618+0000","last_peered":"2023-09-29T23:24:36.283618+0000","last_clean":"2023-09-29T23:24:36.283618+0000","last_became_active":"2023-09-29T23:23:45.467178+0000","last_became_peered":"2023-09-29T23:23:45.467178+0000","last_unstale":"2023-09-29T23:24:36.283618+0000","last_undegraded":"2023-09-29T23:24:36.283618+0000","last_fullsized":"2023-09-29T23:24:36.283618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282929+0000","last_change":"2023-09-29T23:23:45.465231+0000","last_active":"2023-09-29T23:24:36.282929+0000","last_peered":"2023-09-29T23:24:36.282929+0000","last_clean":"2023-09-29T23:24:36.282929+0000","last_became_active":"2023-09-29T23:23:45.464523+0000","last_became_peered":"2023-09-29T23:23:45.464523+0000","last_unstale":"2023-09-29T23:24:36.282929+0000","last_undegraded":"2023-09-29T23:24:36.282929+0000","last_fullsized":"2023-09-29T23:24:36.282929+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:32.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280968+0000","last_change":"2023-09-29T23:23:45.470349+0000","last_active":"2023-09-29T23:24:36.280968+0000","last_peered":"2023-09-29T23:24:36.280968+0000","last_clean":"2023-09-29T23:24:36.280968+0000","last_became_active":"2023-09-29T23:23:45.467004+0000","last_became_peered":"2023-09-29T23:23:45.467004+0000","last_unstale":"2023-09-29T23:24:36.280968+0000","last_undegraded":"2023-09-29T23:24:36.280968+0000","last_fullsized":"2023-09-29T23:24:36.280968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277802+0000","last_change":"2023-09-29T23:23:45.471536+0000","last_active":"2023-09-29T23:24:36.277802+0000","last_peered":"2023-09-29T23:24:36.277802+0000","last_clean":"2023-09-29T23:24:36.277802+0000","last_became_active":"2023-09-29T23:23:45.471334+0000","last_became_peered":"2023-09-29T23:23:45.471334+0000","last_unstale":"2023-09-29T23:24:36.277802+0000","last_undegraded":"2023-09-29T23:24:36.277802+0000","last_fullsized":"2023-09-29T23:24:36.277802+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282404+0000","last_change":"2023-09-29T23:23:45.468857+0000","last_active":"2023-09-29T23:24:36.282404+0000","last_peered":"2023-09-29T23:24:36.282404+0000","last_clean":"2023-09-29T23:24:36.282404+0000","last_became_active":"2023-09-29T23:23:45.468001+0000","last_became_peered":"2023-09-29T23:23:45.468001+0000","last_unstale":"2023-09-29T23:24:36.282404+0000","last_undegraded":"2023-09-29T23:24:36.282404+0000","last_fullsized":"2023-09-29T23:24:36.282404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:11.211646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278543+0000","last_change":"2023-09-29T23:23:45.467819+0000","last_active":"2023-09-29T23:24:36.278543+0000","last_peered":"2023-09-29T23:24:36.278543+0000","last_clean":"2023-09-29T23:24:36.278543+0000","last_became_active":"2023-09-29T23:23:45.467434+0000","last_became_peered":"2023-09-29T23:23:45.467434+0000","last_unstale":"2023-09-29T23:24:36.278543+0000","last_undegraded":"2023-09-29T23:24:36.278543+0000","last_fullsized":"2023-09-29T23:24:36.278543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284385+0000","last_change":"2023-09-29T23:23:45.473751+0000","last_active":"2023-09-29T23:24:36.284385+0000","last_peered":"2023-09-29T23:24:36.284385+0000","last_clean":"2023-09-29T23:24:36.284385+0000","last_became_active":"2023-09-29T23:23:45.473326+0000","last_became_peered":"2023-09-29T23:23:45.473326+0000","last_unstale":"2023-09-29T23:24:36.284385+0000","last_undegraded":"2023-09-29T23:24:36.284385+0000","last_fullsized":"2023-09-29T23:24:36.284385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:21:17.261104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283374+0000","last_change":"2023-09-29T23:23:45.467719+0000","last_active":"2023-09-29T23:24:36.283374+0000","last_peered":"2023-09-29T23:24:36.283374+0000","last_clean":"2023-09-29T23:24:36.283374+0000","last_became_active":"2023-09-29T23:23:45.467494+0000","last_became_peered":"2023-09-29T23:23:45.467494+0000","last_unstale":"2023-09-29T23:24:36.283374+0000","last_undegraded":"2023-09-29T23:24:36.283374+0000","last_fullsized":"2023-09-29T23:24:36.283374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284067+0000","last_change":"2023-09-29T23:23:45.478055+0000","last_active":"2023-09-29T23:24:36.284067+0000","last_peered":"2023-09-29T23:24:36.284067+0000","last_clean":"2023-09-29T23:24:36.284067+0000","last_became_active":"2023-09-29T23:23:45.477408+0000","last_became_peered":"2023-09-29T23:23:45.477408+0000","last_unstale":"2023-09-29T23:24:36.284067+0000","last_undegraded":"2023-09-29T23:24:36.284067+0000","last_fullsized":"2023-09-29T23:24:36.284067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:14:56.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280999+0000","last_change":"2023-09-29T23:23:45.471232+0000","last_active":"2023-09-29T23:24:36.280999+0000","last_peered":"2023-09-29T23:24:36.280999+0000","last_clean":"2023-09-29T23:24:36.280999+0000","last_became_active":"2023-09-29T23:23:45.470574+0000","last_became_peered":"2023-09-29T23:23:45.470574+0000","last_unstale":"2023-09-29T23:24:36.280999+0000","last_undegraded":"2023-09-29T23:24:36.280999+0000","last_fullsized":"2023-09-29T23:24:36.280999+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:25:25.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282928+0000","last_change":"2023-09-29T23:23:45.474093+0000","last_active":"2023-09-29T23:24:36.282928+0000","last_peered":"2023-09-29T23:24:36.282928+0000","last_clean":"2023-09-29T23:24:36.282928+0000","last_became_active":"2023-09-29T23:23:45.473789+0000","last_became_peered":"2023-09-29T23:23:45.473789+0000","last_unstale":"2023-09-29T23:24:36.282928+0000","last_undegraded":"2023-09-29T23:24:36.282928+0000","last_fullsized":"2023-09-29T23:24:36.282928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:46.564456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282401+0000","last_change":"2023-09-29T23:23:45.465993+0000","last_active":"2023-09-29T23:24:36.282401+0000","last_peered":"2023-09-29T23:24:36.282401+0000","last_clean":"2023-09-29T23:24:36.282401+0000","last_became_active":"2023-09-29T23:23:45.465443+0000","last_became_peered":"2023-09-29T23:23:45.465443+0000","last_unstale":"2023-09-29T23:24:36.282401+0000","last_undegraded":"2023-09-29T23:24:36.282401+0000","last_fullsized":"2023-09-29T23:24:36.282401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:12:18.769461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278594+0000","last_change":"2023-09-29T23:23:45.458032+0000","last_active":"2023-09-29T23:24:36.278594+0000","last_peered":"2023-09-29T23:24:36.278594+0000","last_clean":"2023-09-29T23:24:36.278594+0000","last_became_active":"2023-09-29T23:23:45.457799+0000","last_became_peered":"2023-09-29T23:23:45.457799+0000","last_unstale":"2023-09-29T23:24:36.278594+0000","last_undegraded":"2023-09-29T23:24:36.278594+0000","last_fullsized":"2023-09-29T23:24:36.278594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:21:07.207937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.279021+0000","last_change":"2023-09-29T23:23:45.467967+0000","last_active":"2023-09-29T23:24:36.279021+0000","last_peered":"2023-09-29T23:24:36.279021+0000","last_clean":"2023-09-29T23:24:36.279021+0000","last_became_active":"2023-09-29T23:23:45.467730+0000","last_became_peered":"2023-09-29T23:23:45.467730+0000","last_unstale":"2023-09-29T23:24:36.279021+0000","last_undegraded":"2023-09-29T23:24:36.279021+0000","last_fullsized":"2023-09-29T23:24:36.279021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:23:19.840400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281305+0000","last_change":"2023-09-29T23:23:45.076072+0000","last_active":"2023-09-29T23:24:36.281305+0000","last_peered":"2023-09-29T23:24:36.281305+0000","last_clean":"2023-09-29T23:24:36.281305+0000","last_became_active":"2023-09-29T23:23:45.075848+0000","last_became_peered":"2023-09-29T23:23:45.075848+0000","last_unstale":"2023-09-29T23:24:36.281305+0000","last_undegraded":"2023-09-29T23:24:36.281305+0000","last_fullsized":"2023-09-29T23:24:36.281305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:29:13.914085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281203+0000","last_change":"2023-09-29T23:23:45.462781+0000","last_active":"2023-09-29T23:24:36.281203+0000","last_peered":"2023-09-29T23:24:36.281203+0000","last_clean":"2023-09-29T23:24:36.281203+0000","last_became_active":"2023-09-29T23:23:45.462155+0000","last_became_peered":"2023-09-29T23:23:45.462155+0000","last_unstale":"2023-09-29T23:24:36.281203+0000","last_undegraded":"2023-09-29T23:24:36.281203+0000","last_fullsized":"2023-09-29T23:24:36.281203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:13.284557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278059+0000","last_change":"2023-09-29T23:23:45.092553+0000","last_active":"2023-09-29T23:24:36.278059+0000","last_peered":"2023-09-29T23:24:36.278059+0000","last_clean":"2023-09-29T23:24:36.278059+0000","last_became_active":"2023-09-29T23:23:45.092273+0000","last_became_peered":"2023-09-29T23:23:45.092273+0000","last_unstale":"2023-09-29T23:24:36.278059+0000","last_undegraded":"2023-09-29T23:24:36.278059+0000","last_fullsized":"2023-09-29T23:24:36.278059+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284089+0000","last_change":"2023-09-29T23:23:45.464637+0000","last_active":"2023-09-29T23:24:36.284089+0000","last_peered":"2023-09-29T23:24:36.284089+0000","last_clean":"2023-09-29T23:24:36.284089+0000","last_became_active":"2023-09-29T23:23:45.464027+0000","last_became_peered":"2023-09-29T23:23:45.464027+0000","last_unstale":"2023-09-29T23:24:36.284089+0000","last_undegraded":"2023-09-29T23:24:36.284089+0000","last_fullsized":"2023-09-29T23:24:36.284089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283126+0000","last_change":"2023-09-29T23:23:45.088658+0000","last_active":"2023-09-29T23:24:36.283126+0000","last_peered":"2023-09-29T23:24:36.283126+0000","last_clean":"2023-09-29T23:24:36.283126+0000","last_became_active":"2023-09-29T23:23:45.088405+0000","last_became_peered":"2023-09-29T23:23:45.088405+0000","last_unstale":"2023-09-29T23:24:36.283126+0000","last_undegraded":"2023-09-29T23:24:36.283126+0000","last_fullsized":"2023-09-29T23:24:36.283126+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277980+0000","last_change":"2023-09-29T23:23:45.471459+0000","last_active":"2023-09-29T23:24:36.277980+0000","last_peered":"2023-09-29T23:24:36.277980+0000","last_clean":"2023-09-29T23:24:36.277980+0000","last_became_active":"2023-09-29T23:23:45.470917+0000","last_became_peered":"2023-09-29T23:23:45.470917+0000","last_unstale":"2023-09-29T23:24:36.277980+0000","last_undegraded":"2023-09-29T23:24:36.277980+0000","last_fullsized":"2023-09-29T23:24:36.277980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:29:34.889615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282482+0000","last_change":"2023-09-29T23:23:45.070764+0000","last_active":"2023-09-29T23:24:36.282482+0000","last_peered":"2023-09-29T23:24:36.282482+0000","last_clean":"2023-09-29T23:24:36.282482+0000","last_became_active":"2023-09-29T23:23:45.070610+0000","last_became_peered":"2023-09-29T23:23:45.070610+0000","last_unstale":"2023-09-29T23:24:36.282482+0000","last_undegraded":"2023-09-29T23:24:36.282482+0000","last_fullsized":"2023-09-29T23:24:36.282482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:26:19.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280943+0000","last_change":"2023-09-29T23:23:45.475877+0000","last_active":"2023-09-29T23:24:36.280943+0000","last_peered":"2023-09-29T23:24:36.280943+0000","last_clean":"2023-09-29T23:24:36.280943+0000","last_became_active":"2023-09-29T23:23:45.475634+0000","last_became_peered":"2023-09-29T23:23:45.475634+0000","last_unstale":"2023-09-29T23:24:36.280943+0000","last_undegraded":"2023-09-29T23:24:36.280943+0000","last_fullsized":"2023-09-29T23:24:36.280943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:59:25.888959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282216+0000","last_change":"2023-09-29T23:23:45.091556+0000","last_active":"2023-09-29T23:24:36.282216+0000","last_peered":"2023-09-29T23:24:36.282216+0000","last_clean":"2023-09-29T23:24:36.282216+0000","last_became_active":"2023-09-29T23:23:45.091317+0000","last_became_peered":"2023-09-29T23:23:45.091317+0000","last_unstale":"2023-09-29T23:24:36.282216+0000","last_undegraded":"2023-09-29T23:24:36.282216+0000","last_fullsized":"2023-09-29T23:24:36.282216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:53.097532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278718+0000","last_change":"2023-09-29T23:23:45.458805+0000","last_active":"2023-09-29T23:24:36.278718+0000","last_peered":"2023-09-29T23:24:36.278718+0000","last_clean":"2023-09-29T23:24:36.278718+0000","last_became_active":"2023-09-29T23:23:45.458585+0000","last_became_peered":"2023-09-29T23:23:45.458585+0000","last_unstale":"2023-09-29T23:24:36.278718+0000","last_undegraded":"2023-09-29T23:24:36.278718+0000","last_fullsized":"2023-09-29T23:24:36.278718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:05:18.350431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283894+0000","last_change":"2023-09-29T23:23:45.071269+0000","last_active":"2023-09-29T23:24:36.283894+0000","last_peered":"2023-09-29T23:24:36.283894+0000","last_clean":"2023-09-29T23:24:36.283894+0000","last_became_active":"2023-09-29T23:23:45.070986+0000","last_became_peered":"2023-09-29T23:23:45.070986+0000","last_unstale":"2023-09-29T23:24:36.283894+0000","last_undegraded":"2023-09-29T23:24:36.283894+0000","last_fullsized":"2023-09-29T23:24:36.283894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:29.355473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283998+0000","last_change":"2023-09-29T23:23:45.464917+0000","last_active":"2023-09-29T23:24:36.283998+0000","last_peered":"2023-09-29T23:24:36.283998+0000","last_clean":"2023-09-29T23:24:36.283998+0000","last_became_active":"2023-09-29T23:23:45.464510+0000","last_became_peered":"2023-09-29T23:23:45.464510+0000","last_unstale":"2023-09-29T23:24:36.283998+0000","last_undegraded":"2023-09-29T23:24:36.283998+0000","last_fullsized":"2023-09-29T23:24:36.283998+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:58:16.565151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"16'3","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281562+0000","last_change":"2023-09-29T23:23:45.077097+0000","last_active":"2023-09-29T23:24:36.281562+0000","last_peered":"2023-09-29T23:24:36.281562+0000","last_clean":"2023-09-29T23:24:36.281562+0000","last_became_active":"2023-09-29T23:23:45.076856+0000","last_became_peered":"2023-09-29T23:23:45.076856+0000","last_unstale":"2023-09-29T23:24:36.281562+0000","last_undegraded":"2023-09-29T23:24:36.281562+0000","last_fullsized":"2023-09-29T23:24:36.281562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:00:28.816753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281523+0000","last_change":"2023-09-29T23:23:45.462198+0000","last_active":"2023-09-29T23:24:36.281523+0000","last_peered":"2023-09-29T23:24:36.281523+0000","last_clean":"2023-09-29T23:24:36.281523+0000","last_became_active":"2023-09-29T23:23:45.461199+0000","last_became_peered":"2023-09-29T23:23:45.461199+0000","last_unstale":"2023-09-29T23:24:36.281523+0000","last_undegraded":"2023-09-29T23:24:36.281523+0000","last_fullsized":"2023-09-29T23:24:36.281523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:33.901646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"16'6","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278414+0000","last_change":"2023-09-29T23:23:45.093720+0000","last_active":"2023-09-29T23:24:36.278414+0000","last_peered":"2023-09-29T23:24:36.278414+0000","last_clean":"2023-09-29T23:24:36.278414+0000","last_became_active":"2023-09-29T23:23:45.093487+0000","last_became_peered":"2023-09-29T23:23:45.093487+0000","last_unstale":"2023-09-29T23:24:36.278414+0000","last_undegraded":"2023-09-29T23:24:36.278414+0000","last_fullsized":"2023-09-29T23:24:36.278414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284422+0000","last_change":"2023-09-29T23:23:45.466875+0000","last_active":"2023-09-29T23:24:36.284422+0000","last_peered":"2023-09-29T23:24:36.284422+0000","last_clean":"2023-09-29T23:24:36.284422+0000","last_became_active":"2023-09-29T23:23:45.466667+0000","last_became_peered":"2023-09-29T23:23:45.466667+0000","last_unstale":"2023-09-29T23:24:36.284422+0000","last_undegraded":"2023-09-29T23:24:36.284422+0000","last_fullsized":"2023-09-29T23:24:36.284422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:19.696930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283809+0000","last_change":"2023-09-29T23:23:45.089727+0000","last_active":"2023-09-29T23:24:36.283809+0000","last_peered":"2023-09-29T23:24:36.283809+0000","last_clean":"2023-09-29T23:24:36.283809+0000","last_became_active":"2023-09-29T23:23:45.089450+0000","last_became_peered":"2023-09-29T23:23:45.089450+0000","last_unstale":"2023-09-29T23:24:36.283809+0000","last_undegraded":"2023-09-29T23:24:36.283809+0000","last_fullsized":"2023-09-29T23:24:36.283809+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283179+0000","last_change":"2023-09-29T23:23:45.468316+0000","last_active":"2023-09-29T23:24:36.283179+0000","last_peered":"2023-09-29T23:24:36.283179+0000","last_clean":"2023-09-29T23:24:36.283179+0000","last_became_active":"2023-09-29T23:23:45.464801+0000","last_became_peered":"2023-09-29T23:23:45.464801+0000","last_unstale":"2023-09-29T23:24:36.283179+0000","last_undegraded":"2023-09-29T23:24:36.283179+0000","last_fullsized":"2023-09-29T23:24:36.283179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277995+0000","last_change":"2023-09-29T23:23:45.093148+0000","last_active":"2023-09-29T23:24:36.277995+0000","last_peered":"2023-09-29T23:24:36.277995+0000","last_clean":"2023-09-29T23:24:36.277995+0000","last_became_active":"2023-09-29T23:23:45.092902+0000","last_became_peered":"2023-09-29T23:23:45.092902+0000","last_unstale":"2023-09-29T23:24:36.277995+0000","last_undegraded":"2023-09-29T23:24:36.277995+0000","last_fullsized":"2023-09-29T23:24:36.277995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281207+0000","last_change":"2023-09-29T23:23:45.466007+0000","last_active":"2023-09-29T23:24:36.281207+0000","last_peered":"2023-09-29T23:24:36.281207+0000","last_clean":"2023-09-29T23:24:36.281207+0000","last_became_active":"2023-09-29T23:23:45.465743+0000","last_became_peered":"2023-09-29T23:23:45.465743+0000","last_unstale":"2023-09-29T23:24:36.281207+0000","last_undegraded":"2023-09-29T23:24:36.281207+0000","last_fullsized":"2023-09-29T23:24:36.281207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283019+0000","last_change":"2023-09-29T23:23:45.072234+0000","last_active":"2023-09-29T23:24:36.283019+0000","last_peered":"2023-09-29T23:24:36.283019+0000","last_clean":"2023-09-29T23:24:36.283019+0000","last_became_active":"2023-09-29T23:23:45.072009+0000","last_became_peered":"2023-09-29T23:23:45.072009+0000","last_unstale":"2023-09-29T23:24:36.283019+0000","last_undegraded":"2023-09-29T23:24:36.283019+0000","last_fullsized":"2023-09-29T23:24:36.283019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280617+0000","last_change":"2023-09-29T23:23:45.466374+0000","last_active":"2023-09-29T23:24:36.280617+0000","last_peered":"2023-09-29T23:24:36.280617+0000","last_clean":"2023-09-29T23:24:36.280617+0000","last_became_active":"2023-09-29T23:23:45.466169+0000","last_became_peered":"2023-09-29T23:23:45.466169+0000","last_unstale":"2023-09-29T23:24:36.280617+0000","last_undegraded":"2023-09-29T23:24:36.280617+0000","last_fullsized":"2023-09-29T23:24:36.280617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"16'8","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278024+0000","last_change":"2023-09-29T23:23:45.091762+0000","last_active":"2023-09-29T23:24:36.278024+0000","last_peered":"2023-09-29T23:24:36.278024+0000","last_clean":"2023-09-29T23:24:36.278024+0000","last_became_active":"2023-09-29T23:23:45.091386+0000","last_became_peered":"2023-09-29T23:23:45.091386+0000","last_unstale":"2023-09-29T23:24:36.278024+0000","last_undegraded":"2023-09-29T23:24:36.278024+0000","last_fullsized":"2023-09-29T23:24:36.278024+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278185+0000","last_change":"2023-09-29T23:23:45.461421+0000","last_active":"2023-09-29T23:24:36.278185+0000","last_peered":"2023-09-29T23:24:36.278185+0000","last_clean":"2023-09-29T23:24:36.278185+0000","last_became_active":"2023-09-29T23:23:45.460643+0000","last_became_peered":"2023-09-29T23:23:45.460643+0000","last_unstale":"2023-09-29T23:24:36.278185+0000","last_undegraded":"2023-09-29T23:24:36.278185+0000","last_fullsized":"2023-09-29T23:24:36.278185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:12:32.105911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284002+0000","last_change":"2023-09-29T23:23:45.078091+0000","last_active":"2023-09-29T23:24:36.284002+0000","last_peered":"2023-09-29T23:24:36.284002+0000","last_clean":"2023-09-29T23:24:36.284002+0000","last_became_active":"2023-09-29T23:23:45.077734+0000","last_became_peered":"2023-09-29T23:23:45.077734+0000","last_unstale":"2023-09-29T23:24:36.284002+0000","last_undegraded":"2023-09-29T23:24:36.284002+0000","last_fullsized":"2023-09-29T23:24:36.284002+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:53.097532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278792+0000","last_change":"2023-09-29T23:23:45.467950+0000","last_active":"2023-09-29T23:24:36.278792+0000","last_peered":"2023-09-29T23:24:36.278792+0000","last_clean":"2023-09-29T23:24:36.278792+0000","last_became_active":"2023-09-29T23:23:45.467555+0000","last_became_peered":"2023-09-29T23:23:45.467555+0000","last_unstale":"2023-09-29T23:24:36.278792+0000","last_undegraded":"2023-09-29T23:24:36.278792+0000","last_fullsized":"2023-09-29T23:24:36.278792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278873+0000","last_change":"2023-09-29T23:23:45.092471+0000","last_active":"2023-09-29T23:24:36.278873+0000","last_peered":"2023-09-29T23:24:36.278873+0000","last_clean":"2023-09-29T23:24:36.278873+0000","last_became_active":"2023-09-29T23:23:45.092185+0000","last_became_peered":"2023-09-29T23:23:45.092185+0000","last_unstale":"2023-09-29T23:24:36.278873+0000","last_undegraded":"2023-09-29T23:24:36.278873+0000","last_fullsized":"2023-09-29T23:24:36.278873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284089+0000","last_change":"2023-09-29T23:23:45.464504+0000","last_active":"2023-09-29T23:24:36.284089+0000","last_peered":"2023-09-29T23:24:36.284089+0000","last_clean":"2023-09-29T23:24:36.284089+0000","last_became_active":"2023-09-29T23:23:45.463806+0000","last_became_peered":"2023-09-29T23:23:45.463806+0000","last_unstale":"2023-09-29T23:24:36.284089+0000","last_undegraded":"2023-09-29T23:24:36.284089+0000","last_fullsized":"2023-09-29T23:24:36.284089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:25:25.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281453+0000","last_change":"2023-09-29T23:23:45.088776+0000","last_active":"2023-09-29T23:24:36.281453+0000","last_peered":"2023-09-29T23:24:36.281453+0000","last_clean":"2023-09-29T23:24:36.281453+0000","last_became_active":"2023-09-29T23:23:45.088535+0000","last_became_peered":"2023-09-29T23:23:45.088535+0000","last_unstale":"2023-09-29T23:24:36.281453+0000","last_undegraded":"2023-09-29T23:24:36.281453+0000","last_fullsized":"2023-09-29T23:24:36.281453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:35:07.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283419+0000","last_change":"2023-09-29T23:23:45.466379+0000","last_active":"2023-09-29T23:24:36.283419+0000","last_peered":"2023-09-29T23:24:36.283419+0000","last_clean":"2023-09-29T23:24:36.283419+0000","last_became_active":"2023-09-29T23:23:45.465855+0000","last_became_peered":"2023-09-29T23:23:45.465855+0000","last_unstale":"2023-09-29T23:24:36.283419+0000","last_undegraded":"2023-09-29T23:24:36.283419+0000","last_fullsized":"2023-09-29T23:24:36.283419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:06.275738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278346+0000","last_change":"2023-09-29T23:23:45.092714+0000","last_active":"2023-09-29T23:24:36.278346+0000","last_peered":"2023-09-29T23:24:36.278346+0000","last_clean":"2023-09-29T23:24:36.278346+0000","last_became_active":"2023-09-29T23:23:45.092476+0000","last_became_peered":"2023-09-29T23:23:45.092476+0000","last_unstale":"2023-09-29T23:24:36.278346+0000","last_undegraded":"2023-09-29T23:24:36.278346+0000","last_fullsized":"2023-09-29T23:24:36.278346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:20:23.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281616+0000","last_change":"2023-09-29T23:23:45.467010+0000","last_active":"2023-09-29T23:24:36.281616+0000","last_peered":"2023-09-29T23:24:36.281616+0000","last_clean":"2023-09-29T23:24:36.281616+0000","last_became_active":"2023-09-29T23:23:45.466694+0000","last_became_peered":"2023-09-29T23:23:45.466694+0000","last_unstale":"2023-09-29T23:24:36.281616+0000","last_undegraded":"2023-09-29T23:24:36.281616+0000","last_fullsized":"2023-09-29T23:24:36.281616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283738+0000","last_change":"2023-09-29T23:23:45.089622+0000","last_active":"2023-09-29T23:24:36.283738+0000","last_peered":"2023-09-29T23:24:36.283738+0000","last_clean":"2023-09-29T23:24:36.283738+0000","last_became_active":"2023-09-29T23:23:45.089176+0000","last_became_peered":"2023-09-29T23:23:45.089176+0000","last_unstale":"2023-09-29T23:24:36.283738+0000","last_undegraded":"2023-09-29T23:24:36.283738+0000","last_fullsized":"2023-09-29T23:24:36.283738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283257+0000","last_change":"2023-09-29T23:23:45.465798+0000","last_active":"2023-09-29T23:24:36.283257+0000","last_peered":"2023-09-29T23:24:36.283257+0000","last_clean":"2023-09-29T23:24:36.283257+0000","last_became_active":"2023-09-29T23:23:45.465127+0000","last_became_peered":"2023-09-29T23:23:45.465127+0000","last_unstale":"2023-09-29T23:24:36.283257+0000","last_undegraded":"2023-09-29T23:24:36.283257+0000","last_fullsized":"2023-09-29T23:24:36.283257+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:33.901646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281240+0000","last_change":"2023-09-29T23:23:45.075630+0000","last_active":"2023-09-29T23:24:36.281240+0000","last_peered":"2023-09-29T23:24:36.281240+0000","last_clean":"2023-09-29T23:24:36.281240+0000","last_became_active":"2023-09-29T23:23:45.075313+0000","last_became_peered":"2023-09-29T23:23:45.075313+0000","last_unstale":"2023-09-29T23:24:36.281240+0000","last_undegraded":"2023-09-29T23:24:36.281240+0000","last_fullsized":"2023-09-29T23:24:36.281240+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:59:03.439349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.288465+0000","last_change":"2023-09-29T23:24:37.288465+0000","last_active":"2023-09-29T23:24:37.288465+0000","last_peered":"2023-09-29T23:24:37.288465+0000","last_clean":"2023-09-29T23:24:37.288465+0000","last_became_active":"2023-09-29T23:24:37.288220+0000","last_became_peered":"2023-09-29T23:24:37.288220+0000","last_unstale":"2023-09-29T23:24:37.288465+0000","last_undegraded":"2023-09-29T23:24:37.288465+0000","last_fullsized":"2023-09-29T23:24:37.288465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:13:03.586738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280872+0000","last_change":"2023-09-29T23:23:45.075998+0000","last_active":"2023-09-29T23:24:36.280872+0000","last_peered":"2023-09-29T23:24:36.280872+0000","last_clean":"2023-09-29T23:24:36.280872+0000","last_became_active":"2023-09-29T23:23:45.075772+0000","last_became_peered":"2023-09-29T23:23:45.075772+0000","last_unstale":"2023-09-29T23:24:36.280872+0000","last_undegraded":"2023-09-29T23:24:36.280872+0000","last_fullsized":"2023-09-29T23:24:36.280872+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:12:24.809572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277847+0000","last_change":"2023-09-29T23:23:45.463124+0000","last_active":"2023-09-29T23:24:36.277847+0000","last_peered":"2023-09-29T23:24:36.277847+0000","last_clean":"2023-09-29T23:24:36.277847+0000","last_became_active":"2023-09-29T23:23:45.462583+0000","last_became_peered":"2023-09-29T23:23:45.462583+0000","last_unstale":"2023-09-29T23:24:36.277847+0000","last_undegraded":"2023-09-29T23:24:36.277847+0000","last_fullsized":"2023-09-29T23:24:36.277847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:01:57.571277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282321+0000","last_change":"2023-09-29T23:23:45.088750+0000","last_active":"2023-09-29T23:24:36.282321+0000","last_peered":"2023-09-29T23:24:36.282321+0000","last_clean":"2023-09-29T23:24:36.282321+0000","last_became_active":"2023-09-29T23:23:45.088506+0000","last_became_peered":"2023-09-29T23:23:45.088506+0000","last_unstale":"2023-09-29T23:24:36.282321+0000","last_undegraded":"2023-09-29T23:24:36.282321+0000","last_fullsized":"2023-09-29T23:24:36.282321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283202+0000","last_change":"2023-09-29T23:23:45.477617+0000","last_active":"2023-09-29T23:24:36.283202+0000","last_peered":"2023-09-29T23:24:36.283202+0000","last_clean":"2023-09-29T23:24:36.283202+0000","last_became_active":"2023-09-29T23:23:45.477335+0000","last_became_peered":"2023-09-29T23:23:45.477335+0000","last_unstale":"2023-09-29T23:24:36.283202+0000","last_undegraded":"2023-09-29T23:24:36.283202+0000","last_fullsized":"2023-09-29T23:24:36.283202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:44:09.599636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278631+0000","last_change":"2023-09-29T23:23:41.047954+0000","last_active":"2023-09-29T23:24:36.278631+0000","last_peered":"2023-09-29T23:24:36.278631+0000","last_clean":"2023-09-29T23:24:36.278631+0000","last_became_active":"2023-09-29T23:23:41.047701+0000","last_became_peered":"2023-09-29T23:23:41.047701+0000","last_unstale":"2023-09-29T23:24:36.278631+0000","last_undegraded":"2023-09-29T23:24:36.278631+0000","last_fullsized":"2023-09-29T23:24:36.278631+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:08:35.252580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"17'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282609+0000","last_change":"2023-09-29T23:23:45.075607+0000","last_active":"2023-09-29T23:24:36.282609+0000","last_peered":"2023-09-29T23:24:36.282609+0000","last_clean":"2023-09-29T23:24:36.282609+0000","last_became_active":"2023-09-29T23:23:45.075249+0000","last_became_peered":"2023-09-29T23:23:45.075249+0000","last_unstale":"2023-09-29T23:24:36.282609+0000","last_undegraded":"2023-09-29T23:24:36.282609+0000","last_fullsized":"2023-09-29T23:24:36.282609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:55:12.692421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278637+0000","last_change":"2023-09-29T23:23:45.460164+0000","last_active":"2023-09-29T23:24:36.278637+0000","last_peered":"2023-09-29T23:24:36.278637+0000","last_clean":"2023-09-29T23:24:36.278637+0000","last_became_active":"2023-09-29T23:23:45.459933+0000","last_became_peered":"2023-09-29T23:23:45.459933+0000","last_unstale":"2023-09-29T23:24:36.278637+0000","last_undegraded":"2023-09-29T23:24:36.278637+0000","last_fullsized":"2023-09-29T23:24:36.278637+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:25:22.017530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281404+0000","last_change":"2023-09-29T23:23:41.051640+0000","last_active":"2023-09-29T23:24:36.281404+0000","last_peered":"2023-09-29T23:24:36.281404+0000","last_clean":"2023-09-29T23:24:36.281404+0000","last_became_active":"2023-09-29T23:23:41.051398+0000","last_became_peered":"2023-09-29T23:23:41.051398+0000","last_unstale":"2023-09-29T23:24:36.281404+0000","last_undegraded":"2023-09-29T23:24:36.281404+0000","last_fullsized":"2023-09-29T23:24:36.281404+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:49:47.548120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281939+0000","last_change":"2023-09-29T23:23:45.076540+0000","last_active":"2023-09-29T23:24:36.281939+0000","last_peered":"2023-09-29T23:24:36.281939+0000","last_clean":"2023-09-29T23:24:36.281939+0000","last_became_active":"2023-09-29T23:23:45.076293+0000","last_became_peered":"2023-09-29T23:23:45.076293+0000","last_unstale":"2023-09-29T23:24:36.281939+0000","last_undegraded":"2023-09-29T23:24:36.281939+0000","last_fullsized":"2023-09-29T23:24:36.281939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:09.131795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283955+0000","last_change":"2023-09-29T23:23:45.466336+0000","last_active":"2023-09-29T23:24:36.283955+0000","last_peered":"2023-09-29T23:24:36.283955+0000","last_clean":"2023-09-29T23:24:36.283955+0000","last_became_active":"2023-09-29T23:23:45.466115+0000","last_became_peered":"2023-09-29T23:23:45.466115+0000","last_unstale":"2023-09-29T23:24:36.283955+0000","last_undegraded":"2023-09-29T23:24:36.283955+0000","last_fullsized":"2023-09-29T23:24:36.283955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:11.211646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281143+0000","last_change":"2023-09-29T23:23:41.050066+0000","last_active":"2023-09-29T23:24:36.281143+0000","last_peered":"2023-09-29T23:24:36.281143+0000","last_clean":"2023-09-29T23:24:36.281143+0000","last_became_active":"2023-09-29T23:23:41.049786+0000","last_became_peered":"2023-09-29T23:23:41.049786+0000","last_unstale":"2023-09-29T23:24:36.281143+0000","last_undegraded":"2023-09-29T23:24:36.281143+0000","last_fullsized":"2023-09-29T23:24:36.281143+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:22:54.699446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277892+0000","last_change":"2023-09-29T23:23:45.091590+0000","last_active":"2023-09-29T23:24:36.277892+0000","last_peered":"2023-09-29T23:24:36.277892+0000","last_clean":"2023-09-29T23:24:36.277892+0000","last_became_active":"2023-09-29T23:23:45.091162+0000","last_became_peered":"2023-09-29T23:23:45.091162+0000","last_unstale":"2023-09-29T23:24:36.277892+0000","last_undegraded":"2023-09-29T23:24:36.277892+0000","last_fullsized":"2023-09-29T23:24:36.277892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:29:38.240697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283194+0000","last_change":"2023-09-29T23:23:45.474238+0000","last_active":"2023-09-29T23:24:36.283194+0000","last_peered":"2023-09-29T23:24:36.283194+0000","last_clean":"2023-09-29T23:24:36.283194+0000","last_became_active":"2023-09-29T23:23:45.473861+0000","last_became_peered":"2023-09-29T23:23:45.473861+0000","last_unstale":"2023-09-29T23:24:36.283194+0000","last_undegraded":"2023-09-29T23:24:36.283194+0000","last_fullsized":"2023-09-29T23:24:36.283194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:39:43.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283014+0000","last_change":"2023-09-29T23:23:41.049685+0000","last_active":"2023-09-29T23:24:36.283014+0000","last_peered":"2023-09-29T23:24:36.283014+0000","last_clean":"2023-09-29T23:24:36.283014+0000","last_became_active":"2023-09-29T23:23:41.049442+0000","last_became_peered":"2023-09-29T23:23:41.049442+0000","last_unstale":"2023-09-29T23:24:36.283014+0000","last_undegraded":"2023-09-29T23:24:36.283014+0000","last_fullsized":"2023-09-29T23:24:36.283014+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:52:33.065724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277891+0000","last_change":"2023-09-29T23:23:45.092293+0000","last_active":"2023-09-29T23:24:36.277891+0000","last_peered":"2023-09-29T23:24:36.277891+0000","last_clean":"2023-09-29T23:24:36.277891+0000","last_became_active":"2023-09-29T23:23:45.092042+0000","last_became_peered":"2023-09-29T23:23:45.092042+0000","last_unstale":"2023-09-29T23:24:36.277891+0000","last_undegraded":"2023-09-29T23:24:36.277891+0000","last_fullsized":"2023-09-29T23:24:36.277891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:07:16.838088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280566+0000","last_change":"2023-09-29T23:23:45.461917+0000","last_active":"2023-09-29T23:24:36.280566+0000","last_peered":"2023-09-29T23:24:36.280566+0000","last_clean":"2023-09-29T23:24:36.280566+0000","last_became_active":"2023-09-29T23:23:45.461228+0000","last_became_peered":"2023-09-29T23:23:45.461228+0000","last_unstale":"2023-09-29T23:24:36.280566+0000","last_undegraded":"2023-09-29T23:24:36.280566+0000","last_fullsized":"2023-09-29T23:24:36.280566+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:54:19.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280520+0000","last_change":"2023-09-29T23:23:41.051041+0000","last_active":"2023-09-29T23:24:36.280520+0000","last_peered":"2023-09-29T23:24:36.280520+0000","last_clean":"2023-09-29T23:24:36.280520+0000","last_became_active":"2023-09-29T23:23:41.050731+0000","last_became_peered":"2023-09-29T23:23:41.050731+0000","last_unstale":"2023-09-29T23:24:36.280520+0000","last_undegraded":"2023-09-29T23:24:36.280520+0000","last_fullsized":"2023-09-29T23:24:36.280520+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:20.303147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281103+0000","last_change":"2023-09-29T23:23:45.088759+0000","last_active":"2023-09-29T23:24:36.281103+0000","last_peered":"2023-09-29T23:24:36.281103+0000","last_clean":"2023-09-29T23:24:36.281103+0000","last_became_active":"2023-09-29T23:23:45.088510+0000","last_became_peered":"2023-09-29T23:23:45.088510+0000","last_unstale":"2023-09-29T23:24:36.281103+0000","last_undegraded":"2023-09-29T23:24:36.281103+0000","last_fullsized":"2023-09-29T23:24:36.281103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:27:56.918672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281062+0000","last_change":"2023-09-29T23:23:45.472092+0000","last_active":"2023-09-29T23:24:36.281062+0000","last_peered":"2023-09-29T23:24:36.281062+0000","last_clean":"2023-09-29T23:24:36.281062+0000","last_became_active":"2023-09-29T23:23:45.461672+0000","last_became_peered":"2023-09-29T23:23:45.461672+0000","last_unstale":"2023-09-29T23:24:36.281062+0000","last_undegraded":"2023-09-29T23:24:36.281062+0000","last_fullsized":"2023-09-29T23:24:36.281062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:58:16.565151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278081+0000","last_change":"2023-09-29T23:23:41.047062+0000","last_active":"2023-09-29T23:24:36.278081+0000","last_peered":"2023-09-29T23:24:36.278081+0000","last_clean":"2023-09-29T23:24:36.278081+0000","last_became_active":"2023-09-29T23:23:41.046803+0000","last_became_peered":"2023-09-29T23:23:41.046803+0000","last_unstale":"2023-09-29T23:24:36.278081+0000","last_undegraded":"2023-09-29T23:24:36.278081+0000","last_fullsized":"2023-09-29T23:24:36.278081+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:22:14.657466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283094+0000","last_change":"2023-09-29T23:23:45.073226+0000","last_active":"2023-09-29T23:24:36.283094+0000","last_peered":"2023-09-29T23:24:36.283094+0000","last_clean":"2023-09-29T23:24:36.283094+0000","last_became_active":"2023-09-29T23:23:45.072973+0000","last_became_peered":"2023-09-29T23:23:45.072973+0000","last_unstale":"2023-09-29T23:24:36.283094+0000","last_undegraded":"2023-09-29T23:24:36.283094+0000","last_fullsized":"2023-09-29T23:24:36.283094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:27:56.918672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283910+0000","last_change":"2023-09-29T23:23:45.477628+0000","last_active":"2023-09-29T23:24:36.283910+0000","last_peered":"2023-09-29T23:24:36.283910+0000","last_clean":"2023-09-29T23:24:36.283910+0000","last_became_active":"2023-09-29T23:23:45.474318+0000","last_became_peered":"2023-09-29T23:23:45.474318+0000","last_unstale":"2023-09-29T23:24:36.283910+0000","last_undegraded":"2023-09-29T23:24:36.283910+0000","last_fullsized":"2023-09-29T23:24:36.283910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:46:02.634499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282673+0000","last_change":"2023-09-29T23:23:41.050883+0000","last_active":"2023-09-29T23:24:36.282673+0000","last_peered":"2023-09-29T23:24:36.282673+0000","last_clean":"2023-09-29T23:24:36.282673+0000","last_became_active":"2023-09-29T23:23:41.050639+0000","last_became_peered":"2023-09-29T23:23:41.050639+0000","last_unstale":"2023-09-29T23:24:36.282673+0000","last_undegraded":"2023-09-29T23:24:36.282673+0000","last_fullsized":"2023-09-29T23:24:36.282673+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:35:26.897753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281455+0000","last_change":"2023-09-29T23:23:45.077040+0000","last_active":"2023-09-29T23:24:36.281455+0000","last_peered":"2023-09-29T23:24:36.281455+0000","last_clean":"2023-09-29T23:24:36.281455+0000","last_became_active":"2023-09-29T23:23:45.076806+0000","last_became_peered":"2023-09-29T23:23:45.076806+0000","last_unstale":"2023-09-29T23:24:36.281455+0000","last_undegraded":"2023-09-29T23:24:36.281455+0000","last_fullsized":"2023-09-29T23:24:36.281455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:26:19.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281570+0000","last_change":"2023-09-29T23:23:45.462067+0000","last_active":"2023-09-29T23:24:36.281570+0000","last_peered":"2023-09-29T23:24:36.281570+0000","last_clean":"2023-09-29T23:24:36.281570+0000","last_became_active":"2023-09-29T23:23:45.460913+0000","last_became_peered":"2023-09-29T23:23:45.460913+0000","last_unstale":"2023-09-29T23:24:36.281570+0000","last_undegraded":"2023-09-29T23:24:36.281570+0000","last_fullsized":"2023-09-29T23:24:36.281570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:06.275738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282020+0000","last_change":"2023-09-29T23:23:41.050074+0000","last_active":"2023-09-29T23:24:36.282020+0000","last_peered":"2023-09-29T23:24:36.282020+0000","last_clean":"2023-09-29T23:24:36.282020+0000","last_became_active":"2023-09-29T23:23:41.049783+0000","last_became_peered":"2023-09-29T23:23:41.049783+0000","last_unstale":"2023-09-29T23:24:36.282020+0000","last_undegraded":"2023-09-29T23:24:36.282020+0000","last_fullsized":"2023-09-29T23:24:36.282020+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:37:01.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281488+0000","last_change":"2023-09-29T23:23:45.076087+0000","last_active":"2023-09-29T23:24:36.281488+0000","last_peered":"2023-09-29T23:24:36.281488+0000","last_clean":"2023-09-29T23:24:36.281488+0000","last_became_active":"2023-09-29T23:23:45.075273+0000","last_became_peered":"2023-09-29T23:23:45.075273+0000","last_unstale":"2023-09-29T23:24:36.281488+0000","last_undegraded":"2023-09-29T23:24:36.281488+0000","last_fullsized":"2023-09-29T23:24:36.281488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:27.356997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278693+0000","last_change":"2023-09-29T23:23:45.459071+0000","last_active":"2023-09-29T23:24:36.278693+0000","last_peered":"2023-09-29T23:24:36.278693+0000","last_clean":"2023-09-29T23:24:36.278693+0000","last_became_active":"2023-09-29T23:23:45.458250+0000","last_became_peered":"2023-09-29T23:23:45.458250+0000","last_unstale":"2023-09-29T23:24:36.278693+0000","last_undegraded":"2023-09-29T23:24:36.278693+0000","last_fullsized":"2023-09-29T23:24:36.278693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283297+0000","last_change":"2023-09-29T23:23:45.076932+0000","last_active":"2023-09-29T23:24:36.283297+0000","last_peered":"2023-09-29T23:24:36.283297+0000","last_clean":"2023-09-29T23:24:36.283297+0000","last_became_active":"2023-09-29T23:23:45.076638+0000","last_became_peered":"2023-09-29T23:23:45.076638+0000","last_unstale":"2023-09-29T23:24:36.283297+0000","last_undegraded":"2023-09-29T23:24:36.283297+0000","last_fullsized":"2023-09-29T23:24:36.283297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:35:07.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278736+0000","last_change":"2023-09-29T23:23:45.471332+0000","last_active":"2023-09-29T23:24:36.278736+0000","last_peered":"2023-09-29T23:24:36.278736+0000","last_clean":"2023-09-29T23:24:36.278736+0000","last_became_active":"2023-09-29T23:23:45.471013+0000","last_became_peered":"2023-09-29T23:23:45.471013+0000","last_unstale":"2023-09-29T23:24:36.278736+0000","last_undegraded":"2023-09-29T23:24:36.278736+0000","last_fullsized":"2023-09-29T23:24:36.278736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"16'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.295660+0000","last_change":"2023-09-29T23:24:37.295660+0000","last_active":"2023-09-29T23:24:37.295660+0000","last_peered":"2023-09-29T23:24:37.295660+0000","last_clean":"2023-09-29T23:24:37.295660+0000","last_became_active":"2023-09-29T23:24:37.292123+0000","last_became_peered":"2023-09-29T23:24:37.292123+0000","last_unstale":"2023-09-29T23:24:37.295660+0000","last_undegraded":"2023-09-29T23:24:37.295660+0000","last_fullsized":"2023-09-29T23:24:37.295660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:31:58.939763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281307+0000","last_change":"2023-09-29T23:23:45.471929+0000","last_active":"2023-09-29T23:24:36.281307+0000","last_peered":"2023-09-29T23:24:36.281307+0000","last_clean":"2023-09-29T23:24:36.281307+0000","last_became_active":"2023-09-29T23:23:45.471673+0000","last_became_peered":"2023-09-29T23:23:45.471673+0000","last_unstale":"2023-09-29T23:24:36.281307+0000","last_undegraded":"2023-09-29T23:24:36.281307+0000","last_fullsized":"2023-09-29T23:24:36.281307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278632+0000","last_change":"2023-09-29T23:23:45.092434+0000","last_active":"2023-09-29T23:24:36.278632+0000","last_peered":"2023-09-29T23:24:36.278632+0000","last_clean":"2023-09-29T23:24:36.278632+0000","last_became_active":"2023-09-29T23:23:45.092203+0000","last_became_peered":"2023-09-29T23:23:45.092203+0000","last_unstale":"2023-09-29T23:24:36.278632+0000","last_undegraded":"2023-09-29T23:24:36.278632+0000","last_fullsized":"2023-09-29T23:24:36.278632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284145+0000","last_change":"2023-09-29T23:23:45.464734+0000","last_active":"2023-09-29T23:24:36.284145+0000","last_peered":"2023-09-29T23:24:36.284145+0000","last_clean":"2023-09-29T23:24:36.284145+0000","last_became_active":"2023-09-29T23:23:45.464202+0000","last_became_peered":"2023-09-29T23:23:45.464202+0000","last_unstale":"2023-09-29T23:24:36.284145+0000","last_undegraded":"2023-09-29T23:24:36.284145+0000","last_fullsized":"2023-09-29T23:24:36.284145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:59:25.888959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1f","version":"16'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284086+0000","last_change":"2023-09-29T23:23:45.074017+0000","last_active":"2023-09-29T23:24:36.284086+0000","last_peered":"2023-09-29T23:24:36.284086+0000","last_clean":"2023-09-29T23:24:36.284086+0000","last_became_active":"2023-09-29T23:23:45.073772+0000","last_became_peered":"2023-09-29T23:23:45.073772+0000","last_unstale":"2023-09-29T23:24:36.284086+0000","last_undegraded":"2023-09-29T23:24:36.284086+0000","last_fullsized":"2023-09-29T23:24:36.284086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278944+0000","last_change":"2023-09-29T23:23:45.460786+0000","last_active":"2023-09-29T23:24:36.278944+0000","last_peered":"2023-09-29T23:24:36.278944+0000","last_clean":"2023-09-29T23:24:36.278944+0000","last_became_active":"2023-09-29T23:23:45.460548+0000","last_became_peered":"2023-09-29T23:23:45.460548+0000","last_unstale":"2023-09-29T23:24:36.278944+0000","last_undegraded":"2023-09-29T23:24:36.278944+0000","last_fullsized":"2023-09-29T23:24:36.278944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:09:25.160546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278067+0000","last_change":"2023-09-29T23:23:45.471512+0000","last_active":"2023-09-29T23:24:36.278067+0000","last_peered":"2023-09-29T23:24:36.278067+0000","last_clean":"2023-09-29T23:24:36.278067+0000","last_became_active":"2023-09-29T23:23:45.471294+0000","last_became_peered":"2023-09-29T23:23:45.471294+0000","last_unstale":"2023-09-29T23:24:36.278067+0000","last_undegraded":"2023-09-29T23:24:36.278067+0000","last_fullsized":"2023-09-29T23:24:36.278067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:29:14.066786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278131+0000","last_change":"2023-09-29T23:23:45.462314+0000","last_active":"2023-09-29T23:24:36.278131+0000","last_peered":"2023-09-29T23:24:36.278131+0000","last_clean":"2023-09-29T23:24:36.278131+0000","last_became_active":"2023-09-29T23:23:45.461188+0000","last_became_peered":"2023-09-29T23:23:45.461188+0000","last_unstale":"2023-09-29T23:24:36.278131+0000","last_undegraded":"2023-09-29T23:24:36.278131+0000","last_fullsized":"2023-09-29T23:24:36.278131+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:01:06.913634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283328+0000","last_change":"2023-09-29T23:23:45.473685+0000","last_active":"2023-09-29T23:24:36.283328+0000","last_peered":"2023-09-29T23:24:36.283328+0000","last_clean":"2023-09-29T23:24:36.283328+0000","last_became_active":"2023-09-29T23:23:45.473438+0000","last_became_peered":"2023-09-29T23:23:45.473438+0000","last_unstale":"2023-09-29T23:24:36.283328+0000","last_undegraded":"2023-09-29T23:24:36.283328+0000","last_fullsized":"2023-09-29T23:24:36.283328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:39:59.923188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283991+0000","last_change":"2023-09-29T23:23:45.477880+0000","last_active":"2023-09-29T23:24:36.283991+0000","last_peered":"2023-09-29T23:24:36.283991+0000","last_clean":"2023-09-29T23:24:36.283991+0000","last_became_active":"2023-09-29T23:23:45.474163+0000","last_became_peered":"2023-09-29T23:23:45.474163+0000","last_unstale":"2023-09-29T23:24:36.283991+0000","last_undegraded":"2023-09-29T23:24:36.283991+0000","last_fullsized":"2023-09-29T23:24:36.283991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:40:09.175714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283486+0000","last_change":"2023-09-29T23:23:45.473292+0000","last_active":"2023-09-29T23:24:36.283486+0000","last_peered":"2023-09-29T23:24:36.283486+0000","last_clean":"2023-09-29T23:24:36.283486+0000","last_became_active":"2023-09-29T23:23:45.473063+0000","last_became_peered":"2023-09-29T23:23:45.473063+0000","last_unstale":"2023-09-29T23:24:36.283486+0000","last_undegraded":"2023-09-29T23:24:36.283486+0000","last_fullsized":"2023-09-29T23:24:36.283486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:06:47.738713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281692+0000","last_change":"2023-09-29T23:23:45.463712+0000","last_active":"2023-09-29T23:24:36.281692+0000","last_peered":"2023-09-29T23:24:36.281692+0000","last_clean":"2023-09-29T23:24:36.281692+0000","last_became_active":"2023-09-29T23:23:45.463269+0000","last_became_peered":"2023-09-29T23:23:45.463269+0000","last_unstale":"2023-09-29T23:24:36.281692+0000","last_undegraded":"2023-09-29T23:24:36.281692+0000","last_fullsized":"2023-09-29T23:24:36.281692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:32.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705731,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5572,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852028,"statfs":{"total":107374182400,"available":107368476672,"internally_reserved":0,"allocated":192512,"data_stored":54287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 29 23:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.27600000000000002},"min":{"1min":0.191,"5min":0.14499999999999999,"15min":0.14499999999999999},"max":{"1min":0.39800000000000002,"5min":0.435,"15min":0.435},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.29099999999999998,"15min":0.27400000000000002},"min":{"1min":0.20100000000000001,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.42799999999999999,"5min":0.437,"15min":0.437},"last":0.25600000000000001}]},{"osd":2,"last update":"Fri Sep 29 23:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.29599999999999999,"15min":0.27800000000000002},"min":{"1min":0.216,"5min":0.186,"15min":0.186},"max":{"1min":0.42599999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.223},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.309,"15min":0.29299999999999998},"min":{"1min":0.20899999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.45100000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.27800000000000002}]}]},{"osd":2,"up_from":8,"seq":34359738434,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5500,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":104852100,"statfs":{"total":107374182400,"available":107368550400,"internally_reserved":0,"allocated":184320,"data_stored":53655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 29 23:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.28299999999999997,"15min":0.28899999999999998},"min":{"1min":0.19700000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.29099999999999998,"15min":0.29699999999999999},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.433,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.374}]},{"osd":1,"last update":"Fri Sep 29 23:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.21199999999999999,"5min":0.189,"15min":0.189},"max":{"1min":0.46200000000000002,"5min":0.498,"15min":0.498},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.307,"5min":0.313,"15min":0.317},"min":{"1min":0.23499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48099999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.38800000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5624,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":104851976,"statfs":{"total":107374182400,"available":107368423424,"internally_reserved":0,"allocated":180224,"data_stored":52715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 29 23:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.27800000000000002,"15min":0.28399999999999997},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.39900000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.315},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.28199999999999997,"15min":0.27000000000000002},"min":{"1min":0.221,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.41599999999999998,"5min":0.44,"15min":0.44},"last":0.27300000000000002}]},{"osd":2,"last update":"Fri Sep 29 23:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.28100000000000003,"5min":0.28699999999999998,"15min":0.26900000000000002},"min":{"1min":0.22,"5min":0.191,"15min":0.191},"max":{"1min":0.438,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.29099999999999998,"5min":0.29799999999999999,"15min":0.28799999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.45300000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-29T23:28:59.766 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-29T23:28:59.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.913+0000 7fa5ca161700 1 Processor -- start 2023-09-29T23:28:59.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.913+0000 7fa5ca161700 1 -- start start 2023-09-29T23:28:59.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.913+0000 7fa5ca161700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa5c40a3030 0x7fa5c412f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:59.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.913+0000 7fa5ca161700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c40997f0 con 0x7fa5c412fae0 2023-09-29T23:28:59.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.913+0000 7fa5ca161700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c40a3400 con 0x7fa5c40a3030 2023-09-29T23:28:59.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.913+0000 7fa5c37fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa5c40a3030 0x7fa5c412f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:59.915 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.913+0000 7fa5c2ffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fa5c412fae0 0x7fa5c4095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:36702/0 (socket says 172.21.15.92:36702) 2023-09-29T23:28:59.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.913+0000 7fa5c2ffd700 1 -- 172.21.15.92:0/546001755 learned_addr learned my addr 172.21.15.92:0/546001755 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:28:59.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.914+0000 7fa5c37fe700 1 -- 172.21.15.92:0/546001755 >> v1:172.21.15.92:6789/0 conn(0x7fa5c412fae0 legacy=0x7fa5c4095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:59.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.914+0000 7fa5c27fc700 1 -- 172.21.15.92:0/546001755 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308701311 0 0) 0x7fa5c40997f0 con 0x7fa5c412fae0 2023-09-29T23:28:59.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.914+0000 7fa5c37fe700 1 -- 172.21.15.92:0/546001755 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c40977a0 con 0x7fa5c40a3030 2023-09-29T23:28:59.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.914+0000 7fa5c37fe700 1 --2- 172.21.15.92:0/546001755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c40a3030 0x7fa5c412f5a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009860 tx=0x7fa5bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b5acd847f88218 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:59.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.914+0000 7fa5c27fc700 1 -- 172.21.15.92:0/546001755 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5bc00b710 con 0x7fa5c40a3030 2023-09-29T23:28:59.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.914+0000 7fa5c27fc700 1 -- 172.21.15.92:0/546001755 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc00b870 con 0x7fa5c40a3030 2023-09-29T23:28:59.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.914+0000 7fa5c27fc700 1 -- 172.21.15.92:0/546001755 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5bc00ba20 con 0x7fa5c40a3030 2023-09-29T23:28:59.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.914+0000 7fa5ca161700 1 -- 172.21.15.92:0/546001755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c40a3030 msgr2=0x7fa5c412f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:28:59.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.914+0000 7fa5ca161700 1 --2- 172.21.15.92:0/546001755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c40a3030 0x7fa5c412f5a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009860 tx=0x7fa5bc0091a0 comp rx=0 tx=0).stop 2023-09-29T23:28:59.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.914+0000 7fa5ca161700 1 -- 172.21.15.92:0/546001755 shutdown_connections 2023-09-29T23:28:59.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.914+0000 7fa5ca161700 1 --2- 172.21.15.92:0/546001755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c40a3030 0x7fa5c412f5a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:28:59.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.914+0000 7fa5ca161700 1 -- 172.21.15.92:0/546001755 >> 172.21.15.92:0/546001755 conn(0x7fa5c4067fc0 msgr2=0x7fa5c40a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:28:59.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.914+0000 7fa5ca161700 1 -- 172.21.15.92:0/546001755 shutdown_connections 2023-09-29T23:28:59.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.914+0000 7fa5ca161700 1 -- 172.21.15.92:0/546001755 wait complete. 2023-09-29T23:28:59.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.915+0000 7fa5ca161700 1 Processor -- start 2023-09-29T23:28:59.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.915+0000 7fa5ca161700 1 -- start start 2023-09-29T23:28:59.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.916+0000 7fa5ca161700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c40a3030 0x7fa5c413e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:59.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.916+0000 7fa5ca161700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c411d1f0 con 0x7fa5c40a3030 2023-09-29T23:28:59.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.916+0000 7fa5c37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c40a3030 0x7fa5c413e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:59.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.916+0000 7fa5c37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c40a3030 0x7fa5c413e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33488/0 (socket says 172.21.15.92:33488) 2023-09-29T23:28:59.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.916+0000 7fa5c37fe700 1 -- 172.21.15.92:0/1062183972 learned_addr learned my addr 172.21.15.92:0/1062183972 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:28:59.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.916+0000 7fa5c37fe700 1 -- 172.21.15.92:0/1062183972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc009420 con 0x7fa5c40a3030 2023-09-29T23:28:59.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.916+0000 7fa5c37fe700 1 --2- 172.21.15.92:0/1062183972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c40a3030 0x7fa5c413e4d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc000c00 tx=0x7fa5bc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:59.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.916+0000 7fa5bb7fe700 1 -- 172.21.15.92:0/1062183972 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5bc011e70 con 0x7fa5c40a3030 2023-09-29T23:28:59.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.916+0000 7fa5bb7fe700 1 -- 172.21.15.92:0/1062183972 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc020070 con 0x7fa5c40a3030 2023-09-29T23:28:59.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.916+0000 7fa5bb7fe700 1 -- 172.21.15.92:0/1062183972 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5bc01b590 con 0x7fa5c40a3030 2023-09-29T23:28:59.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.916+0000 7fa5ca161700 1 -- 172.21.15.92:0/1062183972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c412ce00 con 0x7fa5c40a3030 2023-09-29T23:28:59.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.916+0000 7fa5ca161700 1 -- 172.21.15.92:0/1062183972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c411e630 con 0x7fa5c40a3030 2023-09-29T23:28:59.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.917+0000 7fa5bb7fe700 1 -- 172.21.15.92:0/1062183972 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fa5bc022030 con 0x7fa5c40a3030 2023-09-29T23:28:59.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.917+0000 7fa5ca161700 1 -- 172.21.15.92:0/1062183972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c411d060 con 0x7fa5c40a3030 2023-09-29T23:28:59.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.917+0000 7fa5bb7fe700 1 --2- 172.21.15.92:0/1062183972 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa5a4035640 0x7fa5a4037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:28:59.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.917+0000 7fa5bb7fe700 1 -- 172.21.15.92:0/1062183972 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fa5bc049580 con 0x7fa5c40a3030 2023-09-29T23:28:59.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.917+0000 7fa5c2ffd700 1 --2- 172.21.15.92:0/1062183972 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa5a4035640 0x7fa5a4037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:28:59.921 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.918+0000 7fa5c2ffd700 1 --2- 172.21.15.92:0/1062183972 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa5a4035640 0x7fa5a4037af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0011e0 tx=0x7fa5ac0079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:28:59.922 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:28:59.922+0000 7fa5bb7fe700 1 -- 172.21.15.92:0/1062183972 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5bc010970 con 0x7fa5c40a3030 2023-09-29T23:29:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:00.104+0000 7fa5ca161700 1 -- 172.21.15.92:0/1062183972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5c4097d10 con 0x7fa5c40a3030 2023-09-29T23:29:00.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:00.105+0000 7fa5bb7fe700 1 -- 172.21.15.92:0/1062183972 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+9590 (secure 0 0 0) 0x7fa5bc01a3d0 con 0x7fa5c40a3030 2023-09-29T23:29:00.105 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:29:00.106 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":19,"fsid":"5b80eae7-9a7e-4dc0-8ff1-cd1f82a1fa33","created":"2023-09-29T23:23:30.308760+0000","modified":"2023-09-29T23:24:37.276001+0000","last_up_change":"2023-09-29T23:23:37.693186+0000","last_in_change":"2023-09-29T23:23:31.538675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-09-29T23:23:39.227674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-29T23:23:43.363869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-29T23:23:44.406215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea64f859-a36f-4804-810d-2fe7081c9990","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":85726},{"type":"v1","addr":"172.21.15.92:6817","nonce":85726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":85726},{"type":"v1","addr":"172.21.15.92:6819","nonce":85726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":85726},{"type":"v1","addr":"172.21.15.92:6823","nonce":85726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":85726},{"type":"v1","addr":"172.21.15.92:6821","nonce":85726}]},"public_addr":"172.21.15.92:6817/85726","cluster_addr":"172.21.15.92:6819/85726","heartbeat_back_addr":"172.21.15.92:6823/85726","heartbeat_front_addr":"172.21.15.92:6821/85726","state":["exists","up"]},{"osd":1,"uuid":"2e9c0837-2887-469f-9dea-db4bde348578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":85705},{"type":"v1","addr":"172.21.15.92:6809","nonce":85705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":85705},{"type":"v1","addr":"172.21.15.92:6811","nonce":85705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":85705},{"type":"v1","addr":"172.21.15.92:6815","nonce":85705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":85705},{"type":"v1","addr":"172.21.15.92:6813","nonce":85705}]},"public_addr":"172.21.15.92:6809/85705","cluster_addr":"172.21.15.92:6811/85705","heartbeat_back_addr":"172.21.15.92:6815/85705","heartbeat_front_addr":"172.21.15.92:6813/85705","state":["exists","up"]},{"osd":2,"uuid":"81ff42a8-c905-48bb-a021-3f5734761a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":85704},{"type":"v1","addr":"172.21.15.92:6801","nonce":85704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":85704},{"type":"v1","addr":"172.21.15.92:6803","nonce":85704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":85704},{"type":"v1","addr":"172.21.15.92:6807","nonce":85704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":85704},{"type":"v1","addr":"172.21.15.92:6805","nonce":85704}]},"public_addr":"172.21.15.92:6801/85704","cluster_addr":"172.21.15.92:6803/85704","heartbeat_back_addr":"172.21.15.92:6807/85704","heartbeat_front_addr":"172.21.15.92:6805/85704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.911756+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.874000+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-29T23:23:35.680977+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1d","mappings":[{"from":0,"to":2}]},{"pgid":"3.b","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":0,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-29T23:29:00.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:00.107+0000 7fa5ca161700 1 -- 172.21.15.92:0/1062183972 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa5a4035640 msgr2=0x7fa5a4037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:00.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:00.107+0000 7fa5ca161700 1 --2- 172.21.15.92:0/1062183972 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa5a4035640 0x7fa5a4037af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0011e0 tx=0x7fa5ac0079d0 comp rx=0 tx=0).stop 2023-09-29T23:29:00.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:00.107+0000 7fa5ca161700 1 -- 172.21.15.92:0/1062183972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c40a3030 msgr2=0x7fa5c413e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:00.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:00.107+0000 7fa5ca161700 1 --2- 172.21.15.92:0/1062183972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c40a3030 0x7fa5c413e4d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc000c00 tx=0x7fa5bc016000 comp rx=0 tx=0).stop 2023-09-29T23:29:00.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:00.107+0000 7fa5ca161700 1 -- 172.21.15.92:0/1062183972 shutdown_connections 2023-09-29T23:29:00.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:00.107+0000 7fa5ca161700 1 --2- 172.21.15.92:0/1062183972 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fa5a4035640 0x7fa5a4037af0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:00.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:00.107+0000 7fa5ca161700 1 --2- 172.21.15.92:0/1062183972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c40a3030 0x7fa5c413e4d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:00.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:00.107+0000 7fa5ca161700 1 -- 172.21.15.92:0/1062183972 >> 172.21.15.92:0/1062183972 conn(0x7fa5c4067fc0 msgr2=0x7fa5c412d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:00.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:00.108+0000 7fa5ca161700 1 -- 172.21.15.92:0/1062183972 shutdown_connections 2023-09-29T23:29:00.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:00.108+0000 7fa5ca161700 1 -- 172.21.15.92:0/1062183972 wait complete. 2023-09-29T23:29:01.121 INFO:tasks.ceph:Scrubbing osd.0 2023-09-29T23:29:01.121 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-09-29T23:29:01.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.253+0000 7f7bdac8c700 1 Processor -- start 2023-09-29T23:29:01.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.253+0000 7f7bdac8c700 1 -- start start 2023-09-29T23:29:01.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.254+0000 7f7bdac8c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7bd4095300 0x7f7bd40956d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:01.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.254+0000 7f7bdac8c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd4099540 con 0x7f7bd4095c10 2023-09-29T23:29:01.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.254+0000 7f7bdac8c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd409a6f0 con 0x7f7bd4095300 2023-09-29T23:29:01.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.254+0000 7f7bd8a28700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7bd4095300 0x7f7bd40956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:01.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.254+0000 7f7bd3fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f7bd4095c10 0x7f7bd4131640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54298/0 (socket says 172.21.15.92:54298) 2023-09-29T23:29:01.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.254+0000 7f7bd3fff700 1 -- 172.21.15.92:0/1224476250 learned_addr learned my addr 172.21.15.92:0/1224476250 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:29:01.255 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.254+0000 7f7bd8a28700 1 -- 172.21.15.92:0/1224476250 >> v1:172.21.15.92:6789/0 conn(0x7f7bd4095c10 legacy=0x7f7bd4131640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:01.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.254+0000 7f7bd8a28700 1 -- 172.21.15.92:0/1224476250 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd406a190 con 0x7f7bd4095300 2023-09-29T23:29:01.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.254+0000 7f7bd8a28700 1 --2- 172.21.15.92:0/1224476250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bd4095300 0x7f7bd40956d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009e30 tx=0x7f7bc4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1f82deed14b07 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:01.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.254+0000 7f7bd37fe700 1 -- 172.21.15.92:0/1224476250 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bc400e070 con 0x7f7bd4095300 2023-09-29T23:29:01.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.255+0000 7f7bd37fe700 1 -- 172.21.15.92:0/1224476250 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc400bd70 con 0x7f7bd4095300 2023-09-29T23:29:01.256 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.255+0000 7f7bd37fe700 1 -- 172.21.15.92:0/1224476250 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bc40125b0 con 0x7f7bd4095300 2023-09-29T23:29:01.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.255+0000 7f7bdac8c700 1 -- 172.21.15.92:0/1224476250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bd4095300 msgr2=0x7f7bd40956d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:01.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.255+0000 7f7bdac8c700 1 --2- 172.21.15.92:0/1224476250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bd4095300 0x7f7bd40956d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009e30 tx=0x7f7bc4009780 comp rx=0 tx=0).stop 2023-09-29T23:29:01.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.255+0000 7f7bdac8c700 1 -- 172.21.15.92:0/1224476250 shutdown_connections 2023-09-29T23:29:01.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.255+0000 7f7bdac8c700 1 --2- 172.21.15.92:0/1224476250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bd4095300 0x7f7bd40956d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:01.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.255+0000 7f7bdac8c700 1 -- 172.21.15.92:0/1224476250 >> 172.21.15.92:0/1224476250 conn(0x7f7bd406bd70 msgr2=0x7f7bd406e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:01.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.255+0000 7f7bdac8c700 1 -- 172.21.15.92:0/1224476250 shutdown_connections 2023-09-29T23:29:01.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.255+0000 7f7bdac8c700 1 -- 172.21.15.92:0/1224476250 wait complete. 2023-09-29T23:29:01.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.256+0000 7f7bdac8c700 1 Processor -- start 2023-09-29T23:29:01.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.256+0000 7f7bdac8c700 1 -- start start 2023-09-29T23:29:01.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.257+0000 7f7bdac8c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bd4095300 0x7f7bd413c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:01.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.257+0000 7f7bdac8c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd408df20 con 0x7f7bd4095300 2023-09-29T23:29:01.260 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.257+0000 7f7bd8a28700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bd4095300 0x7f7bd413c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:01.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.257+0000 7f7bd8a28700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bd4095300 0x7f7bd413c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37264/0 (socket says 172.21.15.92:37264) 2023-09-29T23:29:01.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.257+0000 7f7bd8a28700 1 -- 172.21.15.92:0/289051494 learned_addr learned my addr 172.21.15.92:0/289051494 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:29:01.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.257+0000 7f7bd8a28700 1 -- 172.21.15.92:0/289051494 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc4009a20 con 0x7f7bd4095300 2023-09-29T23:29:01.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.257+0000 7f7bd8a28700 1 --2- 172.21.15.92:0/289051494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bd4095300 0x7f7bd413c710 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40099f0 tx=0x7f7bc4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:01.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.257+0000 7f7bd0ff9700 1 -- 172.21.15.92:0/289051494 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bc4027470 con 0x7f7bd4095300 2023-09-29T23:29:01.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.257+0000 7f7bd0ff9700 1 -- 172.21.15.92:0/289051494 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc40275f0 con 0x7f7bd4095300 2023-09-29T23:29:01.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.257+0000 7f7bdac8c700 1 -- 172.21.15.92:0/289051494 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd4090970 con 0x7f7bd4095300 2023-09-29T23:29:01.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.257+0000 7f7bd0ff9700 1 -- 172.21.15.92:0/289051494 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bc40278e0 con 0x7f7bd4095300 2023-09-29T23:29:01.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.257+0000 7f7bdac8c700 1 -- 172.21.15.92:0/289051494 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd40906e0 con 0x7f7bd4095300 2023-09-29T23:29:01.261 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.258+0000 7f7bdac8c700 1 -- 172.21.15.92:0/289051494 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7bd409a840 con 0x7f7bd4095300 2023-09-29T23:29:01.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.258+0000 7f7bd0ff9700 1 -- 172.21.15.92:0/289051494 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f7bc4024070 con 0x7f7bd4095300 2023-09-29T23:29:01.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.258+0000 7f7bd0ff9700 1 --2- 172.21.15.92:0/289051494 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7bc0035640 0x7f7bc0037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:01.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.258+0000 7f7bd0ff9700 1 -- 172.21.15.92:0/289051494 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f7bc4049ed0 con 0x7f7bd4095300 2023-09-29T23:29:01.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.258+0000 7f7bd3fff700 1 --2- 172.21.15.92:0/289051494 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7bc0035640 0x7f7bc0037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:01.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.258+0000 7f7bd0ff9700 1 --2- 172.21.15.92:0/289051494 >> [v2:172.21.15.92:6816/85726,v1:172.21.15.92:6817/85726] conn(0x7f7bc003c7d0 0x7f7bc003ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:01.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.258+0000 7f7bd0ff9700 1 -- 172.21.15.92:0/289051494 --> [v2:172.21.15.92:6816/85726,v1:172.21.15.92:6817/85726] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7bc003f370 con 0x7f7bc003c7d0 2023-09-29T23:29:01.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.258+0000 7f7bd0ff9700 1 -- 172.21.15.92:0/289051494 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bc404c4f0 con 0x7f7bd4095300 2023-09-29T23:29:01.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.259+0000 7f7bd9229700 1 --2- 172.21.15.92:0/289051494 >> [v2:172.21.15.92:6816/85726,v1:172.21.15.92:6817/85726] conn(0x7f7bc003c7d0 0x7f7bc003ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:01.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.259+0000 7f7bd3fff700 1 --2- 172.21.15.92:0/289051494 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7bc0035640 0x7f7bc0037af0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80016a0 tx=0x7f7bc8007b30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:01.262 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.259+0000 7f7bd9229700 1 --2- 172.21.15.92:0/289051494 >> [v2:172.21.15.92:6816/85726,v1:172.21.15.92:6817/85726] conn(0x7f7bc003c7d0 0x7f7bc003ec60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:01.263 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.259+0000 7f7bd0ff9700 1 -- 172.21.15.92:0/289051494 <== osd.0 v2:172.21.15.92:6816/85726 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f7bc003f370 con 0x7f7bc003c7d0 2023-09-29T23:29:01.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.273+0000 7f7bdac8c700 1 -- 172.21.15.92:0/289051494 --> [v2:172.21.15.92:6816/85726,v1:172.21.15.92:6817/85726] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7bd406f370 con 0x7f7bc003c7d0 2023-09-29T23:29:01.273 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.273+0000 7f7bd0ff9700 1 -- 172.21.15.92:0/289051494 <== osd.0 v2:172.21.15.92:6816/85726 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7bd406f370 con 0x7f7bc003c7d0 2023-09-29T23:29:01.274 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-09-29T23:29:01.274 INFO:teuthology.orchestra.run.smithi092.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-29T23:29:01.274 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-09-29T23:29:01.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.274+0000 7f7bdac8c700 1 -- 172.21.15.92:0/289051494 >> [v2:172.21.15.92:6816/85726,v1:172.21.15.92:6817/85726] conn(0x7f7bc003c7d0 msgr2=0x7f7bc003ec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:01.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.274+0000 7f7bdac8c700 1 --2- 172.21.15.92:0/289051494 >> [v2:172.21.15.92:6816/85726,v1:172.21.15.92:6817/85726] conn(0x7f7bc003c7d0 0x7f7bc003ec60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:01.275 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.274+0000 7f7bdac8c700 1 -- 172.21.15.92:0/289051494 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7bc0035640 msgr2=0x7f7bc0037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:01.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.274+0000 7f7bdac8c700 1 --2- 172.21.15.92:0/289051494 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7bc0035640 0x7f7bc0037af0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80016a0 tx=0x7f7bc8007b30 comp rx=0 tx=0).stop 2023-09-29T23:29:01.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.274+0000 7f7bdac8c700 1 -- 172.21.15.92:0/289051494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bd4095300 msgr2=0x7f7bd413c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:01.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.274+0000 7f7bdac8c700 1 --2- 172.21.15.92:0/289051494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bd4095300 0x7f7bd413c710 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40099f0 tx=0x7f7bc4018000 comp rx=0 tx=0).stop 2023-09-29T23:29:01.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.274+0000 7f7bdac8c700 1 -- 172.21.15.92:0/289051494 shutdown_connections 2023-09-29T23:29:01.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.274+0000 7f7bdac8c700 1 --2- 172.21.15.92:0/289051494 >> [v2:172.21.15.92:6816/85726,v1:172.21.15.92:6817/85726] conn(0x7f7bc003c7d0 0x7f7bc003ec60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:01.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.274+0000 7f7bdac8c700 1 --2- 172.21.15.92:0/289051494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bd4095300 0x7f7bd413c710 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:01.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.274+0000 7f7bdac8c700 1 --2- 172.21.15.92:0/289051494 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7bc0035640 0x7f7bc0037af0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:01.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.274+0000 7f7bdac8c700 1 -- 172.21.15.92:0/289051494 >> 172.21.15.92:0/289051494 conn(0x7f7bd406bd70 msgr2=0x7f7bd406d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:01.276 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.274+0000 7f7bdac8c700 1 -- 172.21.15.92:0/289051494 shutdown_connections 2023-09-29T23:29:01.277 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.274+0000 7f7bdac8c700 1 -- 172.21.15.92:0/289051494 wait complete. 2023-09-29T23:29:01.286 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-09-29T23:29:01.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.399+0000 7fc5f0474700 1 Processor -- start 2023-09-29T23:29:01.400 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.399+0000 7fc5f0474700 1 -- start start 2023-09-29T23:29:01.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.400+0000 7fc5f0474700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc5e80a3030 0x7fc5e812f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:01.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.400+0000 7fc5f0474700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e80997f0 con 0x7fc5e812fae0 2023-09-29T23:29:01.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.400+0000 7fc5f0474700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e80a3400 con 0x7fc5e80a3030 2023-09-29T23:29:01.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.400+0000 7fc5ee210700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc5e80a3030 0x7fc5e812f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:01.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.400+0000 7fc5eda0f700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fc5e812fae0 0x7fc5e8095a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54304/0 (socket says 172.21.15.92:54304) 2023-09-29T23:29:01.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.400+0000 7fc5eda0f700 1 -- 172.21.15.92:0/1210156094 learned_addr learned my addr 172.21.15.92:0/1210156094 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:29:01.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.400+0000 7fc5ee210700 1 -- 172.21.15.92:0/1210156094 >> v1:172.21.15.92:6789/0 conn(0x7fc5e812fae0 legacy=0x7fc5e8095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:01.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.400+0000 7fc5ed20e700 1 -- 172.21.15.92:0/1210156094 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428702609 0 0) 0x7fc5e80997f0 con 0x7fc5e812fae0 2023-09-29T23:29:01.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.400+0000 7fc5ee210700 1 -- 172.21.15.92:0/1210156094 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e80977a0 con 0x7fc5e80a3030 2023-09-29T23:29:01.402 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.401+0000 7fc5ee210700 1 --2- 172.21.15.92:0/1210156094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5e80a3030 0x7fc5e812f5a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0009de0 tx=0x7fc5e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec7d470677bcae7 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:01.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.401+0000 7fc5ed20e700 1 -- 172.21.15.92:0/1210156094 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5e000e070 con 0x7fc5e80a3030 2023-09-29T23:29:01.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.401+0000 7fc5ed20e700 1 -- 172.21.15.92:0/1210156094 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e000bd10 con 0x7fc5e80a3030 2023-09-29T23:29:01.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.401+0000 7fc5ed20e700 1 -- 172.21.15.92:0/1210156094 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5e0012430 con 0x7fc5e80a3030 2023-09-29T23:29:01.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.401+0000 7fc5f0474700 1 -- 172.21.15.92:0/1210156094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5e80a3030 msgr2=0x7fc5e812f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:01.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.401+0000 7fc5f0474700 1 --2- 172.21.15.92:0/1210156094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5e80a3030 0x7fc5e812f5a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0009de0 tx=0x7fc5e0009780 comp rx=0 tx=0).stop 2023-09-29T23:29:01.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.401+0000 7fc5f0474700 1 -- 172.21.15.92:0/1210156094 shutdown_connections 2023-09-29T23:29:01.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.401+0000 7fc5f0474700 1 --2- 172.21.15.92:0/1210156094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5e80a3030 0x7fc5e812f5a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:01.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.401+0000 7fc5f0474700 1 -- 172.21.15.92:0/1210156094 >> 172.21.15.92:0/1210156094 conn(0x7fc5e8067fc0 msgr2=0x7fc5e80a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:01.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.401+0000 7fc5f0474700 1 -- 172.21.15.92:0/1210156094 shutdown_connections 2023-09-29T23:29:01.403 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.401+0000 7fc5f0474700 1 -- 172.21.15.92:0/1210156094 wait complete. 2023-09-29T23:29:01.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.402+0000 7fc5f0474700 1 Processor -- start 2023-09-29T23:29:01.405 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.402+0000 7fc5f0474700 1 -- start start 2023-09-29T23:29:01.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.403+0000 7fc5f0474700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5e80a3030 0x7fc5e813e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:01.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.403+0000 7fc5f0474700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e811e850 con 0x7fc5e80a3030 2023-09-29T23:29:01.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.403+0000 7fc5ee210700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5e80a3030 0x7fc5e813e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:01.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.403+0000 7fc5ee210700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5e80a3030 0x7fc5e813e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37288/0 (socket says 172.21.15.92:37288) 2023-09-29T23:29:01.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.403+0000 7fc5ee210700 1 -- 172.21.15.92:0/3821492221 learned_addr learned my addr 172.21.15.92:0/3821492221 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:29:01.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.403+0000 7fc5ee210700 1 -- 172.21.15.92:0/3821492221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e0009a20 con 0x7fc5e80a3030 2023-09-29T23:29:01.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.403+0000 7fc5ee210700 1 --2- 172.21.15.92:0/3821492221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5e80a3030 0x7fc5e813e4d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc5e00097c0 tx=0x7fc5e0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:01.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.403+0000 7fc5de7fc700 1 -- 172.21.15.92:0/3821492221 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5e000be80 con 0x7fc5e80a3030 2023-09-29T23:29:01.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.403+0000 7fc5de7fc700 1 -- 172.21.15.92:0/3821492221 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e001d640 con 0x7fc5e80a3030 2023-09-29T23:29:01.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.403+0000 7fc5f0474700 1 -- 172.21.15.92:0/3821492221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e811e540 con 0x7fc5e80a3030 2023-09-29T23:29:01.406 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.403+0000 7fc5de7fc700 1 -- 172.21.15.92:0/3821492221 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5e001d930 con 0x7fc5e80a3030 2023-09-29T23:29:01.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.403+0000 7fc5f0474700 1 -- 172.21.15.92:0/3821492221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e811dcb0 con 0x7fc5e80a3030 2023-09-29T23:29:01.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.404+0000 7fc5de7fc700 1 -- 172.21.15.92:0/3821492221 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fc5e0024070 con 0x7fc5e80a3030 2023-09-29T23:29:01.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.404+0000 7fc5f0474700 1 -- 172.21.15.92:0/3821492221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e811e2e0 con 0x7fc5e80a3030 2023-09-29T23:29:01.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.404+0000 7fc5de7fc700 1 --2- 172.21.15.92:0/3821492221 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc5cc035640 0x7fc5cc037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:01.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.404+0000 7fc5de7fc700 1 -- 172.21.15.92:0/3821492221 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fc5e004a290 con 0x7fc5e80a3030 2023-09-29T23:29:01.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.404+0000 7fc5eda0f700 1 --2- 172.21.15.92:0/3821492221 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc5cc035640 0x7fc5cc037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:01.407 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.405+0000 7fc5eda0f700 1 --2- 172.21.15.92:0/3821492221 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc5cc035640 0x7fc5cc037af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80011e0 tx=0x7fc5d80079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:01.409 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.409+0000 7fc5de7fc700 1 -- 172.21.15.92:0/3821492221 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5e001da90 con 0x7fc5e80a3030 2023-09-29T23:29:01.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.591+0000 7fc5f0474700 1 -- 172.21.15.92:0/3821492221 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5e805f230 con 0x7fc5cc035640 2023-09-29T23:29:01.591 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.591+0000 7fc5de7fc700 1 -- 172.21.15.92:0/3821492221 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc5e805f230 con 0x7fc5cc035640 2023-09-29T23:29:01.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.593+0000 7fc5f0474700 1 -- 172.21.15.92:0/3821492221 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc5cc035640 msgr2=0x7fc5cc037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:01.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.593+0000 7fc5f0474700 1 --2- 172.21.15.92:0/3821492221 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc5cc035640 0x7fc5cc037af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80011e0 tx=0x7fc5d80079d0 comp rx=0 tx=0).stop 2023-09-29T23:29:01.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.593+0000 7fc5f0474700 1 -- 172.21.15.92:0/3821492221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5e80a3030 msgr2=0x7fc5e813e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:01.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.593+0000 7fc5f0474700 1 --2- 172.21.15.92:0/3821492221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5e80a3030 0x7fc5e813e4d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc5e00097c0 tx=0x7fc5e0018000 comp rx=0 tx=0).stop 2023-09-29T23:29:01.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.594+0000 7fc5f0474700 1 -- 172.21.15.92:0/3821492221 shutdown_connections 2023-09-29T23:29:01.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.594+0000 7fc5f0474700 1 --2- 172.21.15.92:0/3821492221 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc5cc035640 0x7fc5cc037af0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:01.594 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.594+0000 7fc5f0474700 1 --2- 172.21.15.92:0/3821492221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5e80a3030 0x7fc5e813e4d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:01.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.594+0000 7fc5f0474700 1 -- 172.21.15.92:0/3821492221 >> 172.21.15.92:0/3821492221 conn(0x7fc5e8067fc0 msgr2=0x7fc5e812d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:01.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.594+0000 7fc5f0474700 1 -- 172.21.15.92:0/3821492221 shutdown_connections 2023-09-29T23:29:01.595 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.594+0000 7fc5f0474700 1 -- 172.21.15.92:0/3821492221 wait complete. 2023-09-29T23:29:01.595 INFO:teuthology.orchestra.run.smithi092.stderr:instructed osd(s) 0 to deep-scrub 2023-09-29T23:29:01.605 INFO:tasks.ceph:Scrubbing osd.1 2023-09-29T23:29:01.605 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-09-29T23:29:01.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.721+0000 7f2c36e14700 1 Processor -- start 2023-09-29T23:29:01.722 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.721+0000 7f2c36e14700 1 -- start start 2023-09-29T23:29:01.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.721+0000 7f2c36e14700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2c3012ffc0 0x7f2c300a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:01.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.722+0000 7f2c36e14700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c30098710 con 0x7f2c3009fd80 2023-09-29T23:29:01.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.722+0000 7f2c36e14700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3012f340 con 0x7f2c3012ffc0 2023-09-29T23:29:01.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.722+0000 7f2c27fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2c3012ffc0 0x7f2c300a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:01.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.722+0000 7f2c34bb0700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f2c3009fd80 0x7f2c3012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54318/0 (socket says 172.21.15.92:54318) 2023-09-29T23:29:01.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.722+0000 7f2c34bb0700 1 -- 172.21.15.92:0/3270220766 learned_addr learned my addr 172.21.15.92:0/3270220766 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:29:01.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.722+0000 7f2c27fff700 1 -- 172.21.15.92:0/3270220766 >> v1:172.21.15.92:6789/0 conn(0x7f2c3009fd80 legacy=0x7f2c3012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:01.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.722+0000 7f2c27fff700 1 -- 172.21.15.92:0/3270220766 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c300997e0 con 0x7f2c3012ffc0 2023-09-29T23:29:01.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.722+0000 7f2c27fff700 1 --2- 172.21.15.92:0/3270220766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c3012ffc0 0x7f2c300a3090 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2c20009860 tx=0x7f2c200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928bcbab65a403f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:01.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.722+0000 7f2c277fe700 1 -- 172.21.15.92:0/3270220766 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c2000b680 con 0x7f2c3012ffc0 2023-09-29T23:29:01.723 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.722+0000 7f2c277fe700 1 -- 172.21.15.92:0/3270220766 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2000b7e0 con 0x7f2c3012ffc0 2023-09-29T23:29:01.724 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.722+0000 7f2c277fe700 1 -- 172.21.15.92:0/3270220766 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c2000b990 con 0x7f2c3012ffc0 2023-09-29T23:29:01.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.723+0000 7f2c36e14700 1 -- 172.21.15.92:0/3270220766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c3012ffc0 msgr2=0x7f2c300a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:01.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.723+0000 7f2c36e14700 1 --2- 172.21.15.92:0/3270220766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c3012ffc0 0x7f2c300a3090 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2c20009860 tx=0x7f2c200091a0 comp rx=0 tx=0).stop 2023-09-29T23:29:01.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.723+0000 7f2c36e14700 1 -- 172.21.15.92:0/3270220766 shutdown_connections 2023-09-29T23:29:01.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.723+0000 7f2c36e14700 1 --2- 172.21.15.92:0/3270220766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c3012ffc0 0x7f2c300a3090 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:01.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.723+0000 7f2c36e14700 1 -- 172.21.15.92:0/3270220766 >> 172.21.15.92:0/3270220766 conn(0x7f2c30068000 msgr2=0x7f2c300a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:01.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.723+0000 7f2c36e14700 1 -- 172.21.15.92:0/3270220766 shutdown_connections 2023-09-29T23:29:01.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.723+0000 7f2c36e14700 1 -- 172.21.15.92:0/3270220766 wait complete. 2023-09-29T23:29:01.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.723+0000 7f2c36e14700 1 Processor -- start 2023-09-29T23:29:01.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.724+0000 7f2c36e14700 1 -- start start 2023-09-29T23:29:01.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.724+0000 7f2c36e14700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c3009fd80 0x7f2c3013e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:01.727 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.724+0000 7f2c36e14700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3011eb30 con 0x7f2c3009fd80 2023-09-29T23:29:01.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.724+0000 7f2c34bb0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c3009fd80 0x7f2c3013e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:01.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.724+0000 7f2c34bb0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c3009fd80 0x7f2c3013e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37312/0 (socket says 172.21.15.92:37312) 2023-09-29T23:29:01.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.724+0000 7f2c34bb0700 1 -- 172.21.15.92:0/2659055763 learned_addr learned my addr 172.21.15.92:0/2659055763 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:29:01.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.724+0000 7f2c34bb0700 1 -- 172.21.15.92:0/2659055763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c20009420 con 0x7f2c3009fd80 2023-09-29T23:29:01.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.725+0000 7f2c34bb0700 1 --2- 172.21.15.92:0/2659055763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c3009fd80 0x7f2c3013e520 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00cb70 tx=0x7f2c2c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:01.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.725+0000 7f2c24ff9700 1 -- 172.21.15.92:0/2659055763 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c2c00a910 con 0x7f2c3009fd80 2023-09-29T23:29:01.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.725+0000 7f2c24ff9700 1 -- 172.21.15.92:0/2659055763 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2c00aa70 con 0x7f2c3009fd80 2023-09-29T23:29:01.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.725+0000 7f2c24ff9700 1 -- 172.21.15.92:0/2659055763 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c2c00ad20 con 0x7f2c3009fd80 2023-09-29T23:29:01.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.725+0000 7f2c36e14700 1 -- 172.21.15.92:0/2659055763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3011e820 con 0x7f2c3009fd80 2023-09-29T23:29:01.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.725+0000 7f2c36e14700 1 -- 172.21.15.92:0/2659055763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3011bb70 con 0x7f2c3009fd80 2023-09-29T23:29:01.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.725+0000 7f2c36e14700 1 -- 172.21.15.92:0/2659055763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c300a1b50 con 0x7f2c3009fd80 2023-09-29T23:29:01.728 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.725+0000 7f2c24ff9700 1 -- 172.21.15.92:0/2659055763 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f2c2c0070f0 con 0x7f2c3009fd80 2023-09-29T23:29:01.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.726+0000 7f2c24ff9700 1 --2- 172.21.15.92:0/2659055763 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2c1c035630 0x7f2c1c037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:01.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.726+0000 7f2c24ff9700 1 -- 172.21.15.92:0/2659055763 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f2c2c0478b0 con 0x7f2c3009fd80 2023-09-29T23:29:01.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.726+0000 7f2c27fff700 1 --2- 172.21.15.92:0/2659055763 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2c1c035630 0x7f2c1c037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:01.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.726+0000 7f2c24ff9700 1 --2- 172.21.15.92:0/2659055763 >> [v2:172.21.15.92:6808/85705,v1:172.21.15.92:6809/85705] conn(0x7f2c1c03c7c0 0x7f2c1c03ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:01.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.726+0000 7f2c24ff9700 1 -- 172.21.15.92:0/2659055763 --> [v2:172.21.15.92:6808/85705,v1:172.21.15.92:6809/85705] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c1c03f360 con 0x7f2c1c03c7c0 2023-09-29T23:29:01.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.726+0000 7f2c24ff9700 1 -- 172.21.15.92:0/2659055763 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c2c04c220 con 0x7f2c3009fd80 2023-09-29T23:29:01.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.726+0000 7f2c353b1700 1 --2- 172.21.15.92:0/2659055763 >> [v2:172.21.15.92:6808/85705,v1:172.21.15.92:6809/85705] conn(0x7f2c1c03c7c0 0x7f2c1c03ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:01.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.726+0000 7f2c27fff700 1 --2- 172.21.15.92:0/2659055763 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2c1c035630 0x7f2c1c037ae0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2c20009860 tx=0x7f2c20016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:01.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.726+0000 7f2c353b1700 1 --2- 172.21.15.92:0/2659055763 >> [v2:172.21.15.92:6808/85705,v1:172.21.15.92:6809/85705] conn(0x7f2c1c03c7c0 0x7f2c1c03ec50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:01.729 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.727+0000 7f2c24ff9700 1 -- 172.21.15.92:0/2659055763 <== osd.1 v2:172.21.15.92:6808/85705 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2c1c03f360 con 0x7f2c1c03c7c0 2023-09-29T23:29:01.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.740+0000 7f2c36e14700 1 -- 172.21.15.92:0/2659055763 --> [v2:172.21.15.92:6808/85705,v1:172.21.15.92:6809/85705] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2c3005f230 con 0x7f2c1c03c7c0 2023-09-29T23:29:01.740 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.740+0000 7f2c24ff9700 1 -- 172.21.15.92:0/2659055763 <== osd.1 v2:172.21.15.92:6808/85705 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2c3005f230 con 0x7f2c1c03c7c0 2023-09-29T23:29:01.741 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-09-29T23:29:01.741 INFO:teuthology.orchestra.run.smithi092.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-29T23:29:01.741 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-09-29T23:29:01.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.741+0000 7f2c36e14700 1 -- 172.21.15.92:0/2659055763 >> [v2:172.21.15.92:6808/85705,v1:172.21.15.92:6809/85705] conn(0x7f2c1c03c7c0 msgr2=0x7f2c1c03ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:01.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.741+0000 7f2c36e14700 1 --2- 172.21.15.92:0/2659055763 >> [v2:172.21.15.92:6808/85705,v1:172.21.15.92:6809/85705] conn(0x7f2c1c03c7c0 0x7f2c1c03ec50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:01.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.741+0000 7f2c36e14700 1 -- 172.21.15.92:0/2659055763 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2c1c035630 msgr2=0x7f2c1c037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:01.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.741+0000 7f2c36e14700 1 --2- 172.21.15.92:0/2659055763 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2c1c035630 0x7f2c1c037ae0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2c20009860 tx=0x7f2c20016000 comp rx=0 tx=0).stop 2023-09-29T23:29:01.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.741+0000 7f2c36e14700 1 -- 172.21.15.92:0/2659055763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c3009fd80 msgr2=0x7f2c3013e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:01.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.741+0000 7f2c36e14700 1 --2- 172.21.15.92:0/2659055763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c3009fd80 0x7f2c3013e520 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00cb70 tx=0x7f2c2c001a30 comp rx=0 tx=0).stop 2023-09-29T23:29:01.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.741+0000 7f2c36e14700 1 -- 172.21.15.92:0/2659055763 shutdown_connections 2023-09-29T23:29:01.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.741+0000 7f2c36e14700 1 --2- 172.21.15.92:0/2659055763 >> [v2:172.21.15.92:6808/85705,v1:172.21.15.92:6809/85705] conn(0x7f2c1c03c7c0 0x7f2c1c03ec50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:01.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.741+0000 7f2c36e14700 1 --2- 172.21.15.92:0/2659055763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c3009fd80 0x7f2c3013e520 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:01.743 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.741+0000 7f2c36e14700 1 --2- 172.21.15.92:0/2659055763 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f2c1c035630 0x7f2c1c037ae0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:01.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.741+0000 7f2c36e14700 1 -- 172.21.15.92:0/2659055763 >> 172.21.15.92:0/2659055763 conn(0x7f2c30068000 msgr2=0x7f2c3012dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:01.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.741+0000 7f2c36e14700 1 -- 172.21.15.92:0/2659055763 shutdown_connections 2023-09-29T23:29:01.744 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.741+0000 7f2c36e14700 1 -- 172.21.15.92:0/2659055763 wait complete. 2023-09-29T23:29:01.752 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-09-29T23:29:01.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.866+0000 7fc295784700 1 Processor -- start 2023-09-29T23:29:01.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.866+0000 7fc295784700 1 -- start start 2023-09-29T23:29:01.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.866+0000 7fc295784700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc290067eb0 0x7fc29012f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:01.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.866+0000 7fc295784700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29009cee0 con 0x7fc29012fc50 2023-09-29T23:29:01.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.866+0000 7fc295784700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc290068280 con 0x7fc290067eb0 2023-09-29T23:29:01.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.866+0000 7fc28effd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc290067eb0 0x7fc29012f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:01.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.866+0000 7fc28e7fc700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fc29012fc50 0x7fc290096310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54322/0 (socket says 172.21.15.92:54322) 2023-09-29T23:29:01.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.866+0000 7fc28e7fc700 1 -- 172.21.15.92:0/2559066875 learned_addr learned my addr 172.21.15.92:0/2559066875 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:29:01.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.867+0000 7fc28effd700 1 -- 172.21.15.92:0/2559066875 >> v1:172.21.15.92:6789/0 conn(0x7fc29012fc50 legacy=0x7fc290096310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:01.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.867+0000 7fc28effd700 1 -- 172.21.15.92:0/2559066875 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2900685e0 con 0x7fc290067eb0 2023-09-29T23:29:01.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.867+0000 7fc28dffb700 1 -- 172.21.15.92:0/2559066875 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099056279 0 0) 0x7fc29009cee0 con 0x7fc29012fc50 2023-09-29T23:29:01.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.867+0000 7fc28effd700 1 --2- 172.21.15.92:0/2559066875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc290067eb0 0x7fc29012f710 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc280009850 tx=0x7fc280009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a8ca0fee33b02a server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:01.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.867+0000 7fc28dffb700 1 -- 172.21.15.92:0/2559066875 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc280005d50 con 0x7fc290067eb0 2023-09-29T23:29:01.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.867+0000 7fc28dffb700 1 -- 172.21.15.92:0/2559066875 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc280006030 con 0x7fc290067eb0 2023-09-29T23:29:01.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.867+0000 7fc28dffb700 1 -- 172.21.15.92:0/2559066875 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc280006300 con 0x7fc290067eb0 2023-09-29T23:29:01.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.867+0000 7fc295784700 1 -- 172.21.15.92:0/2559066875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc290067eb0 msgr2=0x7fc29012f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:01.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.867+0000 7fc295784700 1 --2- 172.21.15.92:0/2559066875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc290067eb0 0x7fc29012f710 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc280009850 tx=0x7fc280009120 comp rx=0 tx=0).stop 2023-09-29T23:29:01.869 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.867+0000 7fc295784700 1 -- 172.21.15.92:0/2559066875 shutdown_connections 2023-09-29T23:29:01.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.867+0000 7fc295784700 1 --2- 172.21.15.92:0/2559066875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc290067eb0 0x7fc29012f710 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:01.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.867+0000 7fc295784700 1 -- 172.21.15.92:0/2559066875 >> 172.21.15.92:0/2559066875 conn(0x7fc29006bbd0 msgr2=0x7fc29006dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:01.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.867+0000 7fc295784700 1 -- 172.21.15.92:0/2559066875 shutdown_connections 2023-09-29T23:29:01.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.868+0000 7fc295784700 1 -- 172.21.15.92:0/2559066875 wait complete. 2023-09-29T23:29:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.868+0000 7fc295784700 1 Processor -- start 2023-09-29T23:29:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.868+0000 7fc295784700 1 -- start start 2023-09-29T23:29:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.869+0000 7fc295784700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc290067eb0 0x7fc290117880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.869+0000 7fc295784700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29011b520 con 0x7fc290067eb0 2023-09-29T23:29:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.869+0000 7fc28effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc290067eb0 0x7fc290117880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.869+0000 7fc28effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc290067eb0 0x7fc290117880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37338/0 (socket says 172.21.15.92:37338) 2023-09-29T23:29:01.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.869+0000 7fc28effd700 1 -- 172.21.15.92:0/673825759 learned_addr learned my addr 172.21.15.92:0/673825759 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:29:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.869+0000 7fc28effd700 1 -- 172.21.15.92:0/673825759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2800093c0 con 0x7fc290067eb0 2023-09-29T23:29:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.869+0000 7fc28effd700 1 --2- 172.21.15.92:0/673825759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc290067eb0 0x7fc290117880 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc280000c00 tx=0x7fc280015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.869+0000 7fc276ffd700 1 -- 172.21.15.92:0/673825759 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc28000bc40 con 0x7fc290067eb0 2023-09-29T23:29:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.869+0000 7fc276ffd700 1 -- 172.21.15.92:0/673825759 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28000bda0 con 0x7fc290067eb0 2023-09-29T23:29:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.869+0000 7fc295784700 1 -- 172.21.15.92:0/673825759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc290129a10 con 0x7fc290067eb0 2023-09-29T23:29:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.869+0000 7fc276ffd700 1 -- 172.21.15.92:0/673825759 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc28001c590 con 0x7fc290067eb0 2023-09-29T23:29:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.869+0000 7fc295784700 1 -- 172.21.15.92:0/673825759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc290118ce0 con 0x7fc290067eb0 2023-09-29T23:29:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.870+0000 7fc276ffd700 1 -- 172.21.15.92:0/673825759 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fc280023070 con 0x7fc290067eb0 2023-09-29T23:29:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.870+0000 7fc295784700 1 -- 172.21.15.92:0/673825759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29012bc60 con 0x7fc290067eb0 2023-09-29T23:29:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.870+0000 7fc276ffd700 1 --2- 172.21.15.92:0/673825759 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc27c035640 0x7fc27c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.870+0000 7fc276ffd700 1 -- 172.21.15.92:0/673825759 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fc280049690 con 0x7fc290067eb0 2023-09-29T23:29:01.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.871+0000 7fc28e7fc700 1 --2- 172.21.15.92:0/673825759 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc27c035640 0x7fc27c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:01.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.871+0000 7fc28e7fc700 1 --2- 172.21.15.92:0/673825759 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc27c035640 0x7fc27c037af0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc2840011e0 tx=0x7fc2840079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:01.875 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:01.875+0000 7fc276ffd700 1 -- 172.21.15.92:0/673825759 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc28001b770 con 0x7fc290067eb0 2023-09-29T23:29:02.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.057+0000 7fc295784700 1 -- 172.21.15.92:0/673825759 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc29011b670 con 0x7fc27c035640 2023-09-29T23:29:02.057 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.057+0000 7fc276ffd700 1 -- 172.21.15.92:0/673825759 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc29011b670 con 0x7fc27c035640 2023-09-29T23:29:02.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.059+0000 7fc295784700 1 -- 172.21.15.92:0/673825759 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc27c035640 msgr2=0x7fc27c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:02.059 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.059+0000 7fc295784700 1 --2- 172.21.15.92:0/673825759 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc27c035640 0x7fc27c037af0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc2840011e0 tx=0x7fc2840079d0 comp rx=0 tx=0).stop 2023-09-29T23:29:02.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.059+0000 7fc295784700 1 -- 172.21.15.92:0/673825759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc290067eb0 msgr2=0x7fc290117880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:02.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.059+0000 7fc295784700 1 --2- 172.21.15.92:0/673825759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc290067eb0 0x7fc290117880 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc280000c00 tx=0x7fc280015000 comp rx=0 tx=0).stop 2023-09-29T23:29:02.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.059+0000 7fc295784700 1 -- 172.21.15.92:0/673825759 shutdown_connections 2023-09-29T23:29:02.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.059+0000 7fc295784700 1 --2- 172.21.15.92:0/673825759 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fc27c035640 0x7fc27c037af0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:02.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.059+0000 7fc295784700 1 --2- 172.21.15.92:0/673825759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc290067eb0 0x7fc290117880 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:02.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.059+0000 7fc295784700 1 -- 172.21.15.92:0/673825759 >> 172.21.15.92:0/673825759 conn(0x7fc29006bbd0 msgr2=0x7fc29012e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:02.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.059+0000 7fc295784700 1 -- 172.21.15.92:0/673825759 shutdown_connections 2023-09-29T23:29:02.060 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.059+0000 7fc295784700 1 -- 172.21.15.92:0/673825759 wait complete. 2023-09-29T23:29:02.061 INFO:teuthology.orchestra.run.smithi092.stderr:instructed osd(s) 1 to deep-scrub 2023-09-29T23:29:02.071 INFO:tasks.ceph:Scrubbing osd.2 2023-09-29T23:29:02.071 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-09-29T23:29:02.189 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.187+0000 7f31aabc4700 1 Processor -- start 2023-09-29T23:29:02.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.188+0000 7f31aabc4700 1 -- start start 2023-09-29T23:29:02.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.188+0000 7f31aabc4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f31a412ffc0 0x7f31a40a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:02.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.188+0000 7f31aabc4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a4098710 con 0x7f31a409fd80 2023-09-29T23:29:02.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.188+0000 7f31aabc4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a412f340 con 0x7f31a412ffc0 2023-09-29T23:29:02.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.188+0000 7f319bfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f31a412ffc0 0x7f31a40a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:02.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.188+0000 7f31a8960700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f31a409fd80 0x7f31a412f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54326/0 (socket says 172.21.15.92:54326) 2023-09-29T23:29:02.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.188+0000 7f31a8960700 1 -- 172.21.15.92:0/1763521277 learned_addr learned my addr 172.21.15.92:0/1763521277 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:29:02.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.188+0000 7f319bfff700 1 -- 172.21.15.92:0/1763521277 >> v1:172.21.15.92:6789/0 conn(0x7f31a409fd80 legacy=0x7f31a412f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:02.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.188+0000 7f319bfff700 1 -- 172.21.15.92:0/1763521277 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a40997e0 con 0x7f31a412ffc0 2023-09-29T23:29:02.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.189+0000 7f319bfff700 1 --2- 172.21.15.92:0/1763521277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a412ffc0 0x7f31a40a3090 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3194009860 tx=0x7f31940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb5f0407c8bd597 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:02.190 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.189+0000 7f319b7fe700 1 -- 172.21.15.92:0/1763521277 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f319400b680 con 0x7f31a412ffc0 2023-09-29T23:29:02.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.189+0000 7f319b7fe700 1 -- 172.21.15.92:0/1763521277 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319400b7e0 con 0x7f31a412ffc0 2023-09-29T23:29:02.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.189+0000 7f319b7fe700 1 -- 172.21.15.92:0/1763521277 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f319400b990 con 0x7f31a412ffc0 2023-09-29T23:29:02.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.189+0000 7f31aabc4700 1 -- 172.21.15.92:0/1763521277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a412ffc0 msgr2=0x7f31a40a3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:02.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.189+0000 7f31aabc4700 1 --2- 172.21.15.92:0/1763521277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a412ffc0 0x7f31a40a3090 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3194009860 tx=0x7f31940091a0 comp rx=0 tx=0).stop 2023-09-29T23:29:02.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.189+0000 7f31aabc4700 1 -- 172.21.15.92:0/1763521277 shutdown_connections 2023-09-29T23:29:02.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.189+0000 7f31aabc4700 1 --2- 172.21.15.92:0/1763521277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a412ffc0 0x7f31a40a3090 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:02.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.189+0000 7f31aabc4700 1 -- 172.21.15.92:0/1763521277 >> 172.21.15.92:0/1763521277 conn(0x7f31a4068000 msgr2=0x7f31a40a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:02.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.189+0000 7f31aabc4700 1 -- 172.21.15.92:0/1763521277 shutdown_connections 2023-09-29T23:29:02.191 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.189+0000 7f31aabc4700 1 -- 172.21.15.92:0/1763521277 wait complete. 2023-09-29T23:29:02.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.190+0000 7f31aabc4700 1 Processor -- start 2023-09-29T23:29:02.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.190+0000 7f31aabc4700 1 -- start start 2023-09-29T23:29:02.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.190+0000 7f31aabc4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a409fd80 0x7f31a413e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:02.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.190+0000 7f31aabc4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a411eb30 con 0x7f31a409fd80 2023-09-29T23:29:02.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.191+0000 7f31a8960700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a409fd80 0x7f31a413e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:02.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.191+0000 7f31a8960700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a409fd80 0x7f31a413e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37348/0 (socket says 172.21.15.92:37348) 2023-09-29T23:29:02.194 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.191+0000 7f31a8960700 1 -- 172.21.15.92:0/3089295832 learned_addr learned my addr 172.21.15.92:0/3089295832 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:29:02.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.191+0000 7f31a8960700 1 -- 172.21.15.92:0/3089295832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3194009420 con 0x7f31a409fd80 2023-09-29T23:29:02.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.191+0000 7f31a8960700 1 --2- 172.21.15.92:0/3089295832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a409fd80 0x7f31a413e520 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f31a000cb70 tx=0x7f31a0001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:02.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.191+0000 7f3198ff9700 1 -- 172.21.15.92:0/3089295832 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31a000a910 con 0x7f31a409fd80 2023-09-29T23:29:02.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.191+0000 7f3198ff9700 1 -- 172.21.15.92:0/3089295832 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a000aa70 con 0x7f31a409fd80 2023-09-29T23:29:02.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.191+0000 7f31aabc4700 1 -- 172.21.15.92:0/3089295832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a411e820 con 0x7f31a409fd80 2023-09-29T23:29:02.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.191+0000 7f3198ff9700 1 -- 172.21.15.92:0/3089295832 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31a000ad20 con 0x7f31a409fd80 2023-09-29T23:29:02.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.191+0000 7f31aabc4700 1 -- 172.21.15.92:0/3089295832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a411bb70 con 0x7f31a409fd80 2023-09-29T23:29:02.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.192+0000 7f31aabc4700 1 -- 172.21.15.92:0/3089295832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31a40a1b50 con 0x7f31a409fd80 2023-09-29T23:29:02.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.192+0000 7f3198ff9700 1 -- 172.21.15.92:0/3089295832 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f31a00070f0 con 0x7f31a409fd80 2023-09-29T23:29:02.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.192+0000 7f3198ff9700 1 --2- 172.21.15.92:0/3089295832 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3190035630 0x7f3190037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:02.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.192+0000 7f3198ff9700 1 -- 172.21.15.92:0/3089295832 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f31a00478b0 con 0x7f31a409fd80 2023-09-29T23:29:02.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.192+0000 7f319bfff700 1 --2- 172.21.15.92:0/3089295832 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3190035630 0x7f3190037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:02.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.192+0000 7f3198ff9700 1 --2- 172.21.15.92:0/3089295832 >> [v2:172.21.15.92:6800/85704,v1:172.21.15.92:6801/85704] conn(0x7f319003c7c0 0x7f319003ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:02.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.192+0000 7f3198ff9700 1 -- 172.21.15.92:0/3089295832 --> [v2:172.21.15.92:6800/85704,v1:172.21.15.92:6801/85704] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f319003f360 con 0x7f319003c7c0 2023-09-29T23:29:02.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.192+0000 7f3198ff9700 1 -- 172.21.15.92:0/3089295832 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31a004c220 con 0x7f31a409fd80 2023-09-29T23:29:02.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.192+0000 7f31a9161700 1 --2- 172.21.15.92:0/3089295832 >> [v2:172.21.15.92:6800/85704,v1:172.21.15.92:6801/85704] conn(0x7f319003c7c0 0x7f319003ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:02.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.193+0000 7f319bfff700 1 --2- 172.21.15.92:0/3089295832 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3190035630 0x7f3190037ae0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3194009860 tx=0x7f3194016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:02.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.193+0000 7f31a9161700 1 --2- 172.21.15.92:0/3089295832 >> [v2:172.21.15.92:6800/85704,v1:172.21.15.92:6801/85704] conn(0x7f319003c7c0 0x7f319003ec50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:02.196 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.193+0000 7f3198ff9700 1 -- 172.21.15.92:0/3089295832 <== osd.2 v2:172.21.15.92:6800/85704 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f319003f360 con 0x7f319003c7c0 2023-09-29T23:29:02.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.206+0000 7f31aabc4700 1 -- 172.21.15.92:0/3089295832 --> [v2:172.21.15.92:6800/85704,v1:172.21.15.92:6801/85704] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f31a405f230 con 0x7f319003c7c0 2023-09-29T23:29:02.207 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.207+0000 7f3198ff9700 1 -- 172.21.15.92:0/3089295832 <== osd.2 v2:172.21.15.92:6800/85704 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f31a405f230 con 0x7f319003c7c0 2023-09-29T23:29:02.207 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2023-09-29T23:29:02.207 INFO:teuthology.orchestra.run.smithi092.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-29T23:29:02.207 INFO:teuthology.orchestra.run.smithi092.stdout:} 2023-09-29T23:29:02.208 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.207+0000 7f31aabc4700 1 -- 172.21.15.92:0/3089295832 >> [v2:172.21.15.92:6800/85704,v1:172.21.15.92:6801/85704] conn(0x7f319003c7c0 msgr2=0x7f319003ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:02.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.207+0000 7f31aabc4700 1 --2- 172.21.15.92:0/3089295832 >> [v2:172.21.15.92:6800/85704,v1:172.21.15.92:6801/85704] conn(0x7f319003c7c0 0x7f319003ec50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:02.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.207+0000 7f31aabc4700 1 -- 172.21.15.92:0/3089295832 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3190035630 msgr2=0x7f3190037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:02.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.207+0000 7f31aabc4700 1 --2- 172.21.15.92:0/3089295832 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3190035630 0x7f3190037ae0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3194009860 tx=0x7f3194016000 comp rx=0 tx=0).stop 2023-09-29T23:29:02.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.207+0000 7f31aabc4700 1 -- 172.21.15.92:0/3089295832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a409fd80 msgr2=0x7f31a413e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:02.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.207+0000 7f31aabc4700 1 --2- 172.21.15.92:0/3089295832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a409fd80 0x7f31a413e520 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f31a000cb70 tx=0x7f31a0001a30 comp rx=0 tx=0).stop 2023-09-29T23:29:02.209 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.207+0000 7f31aabc4700 1 -- 172.21.15.92:0/3089295832 shutdown_connections 2023-09-29T23:29:02.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.207+0000 7f31aabc4700 1 --2- 172.21.15.92:0/3089295832 >> [v2:172.21.15.92:6800/85704,v1:172.21.15.92:6801/85704] conn(0x7f319003c7c0 0x7f319003ec50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:02.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.207+0000 7f31aabc4700 1 --2- 172.21.15.92:0/3089295832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31a409fd80 0x7f31a413e520 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:02.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.207+0000 7f31aabc4700 1 --2- 172.21.15.92:0/3089295832 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f3190035630 0x7f3190037ae0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:02.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.207+0000 7f31aabc4700 1 -- 172.21.15.92:0/3089295832 >> 172.21.15.92:0/3089295832 conn(0x7f31a4068000 msgr2=0x7f31a412dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:02.210 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.207+0000 7f31aabc4700 1 -- 172.21.15.92:0/3089295832 shutdown_connections 2023-09-29T23:29:02.211 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.207+0000 7f31aabc4700 1 -- 172.21.15.92:0/3089295832 wait complete. 2023-09-29T23:29:02.218 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-09-29T23:29:02.332 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.332+0000 7f80047ad700 1 Processor -- start 2023-09-29T23:29:02.333 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.332+0000 7f80047ad700 1 -- start start 2023-09-29T23:29:02.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.333+0000 7f80047ad700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7ffc06f210 0x7f7ffc069930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:02.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.333+0000 7f80047ad700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ffc069620 con 0x7f7ffc09b890 2023-09-29T23:29:02.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.333+0000 7f80047ad700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ffc06f5e0 con 0x7f7ffc06f210 2023-09-29T23:29:02.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.333+0000 7f8002549700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7ffc06f210 0x7f7ffc069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:02.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.333+0000 7f8001d48700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f7ffc09b890 0x7f7ffc069e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54328/0 (socket says 172.21.15.92:54328) 2023-09-29T23:29:02.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.333+0000 7f8002549700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7ffc06f210 0x7f7ffc069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37350/0 (socket says 172.21.15.92:37350) 2023-09-29T23:29:02.336 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.333+0000 7f8001d48700 1 -- 172.21.15.92:0/4147585208 learned_addr learned my addr 172.21.15.92:0/4147585208 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:29:02.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.333+0000 7f8002549700 1 -- 172.21.15.92:0/4147585208 >> v1:172.21.15.92:6789/0 conn(0x7f7ffc09b890 legacy=0x7f7ffc069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:02.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.333+0000 7f8002549700 1 -- 172.21.15.92:0/4147585208 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc09cc70 con 0x7f7ffc06f210 2023-09-29T23:29:02.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.333+0000 7f8002549700 1 --2- 172.21.15.92:0/4147585208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ffc06f210 0x7f7ffc069930 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009e30 tx=0x7f7fec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b415d5e53adbd05 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:02.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.333+0000 7f8001547700 1 -- 172.21.15.92:0/4147585208 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fec00e070 con 0x7f7ffc06f210 2023-09-29T23:29:02.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.333+0000 7f8001547700 1 -- 172.21.15.92:0/4147585208 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fec00bd70 con 0x7f7ffc06f210 2023-09-29T23:29:02.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.333+0000 7f8001547700 1 -- 172.21.15.92:0/4147585208 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fec0125b0 con 0x7f7ffc06f210 2023-09-29T23:29:02.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.334+0000 7f80047ad700 1 -- 172.21.15.92:0/4147585208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ffc06f210 msgr2=0x7f7ffc069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:02.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.334+0000 7f80047ad700 1 --2- 172.21.15.92:0/4147585208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ffc06f210 0x7f7ffc069930 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009e30 tx=0x7f7fec009780 comp rx=0 tx=0).stop 2023-09-29T23:29:02.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.334+0000 7f80047ad700 1 -- 172.21.15.92:0/4147585208 shutdown_connections 2023-09-29T23:29:02.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.334+0000 7f80047ad700 1 --2- 172.21.15.92:0/4147585208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ffc06f210 0x7f7ffc069930 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:02.337 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.334+0000 7f80047ad700 1 -- 172.21.15.92:0/4147585208 >> 172.21.15.92:0/4147585208 conn(0x7f7ffc094a70 msgr2=0x7f7ffc06eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:02.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.334+0000 7f80047ad700 1 -- 172.21.15.92:0/4147585208 shutdown_connections 2023-09-29T23:29:02.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.334+0000 7f80047ad700 1 -- 172.21.15.92:0/4147585208 wait complete. 2023-09-29T23:29:02.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.335+0000 7f80047ad700 1 Processor -- start 2023-09-29T23:29:02.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.335+0000 7f80047ad700 1 -- start start 2023-09-29T23:29:02.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.335+0000 7f80047ad700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ffc06f210 0x7f7ffc11e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:02.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.335+0000 7f80047ad700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc11a920 con 0x7f7ffc06f210 2023-09-29T23:29:02.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.335+0000 7f8002549700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ffc06f210 0x7f7ffc11e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:02.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.335+0000 7f8002549700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ffc06f210 0x7f7ffc11e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37354/0 (socket says 172.21.15.92:37354) 2023-09-29T23:29:02.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.335+0000 7f8002549700 1 -- 172.21.15.92:0/2336707184 learned_addr learned my addr 172.21.15.92:0/2336707184 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:29:02.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.335+0000 7f8002549700 1 -- 172.21.15.92:0/2336707184 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec009a20 con 0x7f7ffc06f210 2023-09-29T23:29:02.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.336+0000 7f8002549700 1 --2- 172.21.15.92:0/2336707184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ffc06f210 0x7f7ffc11e000 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7fec0097c0 tx=0x7f7fec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:02.338 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.336+0000 7f7ffa7fc700 1 -- 172.21.15.92:0/2336707184 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fec012e00 con 0x7f7ffc06f210 2023-09-29T23:29:02.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.336+0000 7f7ffa7fc700 1 -- 172.21.15.92:0/2336707184 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fec01d640 con 0x7f7ffc06f210 2023-09-29T23:29:02.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.336+0000 7f80047ad700 1 -- 172.21.15.92:0/2336707184 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ffc11e6e0 con 0x7f7ffc06f210 2023-09-29T23:29:02.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.336+0000 7f7ffa7fc700 1 -- 172.21.15.92:0/2336707184 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fec01d930 con 0x7f7ffc06f210 2023-09-29T23:29:02.339 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.336+0000 7f80047ad700 1 -- 172.21.15.92:0/2336707184 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ffc11c060 con 0x7f7ffc06f210 2023-09-29T23:29:02.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.336+0000 7f7ffa7fc700 1 -- 172.21.15.92:0/2336707184 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f7fec024070 con 0x7f7ffc06f210 2023-09-29T23:29:02.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.337+0000 7f7ffa7fc700 1 --2- 172.21.15.92:0/2336707184 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7fe8035640 0x7f7fe8037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:02.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.337+0000 7f7ffa7fc700 1 -- 172.21.15.92:0/2336707184 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f7fec049d30 con 0x7f7ffc06f210 2023-09-29T23:29:02.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.337+0000 7f8001d48700 1 --2- 172.21.15.92:0/2336707184 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7fe8035640 0x7f7fe8037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:02.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.337+0000 7f80047ad700 1 -- 172.21.15.92:0/2336707184 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ffc06fbe0 con 0x7f7ffc06f210 2023-09-29T23:29:02.340 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.337+0000 7f8001d48700 1 --2- 172.21.15.92:0/2336707184 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7fe8035640 0x7f7fe8037af0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0007fd0 tx=0x7f7ff0007b00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:02.341 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.341+0000 7f7ffa7fc700 1 -- 172.21.15.92:0/2336707184 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7fec01e950 con 0x7f7ffc06f210 2023-09-29T23:29:02.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.524+0000 7f80047ad700 1 -- 172.21.15.92:0/2336707184 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ffc05f230 con 0x7f7fe8035640 2023-09-29T23:29:02.524 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.524+0000 7f7ffa7fc700 1 -- 172.21.15.92:0/2336707184 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7ffc05f230 con 0x7f7fe8035640 2023-09-29T23:29:02.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.526+0000 7f80047ad700 1 -- 172.21.15.92:0/2336707184 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7fe8035640 msgr2=0x7f7fe8037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:02.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.526+0000 7f80047ad700 1 --2- 172.21.15.92:0/2336707184 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7fe8035640 0x7f7fe8037af0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0007fd0 tx=0x7f7ff0007b00 comp rx=0 tx=0).stop 2023-09-29T23:29:02.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.526+0000 7f80047ad700 1 -- 172.21.15.92:0/2336707184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ffc06f210 msgr2=0x7f7ffc11e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:02.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.526+0000 7f80047ad700 1 --2- 172.21.15.92:0/2336707184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ffc06f210 0x7f7ffc11e000 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7fec0097c0 tx=0x7f7fec018000 comp rx=0 tx=0).stop 2023-09-29T23:29:02.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.526+0000 7f80047ad700 1 -- 172.21.15.92:0/2336707184 shutdown_connections 2023-09-29T23:29:02.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.526+0000 7f80047ad700 1 --2- 172.21.15.92:0/2336707184 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f7fe8035640 0x7f7fe8037af0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:02.527 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.526+0000 7f80047ad700 1 --2- 172.21.15.92:0/2336707184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ffc06f210 0x7f7ffc11e000 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:02.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.526+0000 7f80047ad700 1 -- 172.21.15.92:0/2336707184 >> 172.21.15.92:0/2336707184 conn(0x7f7ffc094a70 msgr2=0x7f7ffc06dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:02.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.526+0000 7f80047ad700 1 -- 172.21.15.92:0/2336707184 shutdown_connections 2023-09-29T23:29:02.528 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.526+0000 7f80047ad700 1 -- 172.21.15.92:0/2336707184 wait complete. 2023-09-29T23:29:02.528 INFO:teuthology.orchestra.run.smithi092.stderr:instructed osd(s) 2 to deep-scrub 2023-09-29T23:29:02.538 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:29:02.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.650+0000 7f73cc572700 1 Processor -- start 2023-09-29T23:29:02.651 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.650+0000 7f73cc572700 1 -- start start 2023-09-29T23:29:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.651+0000 7f73cc572700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f73c412fcb0 0x7f73c4134620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.651+0000 7f73cc572700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c40997f0 con 0x7f73c40a3030 2023-09-29T23:29:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.651+0000 7f73cc572700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c40a3400 con 0x7f73c412fcb0 2023-09-29T23:29:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.651+0000 7f73c9b0d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f73c412fcb0 0x7f73c4134620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.651+0000 7f73ca30e700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f73c40a3030 0x7f73c412f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:54344/0 (socket says 172.21.15.92:54344) 2023-09-29T23:29:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.651+0000 7f73ca30e700 1 -- 172.21.15.92:0/2558993230 learned_addr learned my addr 172.21.15.92:0/2558993230 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:29:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.651+0000 7f73c9b0d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f73c412fcb0 0x7f73c4134620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37358/0 (socket says 172.21.15.92:37358) 2023-09-29T23:29:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.651+0000 7f73c9b0d700 1 -- 172.21.15.92:0/2558993230 >> v1:172.21.15.92:6789/0 conn(0x7f73c40a3030 legacy=0x7f73c412f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.652+0000 7f73c9b0d700 1 -- 172.21.15.92:0/2558993230 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c40977a0 con 0x7f73c412fcb0 2023-09-29T23:29:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.651+0000 7f73c930c700 1 -- 172.21.15.92:0/2558993230 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491595169 0 0) 0x7f73c40997f0 con 0x7f73c40a3030 2023-09-29T23:29:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.652+0000 7f73c9b0d700 1 --2- 172.21.15.92:0/2558993230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c412fcb0 0x7f73c4134620 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009860 tx=0x7f73b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7ad3de53ee7889 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.652+0000 7f73c930c700 1 -- 172.21.15.92:0/2558993230 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73b400b710 con 0x7f73c412fcb0 2023-09-29T23:29:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.652+0000 7f73c930c700 1 -- 172.21.15.92:0/2558993230 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b400b870 con 0x7f73c412fcb0 2023-09-29T23:29:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.652+0000 7f73c930c700 1 -- 172.21.15.92:0/2558993230 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73b400ba20 con 0x7f73c412fcb0 2023-09-29T23:29:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.652+0000 7f73cc572700 1 -- 172.21.15.92:0/2558993230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c412fcb0 msgr2=0x7f73c4134620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.652+0000 7f73cc572700 1 --2- 172.21.15.92:0/2558993230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c412fcb0 0x7f73c4134620 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009860 tx=0x7f73b40091a0 comp rx=0 tx=0).stop 2023-09-29T23:29:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.652+0000 7f73cc572700 1 -- 172.21.15.92:0/2558993230 shutdown_connections 2023-09-29T23:29:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.652+0000 7f73cc572700 1 --2- 172.21.15.92:0/2558993230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c412fcb0 0x7f73c4134620 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.652+0000 7f73cc572700 1 -- 172.21.15.92:0/2558993230 >> 172.21.15.92:0/2558993230 conn(0x7f73c4067fc0 msgr2=0x7f73c40a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.652+0000 7f73cc572700 1 -- 172.21.15.92:0/2558993230 shutdown_connections 2023-09-29T23:29:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.652+0000 7f73cc572700 1 -- 172.21.15.92:0/2558993230 wait complete. 2023-09-29T23:29:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.653+0000 7f73cc572700 1 Processor -- start 2023-09-29T23:29:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.653+0000 7f73cc572700 1 -- start start 2023-09-29T23:29:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.653+0000 7f73cc572700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c40a3030 0x7f73c412c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.653+0000 7f73cc572700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c411e710 con 0x7f73c40a3030 2023-09-29T23:29:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.654+0000 7f73ca30e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c40a3030 0x7f73c412c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.654+0000 7f73ca30e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c40a3030 0x7f73c412c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37370/0 (socket says 172.21.15.92:37370) 2023-09-29T23:29:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.654+0000 7f73ca30e700 1 -- 172.21.15.92:0/1155020061 learned_addr learned my addr 172.21.15.92:0/1155020061 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:29:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.654+0000 7f73ca30e700 1 -- 172.21.15.92:0/1155020061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b4009420 con 0x7f73c40a3030 2023-09-29T23:29:02.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.654+0000 7f73ca30e700 1 --2- 172.21.15.92:0/1155020061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c40a3030 0x7f73c412c150 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f73c000cbc0 tx=0x7f73c0001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:02.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.654+0000 7f73ba7fc700 1 -- 172.21.15.92:0/1155020061 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73c000a9d0 con 0x7f73c40a3030 2023-09-29T23:29:02.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.654+0000 7f73ba7fc700 1 -- 172.21.15.92:0/1155020061 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c000ab30 con 0x7f73c40a3030 2023-09-29T23:29:02.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.654+0000 7f73cc572700 1 -- 172.21.15.92:0/1155020061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c411ec50 con 0x7f73c40a3030 2023-09-29T23:29:02.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.654+0000 7f73ba7fc700 1 -- 172.21.15.92:0/1155020061 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73c000ade0 con 0x7f73c40a3030 2023-09-29T23:29:02.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.654+0000 7f73cc572700 1 -- 172.21.15.92:0/1155020061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c411e940 con 0x7f73c40a3030 2023-09-29T23:29:02.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.655+0000 7f73ba7fc700 1 -- 172.21.15.92:0/1155020061 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f73c00070f0 con 0x7f73c40a3030 2023-09-29T23:29:02.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.655+0000 7f73cc572700 1 -- 172.21.15.92:0/1155020061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c411b490 con 0x7f73c40a3030 2023-09-29T23:29:02.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.655+0000 7f73ba7fc700 1 --2- 172.21.15.92:0/1155020061 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f73a8035680 0x7f73a8037b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:02.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.655+0000 7f73ba7fc700 1 -- 172.21.15.92:0/1155020061 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f73c0047aa0 con 0x7f73c40a3030 2023-09-29T23:29:02.659 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.655+0000 7f73c9b0d700 1 --2- 172.21.15.92:0/1155020061 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f73a8035680 0x7f73a8037b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:02.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.656+0000 7f73c9b0d700 1 --2- 172.21.15.92:0/1155020061 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f73a8035680 0x7f73a8037b30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f73b4006eb0 tx=0x7f73b4016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:02.660 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.660+0000 7f73ba7fc700 1 -- 172.21.15.92:0/1155020061 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73c00073a0 con 0x7f73c40a3030 2023-09-29T23:29:02.837 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.837+0000 7f73cc572700 1 -- 172.21.15.92:0/1155020061 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73c4096410 con 0x7f73a8035680 2023-09-29T23:29:02.844 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.844+0000 7f73ba7fc700 1 -- 172.21.15.92:0/1155020061 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264984 (secure 0 0 0) 0x7f73c4096410 con 0x7f73a8035680 2023-09-29T23:29:02.847 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:29:02.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.847+0000 7f73cc572700 1 -- 172.21.15.92:0/1155020061 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f73a8035680 msgr2=0x7f73a8037b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:02.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.847+0000 7f73cc572700 1 --2- 172.21.15.92:0/1155020061 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f73a8035680 0x7f73a8037b30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f73b4006eb0 tx=0x7f73b4016000 comp rx=0 tx=0).stop 2023-09-29T23:29:02.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.847+0000 7f73cc572700 1 -- 172.21.15.92:0/1155020061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c40a3030 msgr2=0x7f73c412c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:02.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.847+0000 7f73cc572700 1 --2- 172.21.15.92:0/1155020061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c40a3030 0x7f73c412c150 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f73c000cbc0 tx=0x7f73c0001a80 comp rx=0 tx=0).stop 2023-09-29T23:29:02.849 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.847+0000 7f73cc572700 1 -- 172.21.15.92:0/1155020061 shutdown_connections 2023-09-29T23:29:02.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.847+0000 7f73cc572700 1 --2- 172.21.15.92:0/1155020061 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f73a8035680 0x7f73a8037b30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:02.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.847+0000 7f73cc572700 1 --2- 172.21.15.92:0/1155020061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c40a3030 0x7f73c412c150 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:02.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.847+0000 7f73cc572700 1 -- 172.21.15.92:0/1155020061 >> 172.21.15.92:0/1155020061 conn(0x7f73c4067fc0 msgr2=0x7f73c412d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:02.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.847+0000 7f73cc572700 1 -- 172.21.15.92:0/1155020061 shutdown_connections 2023-09-29T23:29:02.850 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:02.847+0000 7f73cc572700 1 -- 172.21.15.92:0/1155020061 wait complete. 2023-09-29T23:29:02.850 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-09-29T23:29:02.859 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2023-09-29T23:29:02.108847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":208,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":16696,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":314556104,"statfs":{"total":322122547200,"available":322105450496,"internally_reserved":0,"allocated":557056,"data_stored":160657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002533"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284180+0000","last_change":"2023-09-29T23:23:45.465624+0000","last_active":"2023-09-29T23:24:36.284180+0000","last_peered":"2023-09-29T23:24:36.284180+0000","last_clean":"2023-09-29T23:24:36.284180+0000","last_became_active":"2023-09-29T23:23:45.464271+0000","last_became_peered":"2023-09-29T23:23:45.464271+0000","last_unstale":"2023-09-29T23:24:36.284180+0000","last_undegraded":"2023-09-29T23:24:36.284180+0000","last_fullsized":"2023-09-29T23:24:36.284180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:54:19.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282759+0000","last_change":"2023-09-29T23:23:45.466587+0000","last_active":"2023-09-29T23:24:36.282759+0000","last_peered":"2023-09-29T23:24:36.282759+0000","last_clean":"2023-09-29T23:24:36.282759+0000","last_became_active":"2023-09-29T23:23:45.466338+0000","last_became_peered":"2023-09-29T23:23:45.466338+0000","last_unstale":"2023-09-29T23:24:36.282759+0000","last_undegraded":"2023-09-29T23:24:36.282759+0000","last_fullsized":"2023-09-29T23:24:36.282759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284501+0000","last_change":"2023-09-29T23:23:45.477248+0000","last_active":"2023-09-29T23:24:36.284501+0000","last_peered":"2023-09-29T23:24:36.284501+0000","last_clean":"2023-09-29T23:24:36.284501+0000","last_became_active":"2023-09-29T23:23:45.474129+0000","last_became_peered":"2023-09-29T23:23:45.474129+0000","last_unstale":"2023-09-29T23:24:36.284501+0000","last_undegraded":"2023-09-29T23:24:36.284501+0000","last_fullsized":"2023-09-29T23:24:36.284501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:09:27.600159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278328+0000","last_change":"2023-09-29T23:23:45.471200+0000","last_active":"2023-09-29T23:24:36.278328+0000","last_peered":"2023-09-29T23:24:36.278328+0000","last_clean":"2023-09-29T23:24:36.278328+0000","last_became_active":"2023-09-29T23:23:45.470971+0000","last_became_peered":"2023-09-29T23:23:45.470971+0000","last_unstale":"2023-09-29T23:24:36.278328+0000","last_undegraded":"2023-09-29T23:24:36.278328+0000","last_fullsized":"2023-09-29T23:24:36.278328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:29:34.531515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282900+0000","last_change":"2023-09-29T23:23:45.473831+0000","last_active":"2023-09-29T23:24:36.282900+0000","last_peered":"2023-09-29T23:24:36.282900+0000","last_clean":"2023-09-29T23:24:36.282900+0000","last_became_active":"2023-09-29T23:23:45.473570+0000","last_became_peered":"2023-09-29T23:23:45.473570+0000","last_unstale":"2023-09-29T23:24:36.282900+0000","last_undegraded":"2023-09-29T23:24:36.282900+0000","last_fullsized":"2023-09-29T23:24:36.282900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:51:36.401360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277945+0000","last_change":"2023-09-29T23:23:45.470583+0000","last_active":"2023-09-29T23:24:36.277945+0000","last_peered":"2023-09-29T23:24:36.277945+0000","last_clean":"2023-09-29T23:24:36.277945+0000","last_became_active":"2023-09-29T23:23:45.470349+0000","last_became_peered":"2023-09-29T23:23:45.470349+0000","last_unstale":"2023-09-29T23:24:36.277945+0000","last_undegraded":"2023-09-29T23:24:36.277945+0000","last_fullsized":"2023-09-29T23:24:36.277945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:50:32.868236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282803+0000","last_change":"2023-09-29T23:23:45.465376+0000","last_active":"2023-09-29T23:24:36.282803+0000","last_peered":"2023-09-29T23:24:36.282803+0000","last_clean":"2023-09-29T23:24:36.282803+0000","last_became_active":"2023-09-29T23:23:45.464893+0000","last_became_peered":"2023-09-29T23:23:45.464893+0000","last_unstale":"2023-09-29T23:24:36.282803+0000","last_undegraded":"2023-09-29T23:24:36.282803+0000","last_fullsized":"2023-09-29T23:24:36.282803+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:34:22.460877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277761+0000","last_change":"2023-09-29T23:23:45.463286+0000","last_active":"2023-09-29T23:24:36.277761+0000","last_peered":"2023-09-29T23:24:36.277761+0000","last_clean":"2023-09-29T23:24:36.277761+0000","last_became_active":"2023-09-29T23:23:45.462888+0000","last_became_peered":"2023-09-29T23:23:45.462888+0000","last_unstale":"2023-09-29T23:24:36.277761+0000","last_undegraded":"2023-09-29T23:24:36.277761+0000","last_fullsized":"2023-09-29T23:24:36.277761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281893+0000","last_change":"2023-09-29T23:23:45.468860+0000","last_active":"2023-09-29T23:24:36.281893+0000","last_peered":"2023-09-29T23:24:36.281893+0000","last_clean":"2023-09-29T23:24:36.281893+0000","last_became_active":"2023-09-29T23:23:45.468303+0000","last_became_peered":"2023-09-29T23:23:45.468303+0000","last_unstale":"2023-09-29T23:24:36.281893+0000","last_undegraded":"2023-09-29T23:24:36.281893+0000","last_fullsized":"2023-09-29T23:24:36.281893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:34:22.460877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.285573+0000","last_change":"2023-09-29T23:24:37.285573+0000","last_active":"2023-09-29T23:24:37.285573+0000","last_peered":"2023-09-29T23:24:37.285573+0000","last_clean":"2023-09-29T23:24:37.285573+0000","last_became_active":"2023-09-29T23:24:37.285339+0000","last_became_peered":"2023-09-29T23:24:37.285339+0000","last_unstale":"2023-09-29T23:24:37.285573+0000","last_undegraded":"2023-09-29T23:24:37.285573+0000","last_fullsized":"2023-09-29T23:24:37.285573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:26:49.563741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284446+0000","last_change":"2023-09-29T23:23:45.467858+0000","last_active":"2023-09-29T23:24:36.284446+0000","last_peered":"2023-09-29T23:24:36.284446+0000","last_clean":"2023-09-29T23:24:36.284446+0000","last_became_active":"2023-09-29T23:23:45.464083+0000","last_became_peered":"2023-09-29T23:23:45.464083+0000","last_unstale":"2023-09-29T23:24:36.284446+0000","last_undegraded":"2023-09-29T23:24:36.284446+0000","last_fullsized":"2023-09-29T23:24:36.284446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:30:57.865969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283523+0000","last_change":"2023-09-29T23:23:45.466588+0000","last_active":"2023-09-29T23:24:36.283523+0000","last_peered":"2023-09-29T23:24:36.283523+0000","last_clean":"2023-09-29T23:24:36.283523+0000","last_became_active":"2023-09-29T23:23:45.466161+0000","last_became_peered":"2023-09-29T23:23:45.466161+0000","last_unstale":"2023-09-29T23:24:36.283523+0000","last_undegraded":"2023-09-29T23:24:36.283523+0000","last_fullsized":"2023-09-29T23:24:36.283523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:13.284557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283618+0000","last_change":"2023-09-29T23:23:45.467402+0000","last_active":"2023-09-29T23:24:36.283618+0000","last_peered":"2023-09-29T23:24:36.283618+0000","last_clean":"2023-09-29T23:24:36.283618+0000","last_became_active":"2023-09-29T23:23:45.467178+0000","last_became_peered":"2023-09-29T23:23:45.467178+0000","last_unstale":"2023-09-29T23:24:36.283618+0000","last_undegraded":"2023-09-29T23:24:36.283618+0000","last_fullsized":"2023-09-29T23:24:36.283618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282929+0000","last_change":"2023-09-29T23:23:45.465231+0000","last_active":"2023-09-29T23:24:36.282929+0000","last_peered":"2023-09-29T23:24:36.282929+0000","last_clean":"2023-09-29T23:24:36.282929+0000","last_became_active":"2023-09-29T23:23:45.464523+0000","last_became_peered":"2023-09-29T23:23:45.464523+0000","last_unstale":"2023-09-29T23:24:36.282929+0000","last_undegraded":"2023-09-29T23:24:36.282929+0000","last_fullsized":"2023-09-29T23:24:36.282929+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:32.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280968+0000","last_change":"2023-09-29T23:23:45.470349+0000","last_active":"2023-09-29T23:24:36.280968+0000","last_peered":"2023-09-29T23:24:36.280968+0000","last_clean":"2023-09-29T23:24:36.280968+0000","last_became_active":"2023-09-29T23:23:45.467004+0000","last_became_peered":"2023-09-29T23:23:45.467004+0000","last_unstale":"2023-09-29T23:24:36.280968+0000","last_undegraded":"2023-09-29T23:24:36.280968+0000","last_fullsized":"2023-09-29T23:24:36.280968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277802+0000","last_change":"2023-09-29T23:23:45.471536+0000","last_active":"2023-09-29T23:24:36.277802+0000","last_peered":"2023-09-29T23:24:36.277802+0000","last_clean":"2023-09-29T23:24:36.277802+0000","last_became_active":"2023-09-29T23:23:45.471334+0000","last_became_peered":"2023-09-29T23:23:45.471334+0000","last_unstale":"2023-09-29T23:24:36.277802+0000","last_undegraded":"2023-09-29T23:24:36.277802+0000","last_fullsized":"2023-09-29T23:24:36.277802+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282404+0000","last_change":"2023-09-29T23:23:45.468857+0000","last_active":"2023-09-29T23:24:36.282404+0000","last_peered":"2023-09-29T23:24:36.282404+0000","last_clean":"2023-09-29T23:24:36.282404+0000","last_became_active":"2023-09-29T23:23:45.468001+0000","last_became_peered":"2023-09-29T23:23:45.468001+0000","last_unstale":"2023-09-29T23:24:36.282404+0000","last_undegraded":"2023-09-29T23:24:36.282404+0000","last_fullsized":"2023-09-29T23:24:36.282404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:11.211646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278543+0000","last_change":"2023-09-29T23:23:45.467819+0000","last_active":"2023-09-29T23:24:36.278543+0000","last_peered":"2023-09-29T23:24:36.278543+0000","last_clean":"2023-09-29T23:24:36.278543+0000","last_became_active":"2023-09-29T23:23:45.467434+0000","last_became_peered":"2023-09-29T23:23:45.467434+0000","last_unstale":"2023-09-29T23:24:36.278543+0000","last_undegraded":"2023-09-29T23:24:36.278543+0000","last_fullsized":"2023-09-29T23:24:36.278543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284385+0000","last_change":"2023-09-29T23:23:45.473751+0000","last_active":"2023-09-29T23:24:36.284385+0000","last_peered":"2023-09-29T23:24:36.284385+0000","last_clean":"2023-09-29T23:24:36.284385+0000","last_became_active":"2023-09-29T23:23:45.473326+0000","last_became_peered":"2023-09-29T23:23:45.473326+0000","last_unstale":"2023-09-29T23:24:36.284385+0000","last_undegraded":"2023-09-29T23:24:36.284385+0000","last_fullsized":"2023-09-29T23:24:36.284385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:21:17.261104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283374+0000","last_change":"2023-09-29T23:23:45.467719+0000","last_active":"2023-09-29T23:24:36.283374+0000","last_peered":"2023-09-29T23:24:36.283374+0000","last_clean":"2023-09-29T23:24:36.283374+0000","last_became_active":"2023-09-29T23:23:45.467494+0000","last_became_peered":"2023-09-29T23:23:45.467494+0000","last_unstale":"2023-09-29T23:24:36.283374+0000","last_undegraded":"2023-09-29T23:24:36.283374+0000","last_fullsized":"2023-09-29T23:24:36.283374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284067+0000","last_change":"2023-09-29T23:23:45.478055+0000","last_active":"2023-09-29T23:24:36.284067+0000","last_peered":"2023-09-29T23:24:36.284067+0000","last_clean":"2023-09-29T23:24:36.284067+0000","last_became_active":"2023-09-29T23:23:45.477408+0000","last_became_peered":"2023-09-29T23:23:45.477408+0000","last_unstale":"2023-09-29T23:24:36.284067+0000","last_undegraded":"2023-09-29T23:24:36.284067+0000","last_fullsized":"2023-09-29T23:24:36.284067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:14:56.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280999+0000","last_change":"2023-09-29T23:23:45.471232+0000","last_active":"2023-09-29T23:24:36.280999+0000","last_peered":"2023-09-29T23:24:36.280999+0000","last_clean":"2023-09-29T23:24:36.280999+0000","last_became_active":"2023-09-29T23:23:45.470574+0000","last_became_peered":"2023-09-29T23:23:45.470574+0000","last_unstale":"2023-09-29T23:24:36.280999+0000","last_undegraded":"2023-09-29T23:24:36.280999+0000","last_fullsized":"2023-09-29T23:24:36.280999+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:25:25.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282928+0000","last_change":"2023-09-29T23:23:45.474093+0000","last_active":"2023-09-29T23:24:36.282928+0000","last_peered":"2023-09-29T23:24:36.282928+0000","last_clean":"2023-09-29T23:24:36.282928+0000","last_became_active":"2023-09-29T23:23:45.473789+0000","last_became_peered":"2023-09-29T23:23:45.473789+0000","last_unstale":"2023-09-29T23:24:36.282928+0000","last_undegraded":"2023-09-29T23:24:36.282928+0000","last_fullsized":"2023-09-29T23:24:36.282928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:46.564456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282401+0000","last_change":"2023-09-29T23:23:45.465993+0000","last_active":"2023-09-29T23:24:36.282401+0000","last_peered":"2023-09-29T23:24:36.282401+0000","last_clean":"2023-09-29T23:24:36.282401+0000","last_became_active":"2023-09-29T23:23:45.465443+0000","last_became_peered":"2023-09-29T23:23:45.465443+0000","last_unstale":"2023-09-29T23:24:36.282401+0000","last_undegraded":"2023-09-29T23:24:36.282401+0000","last_fullsized":"2023-09-29T23:24:36.282401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:12:18.769461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278594+0000","last_change":"2023-09-29T23:23:45.458032+0000","last_active":"2023-09-29T23:24:36.278594+0000","last_peered":"2023-09-29T23:24:36.278594+0000","last_clean":"2023-09-29T23:24:36.278594+0000","last_became_active":"2023-09-29T23:23:45.457799+0000","last_became_peered":"2023-09-29T23:23:45.457799+0000","last_unstale":"2023-09-29T23:24:36.278594+0000","last_undegraded":"2023-09-29T23:24:36.278594+0000","last_fullsized":"2023-09-29T23:24:36.278594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:21:07.207937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.279021+0000","last_change":"2023-09-29T23:23:45.467967+0000","last_active":"2023-09-29T23:24:36.279021+0000","last_peered":"2023-09-29T23:24:36.279021+0000","last_clean":"2023-09-29T23:24:36.279021+0000","last_became_active":"2023-09-29T23:23:45.467730+0000","last_became_peered":"2023-09-29T23:23:45.467730+0000","last_unstale":"2023-09-29T23:24:36.279021+0000","last_undegraded":"2023-09-29T23:24:36.279021+0000","last_fullsized":"2023-09-29T23:24:36.279021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:23:19.840400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281305+0000","last_change":"2023-09-29T23:23:45.076072+0000","last_active":"2023-09-29T23:24:36.281305+0000","last_peered":"2023-09-29T23:24:36.281305+0000","last_clean":"2023-09-29T23:24:36.281305+0000","last_became_active":"2023-09-29T23:23:45.075848+0000","last_became_peered":"2023-09-29T23:23:45.075848+0000","last_unstale":"2023-09-29T23:24:36.281305+0000","last_undegraded":"2023-09-29T23:24:36.281305+0000","last_fullsized":"2023-09-29T23:24:36.281305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:29:13.914085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281203+0000","last_change":"2023-09-29T23:23:45.462781+0000","last_active":"2023-09-29T23:24:36.281203+0000","last_peered":"2023-09-29T23:24:36.281203+0000","last_clean":"2023-09-29T23:24:36.281203+0000","last_became_active":"2023-09-29T23:23:45.462155+0000","last_became_peered":"2023-09-29T23:23:45.462155+0000","last_unstale":"2023-09-29T23:24:36.281203+0000","last_undegraded":"2023-09-29T23:24:36.281203+0000","last_fullsized":"2023-09-29T23:24:36.281203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:31:13.284557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278059+0000","last_change":"2023-09-29T23:23:45.092553+0000","last_active":"2023-09-29T23:24:36.278059+0000","last_peered":"2023-09-29T23:24:36.278059+0000","last_clean":"2023-09-29T23:24:36.278059+0000","last_became_active":"2023-09-29T23:23:45.092273+0000","last_became_peered":"2023-09-29T23:23:45.092273+0000","last_unstale":"2023-09-29T23:24:36.278059+0000","last_undegraded":"2023-09-29T23:24:36.278059+0000","last_fullsized":"2023-09-29T23:24:36.278059+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284089+0000","last_change":"2023-09-29T23:23:45.464637+0000","last_active":"2023-09-29T23:24:36.284089+0000","last_peered":"2023-09-29T23:24:36.284089+0000","last_clean":"2023-09-29T23:24:36.284089+0000","last_became_active":"2023-09-29T23:23:45.464027+0000","last_became_peered":"2023-09-29T23:23:45.464027+0000","last_unstale":"2023-09-29T23:24:36.284089+0000","last_undegraded":"2023-09-29T23:24:36.284089+0000","last_fullsized":"2023-09-29T23:24:36.284089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283126+0000","last_change":"2023-09-29T23:23:45.088658+0000","last_active":"2023-09-29T23:24:36.283126+0000","last_peered":"2023-09-29T23:24:36.283126+0000","last_clean":"2023-09-29T23:24:36.283126+0000","last_became_active":"2023-09-29T23:23:45.088405+0000","last_became_peered":"2023-09-29T23:23:45.088405+0000","last_unstale":"2023-09-29T23:24:36.283126+0000","last_undegraded":"2023-09-29T23:24:36.283126+0000","last_fullsized":"2023-09-29T23:24:36.283126+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277980+0000","last_change":"2023-09-29T23:23:45.471459+0000","last_active":"2023-09-29T23:24:36.277980+0000","last_peered":"2023-09-29T23:24:36.277980+0000","last_clean":"2023-09-29T23:24:36.277980+0000","last_became_active":"2023-09-29T23:23:45.470917+0000","last_became_peered":"2023-09-29T23:23:45.470917+0000","last_unstale":"2023-09-29T23:24:36.277980+0000","last_undegraded":"2023-09-29T23:24:36.277980+0000","last_fullsized":"2023-09-29T23:24:36.277980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:29:34.889615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282482+0000","last_change":"2023-09-29T23:23:45.070764+0000","last_active":"2023-09-29T23:24:36.282482+0000","last_peered":"2023-09-29T23:24:36.282482+0000","last_clean":"2023-09-29T23:24:36.282482+0000","last_became_active":"2023-09-29T23:23:45.070610+0000","last_became_peered":"2023-09-29T23:23:45.070610+0000","last_unstale":"2023-09-29T23:24:36.282482+0000","last_undegraded":"2023-09-29T23:24:36.282482+0000","last_fullsized":"2023-09-29T23:24:36.282482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:26:19.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280943+0000","last_change":"2023-09-29T23:23:45.475877+0000","last_active":"2023-09-29T23:24:36.280943+0000","last_peered":"2023-09-29T23:24:36.280943+0000","last_clean":"2023-09-29T23:24:36.280943+0000","last_became_active":"2023-09-29T23:23:45.475634+0000","last_became_peered":"2023-09-29T23:23:45.475634+0000","last_unstale":"2023-09-29T23:24:36.280943+0000","last_undegraded":"2023-09-29T23:24:36.280943+0000","last_fullsized":"2023-09-29T23:24:36.280943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:59:25.888959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282216+0000","last_change":"2023-09-29T23:23:45.091556+0000","last_active":"2023-09-29T23:24:36.282216+0000","last_peered":"2023-09-29T23:24:36.282216+0000","last_clean":"2023-09-29T23:24:36.282216+0000","last_became_active":"2023-09-29T23:23:45.091317+0000","last_became_peered":"2023-09-29T23:23:45.091317+0000","last_unstale":"2023-09-29T23:24:36.282216+0000","last_undegraded":"2023-09-29T23:24:36.282216+0000","last_fullsized":"2023-09-29T23:24:36.282216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:53.097532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278718+0000","last_change":"2023-09-29T23:23:45.458805+0000","last_active":"2023-09-29T23:24:36.278718+0000","last_peered":"2023-09-29T23:24:36.278718+0000","last_clean":"2023-09-29T23:24:36.278718+0000","last_became_active":"2023-09-29T23:23:45.458585+0000","last_became_peered":"2023-09-29T23:23:45.458585+0000","last_unstale":"2023-09-29T23:24:36.278718+0000","last_undegraded":"2023-09-29T23:24:36.278718+0000","last_fullsized":"2023-09-29T23:24:36.278718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:05:18.350431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283894+0000","last_change":"2023-09-29T23:23:45.071269+0000","last_active":"2023-09-29T23:24:36.283894+0000","last_peered":"2023-09-29T23:24:36.283894+0000","last_clean":"2023-09-29T23:24:36.283894+0000","last_became_active":"2023-09-29T23:23:45.070986+0000","last_became_peered":"2023-09-29T23:23:45.070986+0000","last_unstale":"2023-09-29T23:24:36.283894+0000","last_undegraded":"2023-09-29T23:24:36.283894+0000","last_fullsized":"2023-09-29T23:24:36.283894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:29.355473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283998+0000","last_change":"2023-09-29T23:23:45.464917+0000","last_active":"2023-09-29T23:24:36.283998+0000","last_peered":"2023-09-29T23:24:36.283998+0000","last_clean":"2023-09-29T23:24:36.283998+0000","last_became_active":"2023-09-29T23:23:45.464510+0000","last_became_peered":"2023-09-29T23:23:45.464510+0000","last_unstale":"2023-09-29T23:24:36.283998+0000","last_undegraded":"2023-09-29T23:24:36.283998+0000","last_fullsized":"2023-09-29T23:24:36.283998+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:58:16.565151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"16'3","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281562+0000","last_change":"2023-09-29T23:23:45.077097+0000","last_active":"2023-09-29T23:24:36.281562+0000","last_peered":"2023-09-29T23:24:36.281562+0000","last_clean":"2023-09-29T23:24:36.281562+0000","last_became_active":"2023-09-29T23:23:45.076856+0000","last_became_peered":"2023-09-29T23:23:45.076856+0000","last_unstale":"2023-09-29T23:24:36.281562+0000","last_undegraded":"2023-09-29T23:24:36.281562+0000","last_fullsized":"2023-09-29T23:24:36.281562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:00:28.816753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281523+0000","last_change":"2023-09-29T23:23:45.462198+0000","last_active":"2023-09-29T23:24:36.281523+0000","last_peered":"2023-09-29T23:24:36.281523+0000","last_clean":"2023-09-29T23:24:36.281523+0000","last_became_active":"2023-09-29T23:23:45.461199+0000","last_became_peered":"2023-09-29T23:23:45.461199+0000","last_unstale":"2023-09-29T23:24:36.281523+0000","last_undegraded":"2023-09-29T23:24:36.281523+0000","last_fullsized":"2023-09-29T23:24:36.281523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:33.901646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"16'6","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278414+0000","last_change":"2023-09-29T23:23:45.093720+0000","last_active":"2023-09-29T23:24:36.278414+0000","last_peered":"2023-09-29T23:24:36.278414+0000","last_clean":"2023-09-29T23:24:36.278414+0000","last_became_active":"2023-09-29T23:23:45.093487+0000","last_became_peered":"2023-09-29T23:23:45.093487+0000","last_unstale":"2023-09-29T23:24:36.278414+0000","last_undegraded":"2023-09-29T23:24:36.278414+0000","last_fullsized":"2023-09-29T23:24:36.278414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284422+0000","last_change":"2023-09-29T23:23:45.466875+0000","last_active":"2023-09-29T23:24:36.284422+0000","last_peered":"2023-09-29T23:24:36.284422+0000","last_clean":"2023-09-29T23:24:36.284422+0000","last_became_active":"2023-09-29T23:23:45.466667+0000","last_became_peered":"2023-09-29T23:23:45.466667+0000","last_unstale":"2023-09-29T23:24:36.284422+0000","last_undegraded":"2023-09-29T23:24:36.284422+0000","last_fullsized":"2023-09-29T23:24:36.284422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:19.696930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283809+0000","last_change":"2023-09-29T23:23:45.089727+0000","last_active":"2023-09-29T23:24:36.283809+0000","last_peered":"2023-09-29T23:24:36.283809+0000","last_clean":"2023-09-29T23:24:36.283809+0000","last_became_active":"2023-09-29T23:23:45.089450+0000","last_became_peered":"2023-09-29T23:23:45.089450+0000","last_unstale":"2023-09-29T23:24:36.283809+0000","last_undegraded":"2023-09-29T23:24:36.283809+0000","last_fullsized":"2023-09-29T23:24:36.283809+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:18.091965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283179+0000","last_change":"2023-09-29T23:23:45.468316+0000","last_active":"2023-09-29T23:24:36.283179+0000","last_peered":"2023-09-29T23:24:36.283179+0000","last_clean":"2023-09-29T23:24:36.283179+0000","last_became_active":"2023-09-29T23:23:45.464801+0000","last_became_peered":"2023-09-29T23:23:45.464801+0000","last_unstale":"2023-09-29T23:24:36.283179+0000","last_undegraded":"2023-09-29T23:24:36.283179+0000","last_fullsized":"2023-09-29T23:24:36.283179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:23:46.126419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277995+0000","last_change":"2023-09-29T23:23:45.093148+0000","last_active":"2023-09-29T23:24:36.277995+0000","last_peered":"2023-09-29T23:24:36.277995+0000","last_clean":"2023-09-29T23:24:36.277995+0000","last_became_active":"2023-09-29T23:23:45.092902+0000","last_became_peered":"2023-09-29T23:23:45.092902+0000","last_unstale":"2023-09-29T23:24:36.277995+0000","last_undegraded":"2023-09-29T23:24:36.277995+0000","last_fullsized":"2023-09-29T23:24:36.277995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281207+0000","last_change":"2023-09-29T23:23:45.466007+0000","last_active":"2023-09-29T23:24:36.281207+0000","last_peered":"2023-09-29T23:24:36.281207+0000","last_clean":"2023-09-29T23:24:36.281207+0000","last_became_active":"2023-09-29T23:23:45.465743+0000","last_became_peered":"2023-09-29T23:23:45.465743+0000","last_unstale":"2023-09-29T23:24:36.281207+0000","last_undegraded":"2023-09-29T23:24:36.281207+0000","last_fullsized":"2023-09-29T23:24:36.281207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283019+0000","last_change":"2023-09-29T23:23:45.072234+0000","last_active":"2023-09-29T23:24:36.283019+0000","last_peered":"2023-09-29T23:24:36.283019+0000","last_clean":"2023-09-29T23:24:36.283019+0000","last_became_active":"2023-09-29T23:23:45.072009+0000","last_became_peered":"2023-09-29T23:23:45.072009+0000","last_unstale":"2023-09-29T23:24:36.283019+0000","last_undegraded":"2023-09-29T23:24:36.283019+0000","last_fullsized":"2023-09-29T23:24:36.283019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:15:37.187718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280617+0000","last_change":"2023-09-29T23:23:45.466374+0000","last_active":"2023-09-29T23:24:36.280617+0000","last_peered":"2023-09-29T23:24:36.280617+0000","last_clean":"2023-09-29T23:24:36.280617+0000","last_became_active":"2023-09-29T23:23:45.466169+0000","last_became_peered":"2023-09-29T23:23:45.466169+0000","last_unstale":"2023-09-29T23:24:36.280617+0000","last_undegraded":"2023-09-29T23:24:36.280617+0000","last_fullsized":"2023-09-29T23:24:36.280617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"16'8","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278024+0000","last_change":"2023-09-29T23:23:45.091762+0000","last_active":"2023-09-29T23:24:36.278024+0000","last_peered":"2023-09-29T23:24:36.278024+0000","last_clean":"2023-09-29T23:24:36.278024+0000","last_became_active":"2023-09-29T23:23:45.091386+0000","last_became_peered":"2023-09-29T23:23:45.091386+0000","last_unstale":"2023-09-29T23:24:36.278024+0000","last_undegraded":"2023-09-29T23:24:36.278024+0000","last_fullsized":"2023-09-29T23:24:36.278024+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278185+0000","last_change":"2023-09-29T23:23:45.461421+0000","last_active":"2023-09-29T23:24:36.278185+0000","last_peered":"2023-09-29T23:24:36.278185+0000","last_clean":"2023-09-29T23:24:36.278185+0000","last_became_active":"2023-09-29T23:23:45.460643+0000","last_became_peered":"2023-09-29T23:23:45.460643+0000","last_unstale":"2023-09-29T23:24:36.278185+0000","last_undegraded":"2023-09-29T23:24:36.278185+0000","last_fullsized":"2023-09-29T23:24:36.278185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:12:32.105911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284002+0000","last_change":"2023-09-29T23:23:45.078091+0000","last_active":"2023-09-29T23:24:36.284002+0000","last_peered":"2023-09-29T23:24:36.284002+0000","last_clean":"2023-09-29T23:24:36.284002+0000","last_became_active":"2023-09-29T23:23:45.077734+0000","last_became_peered":"2023-09-29T23:23:45.077734+0000","last_unstale":"2023-09-29T23:24:36.284002+0000","last_undegraded":"2023-09-29T23:24:36.284002+0000","last_fullsized":"2023-09-29T23:24:36.284002+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:53.097532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278792+0000","last_change":"2023-09-29T23:23:45.467950+0000","last_active":"2023-09-29T23:24:36.278792+0000","last_peered":"2023-09-29T23:24:36.278792+0000","last_clean":"2023-09-29T23:24:36.278792+0000","last_became_active":"2023-09-29T23:23:45.467555+0000","last_became_peered":"2023-09-29T23:23:45.467555+0000","last_unstale":"2023-09-29T23:24:36.278792+0000","last_undegraded":"2023-09-29T23:24:36.278792+0000","last_fullsized":"2023-09-29T23:24:36.278792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:32:10.504594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278873+0000","last_change":"2023-09-29T23:23:45.092471+0000","last_active":"2023-09-29T23:24:36.278873+0000","last_peered":"2023-09-29T23:24:36.278873+0000","last_clean":"2023-09-29T23:24:36.278873+0000","last_became_active":"2023-09-29T23:23:45.092185+0000","last_became_peered":"2023-09-29T23:23:45.092185+0000","last_unstale":"2023-09-29T23:24:36.278873+0000","last_undegraded":"2023-09-29T23:24:36.278873+0000","last_fullsized":"2023-09-29T23:24:36.278873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:47:59.150464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284089+0000","last_change":"2023-09-29T23:23:45.464504+0000","last_active":"2023-09-29T23:24:36.284089+0000","last_peered":"2023-09-29T23:24:36.284089+0000","last_clean":"2023-09-29T23:24:36.284089+0000","last_became_active":"2023-09-29T23:23:45.463806+0000","last_became_peered":"2023-09-29T23:23:45.463806+0000","last_unstale":"2023-09-29T23:24:36.284089+0000","last_undegraded":"2023-09-29T23:24:36.284089+0000","last_fullsized":"2023-09-29T23:24:36.284089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:25:25.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281453+0000","last_change":"2023-09-29T23:23:45.088776+0000","last_active":"2023-09-29T23:24:36.281453+0000","last_peered":"2023-09-29T23:24:36.281453+0000","last_clean":"2023-09-29T23:24:36.281453+0000","last_became_active":"2023-09-29T23:23:45.088535+0000","last_became_peered":"2023-09-29T23:23:45.088535+0000","last_unstale":"2023-09-29T23:24:36.281453+0000","last_undegraded":"2023-09-29T23:24:36.281453+0000","last_fullsized":"2023-09-29T23:24:36.281453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:35:07.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283419+0000","last_change":"2023-09-29T23:23:45.466379+0000","last_active":"2023-09-29T23:24:36.283419+0000","last_peered":"2023-09-29T23:24:36.283419+0000","last_clean":"2023-09-29T23:24:36.283419+0000","last_became_active":"2023-09-29T23:23:45.465855+0000","last_became_peered":"2023-09-29T23:23:45.465855+0000","last_unstale":"2023-09-29T23:24:36.283419+0000","last_undegraded":"2023-09-29T23:24:36.283419+0000","last_fullsized":"2023-09-29T23:24:36.283419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:06.275738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278346+0000","last_change":"2023-09-29T23:23:45.092714+0000","last_active":"2023-09-29T23:24:36.278346+0000","last_peered":"2023-09-29T23:24:36.278346+0000","last_clean":"2023-09-29T23:24:36.278346+0000","last_became_active":"2023-09-29T23:23:45.092476+0000","last_became_peered":"2023-09-29T23:23:45.092476+0000","last_unstale":"2023-09-29T23:24:36.278346+0000","last_undegraded":"2023-09-29T23:24:36.278346+0000","last_fullsized":"2023-09-29T23:24:36.278346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:20:23.267433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281616+0000","last_change":"2023-09-29T23:23:45.467010+0000","last_active":"2023-09-29T23:24:36.281616+0000","last_peered":"2023-09-29T23:24:36.281616+0000","last_clean":"2023-09-29T23:24:36.281616+0000","last_became_active":"2023-09-29T23:23:45.466694+0000","last_became_peered":"2023-09-29T23:23:45.466694+0000","last_unstale":"2023-09-29T23:24:36.281616+0000","last_undegraded":"2023-09-29T23:24:36.281616+0000","last_fullsized":"2023-09-29T23:24:36.281616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:03:39.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283738+0000","last_change":"2023-09-29T23:23:45.089622+0000","last_active":"2023-09-29T23:24:36.283738+0000","last_peered":"2023-09-29T23:24:36.283738+0000","last_clean":"2023-09-29T23:24:36.283738+0000","last_became_active":"2023-09-29T23:23:45.089176+0000","last_became_peered":"2023-09-29T23:23:45.089176+0000","last_unstale":"2023-09-29T23:24:36.283738+0000","last_undegraded":"2023-09-29T23:24:36.283738+0000","last_fullsized":"2023-09-29T23:24:36.283738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:42.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283257+0000","last_change":"2023-09-29T23:23:45.465798+0000","last_active":"2023-09-29T23:24:36.283257+0000","last_peered":"2023-09-29T23:24:36.283257+0000","last_clean":"2023-09-29T23:24:36.283257+0000","last_became_active":"2023-09-29T23:23:45.465127+0000","last_became_peered":"2023-09-29T23:23:45.465127+0000","last_unstale":"2023-09-29T23:24:36.283257+0000","last_undegraded":"2023-09-29T23:24:36.283257+0000","last_fullsized":"2023-09-29T23:24:36.283257+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:33.901646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281240+0000","last_change":"2023-09-29T23:23:45.075630+0000","last_active":"2023-09-29T23:24:36.281240+0000","last_peered":"2023-09-29T23:24:36.281240+0000","last_clean":"2023-09-29T23:24:36.281240+0000","last_became_active":"2023-09-29T23:23:45.075313+0000","last_became_peered":"2023-09-29T23:23:45.075313+0000","last_unstale":"2023-09-29T23:24:36.281240+0000","last_undegraded":"2023-09-29T23:24:36.281240+0000","last_fullsized":"2023-09-29T23:24:36.281240+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:59:03.439349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.288465+0000","last_change":"2023-09-29T23:24:37.288465+0000","last_active":"2023-09-29T23:24:37.288465+0000","last_peered":"2023-09-29T23:24:37.288465+0000","last_clean":"2023-09-29T23:24:37.288465+0000","last_became_active":"2023-09-29T23:24:37.288220+0000","last_became_peered":"2023-09-29T23:24:37.288220+0000","last_unstale":"2023-09-29T23:24:37.288465+0000","last_undegraded":"2023-09-29T23:24:37.288465+0000","last_fullsized":"2023-09-29T23:24:37.288465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:13:03.586738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280872+0000","last_change":"2023-09-29T23:23:45.075998+0000","last_active":"2023-09-29T23:24:36.280872+0000","last_peered":"2023-09-29T23:24:36.280872+0000","last_clean":"2023-09-29T23:24:36.280872+0000","last_became_active":"2023-09-29T23:23:45.075772+0000","last_became_peered":"2023-09-29T23:23:45.075772+0000","last_unstale":"2023-09-29T23:24:36.280872+0000","last_undegraded":"2023-09-29T23:24:36.280872+0000","last_fullsized":"2023-09-29T23:24:36.280872+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:12:24.809572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277847+0000","last_change":"2023-09-29T23:23:45.463124+0000","last_active":"2023-09-29T23:24:36.277847+0000","last_peered":"2023-09-29T23:24:36.277847+0000","last_clean":"2023-09-29T23:24:36.277847+0000","last_became_active":"2023-09-29T23:23:45.462583+0000","last_became_peered":"2023-09-29T23:23:45.462583+0000","last_unstale":"2023-09-29T23:24:36.277847+0000","last_undegraded":"2023-09-29T23:24:36.277847+0000","last_fullsized":"2023-09-29T23:24:36.277847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:01:57.571277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282321+0000","last_change":"2023-09-29T23:23:45.088750+0000","last_active":"2023-09-29T23:24:36.282321+0000","last_peered":"2023-09-29T23:24:36.282321+0000","last_clean":"2023-09-29T23:24:36.282321+0000","last_became_active":"2023-09-29T23:23:45.088506+0000","last_became_peered":"2023-09-29T23:23:45.088506+0000","last_unstale":"2023-09-29T23:24:36.282321+0000","last_undegraded":"2023-09-29T23:24:36.282321+0000","last_fullsized":"2023-09-29T23:24:36.282321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:04.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283202+0000","last_change":"2023-09-29T23:23:45.477617+0000","last_active":"2023-09-29T23:24:36.283202+0000","last_peered":"2023-09-29T23:24:36.283202+0000","last_clean":"2023-09-29T23:24:36.283202+0000","last_became_active":"2023-09-29T23:23:45.477335+0000","last_became_peered":"2023-09-29T23:23:45.477335+0000","last_unstale":"2023-09-29T23:24:36.283202+0000","last_undegraded":"2023-09-29T23:24:36.283202+0000","last_fullsized":"2023-09-29T23:24:36.283202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:44:09.599636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278631+0000","last_change":"2023-09-29T23:23:41.047954+0000","last_active":"2023-09-29T23:24:36.278631+0000","last_peered":"2023-09-29T23:24:36.278631+0000","last_clean":"2023-09-29T23:24:36.278631+0000","last_became_active":"2023-09-29T23:23:41.047701+0000","last_became_peered":"2023-09-29T23:23:41.047701+0000","last_unstale":"2023-09-29T23:24:36.278631+0000","last_undegraded":"2023-09-29T23:24:36.278631+0000","last_fullsized":"2023-09-29T23:24:36.278631+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:08:35.252580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"17'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282609+0000","last_change":"2023-09-29T23:23:45.075607+0000","last_active":"2023-09-29T23:24:36.282609+0000","last_peered":"2023-09-29T23:24:36.282609+0000","last_clean":"2023-09-29T23:24:36.282609+0000","last_became_active":"2023-09-29T23:23:45.075249+0000","last_became_peered":"2023-09-29T23:23:45.075249+0000","last_unstale":"2023-09-29T23:24:36.282609+0000","last_undegraded":"2023-09-29T23:24:36.282609+0000","last_fullsized":"2023-09-29T23:24:36.282609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:55:12.692421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278637+0000","last_change":"2023-09-29T23:23:45.460164+0000","last_active":"2023-09-29T23:24:36.278637+0000","last_peered":"2023-09-29T23:24:36.278637+0000","last_clean":"2023-09-29T23:24:36.278637+0000","last_became_active":"2023-09-29T23:23:45.459933+0000","last_became_peered":"2023-09-29T23:23:45.459933+0000","last_unstale":"2023-09-29T23:24:36.278637+0000","last_undegraded":"2023-09-29T23:24:36.278637+0000","last_fullsized":"2023-09-29T23:24:36.278637+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:25:22.017530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281404+0000","last_change":"2023-09-29T23:23:41.051640+0000","last_active":"2023-09-29T23:24:36.281404+0000","last_peered":"2023-09-29T23:24:36.281404+0000","last_clean":"2023-09-29T23:24:36.281404+0000","last_became_active":"2023-09-29T23:23:41.051398+0000","last_became_peered":"2023-09-29T23:23:41.051398+0000","last_unstale":"2023-09-29T23:24:36.281404+0000","last_undegraded":"2023-09-29T23:24:36.281404+0000","last_fullsized":"2023-09-29T23:24:36.281404+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:49:47.548120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281939+0000","last_change":"2023-09-29T23:23:45.076540+0000","last_active":"2023-09-29T23:24:36.281939+0000","last_peered":"2023-09-29T23:24:36.281939+0000","last_clean":"2023-09-29T23:24:36.281939+0000","last_became_active":"2023-09-29T23:23:45.076293+0000","last_became_peered":"2023-09-29T23:23:45.076293+0000","last_unstale":"2023-09-29T23:24:36.281939+0000","last_undegraded":"2023-09-29T23:24:36.281939+0000","last_fullsized":"2023-09-29T23:24:36.281939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:09.131795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283955+0000","last_change":"2023-09-29T23:23:45.466336+0000","last_active":"2023-09-29T23:24:36.283955+0000","last_peered":"2023-09-29T23:24:36.283955+0000","last_clean":"2023-09-29T23:24:36.283955+0000","last_became_active":"2023-09-29T23:23:45.466115+0000","last_became_peered":"2023-09-29T23:23:45.466115+0000","last_unstale":"2023-09-29T23:24:36.283955+0000","last_undegraded":"2023-09-29T23:24:36.283955+0000","last_fullsized":"2023-09-29T23:24:36.283955+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:14:11.211646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281143+0000","last_change":"2023-09-29T23:23:41.050066+0000","last_active":"2023-09-29T23:24:36.281143+0000","last_peered":"2023-09-29T23:24:36.281143+0000","last_clean":"2023-09-29T23:24:36.281143+0000","last_became_active":"2023-09-29T23:23:41.049786+0000","last_became_peered":"2023-09-29T23:23:41.049786+0000","last_unstale":"2023-09-29T23:24:36.281143+0000","last_undegraded":"2023-09-29T23:24:36.281143+0000","last_fullsized":"2023-09-29T23:24:36.281143+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:22:54.699446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277892+0000","last_change":"2023-09-29T23:23:45.091590+0000","last_active":"2023-09-29T23:24:36.277892+0000","last_peered":"2023-09-29T23:24:36.277892+0000","last_clean":"2023-09-29T23:24:36.277892+0000","last_became_active":"2023-09-29T23:23:45.091162+0000","last_became_peered":"2023-09-29T23:23:45.091162+0000","last_unstale":"2023-09-29T23:24:36.277892+0000","last_undegraded":"2023-09-29T23:24:36.277892+0000","last_fullsized":"2023-09-29T23:24:36.277892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:29:38.240697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283194+0000","last_change":"2023-09-29T23:23:45.474238+0000","last_active":"2023-09-29T23:24:36.283194+0000","last_peered":"2023-09-29T23:24:36.283194+0000","last_clean":"2023-09-29T23:24:36.283194+0000","last_became_active":"2023-09-29T23:23:45.473861+0000","last_became_peered":"2023-09-29T23:23:45.473861+0000","last_unstale":"2023-09-29T23:24:36.283194+0000","last_undegraded":"2023-09-29T23:24:36.283194+0000","last_fullsized":"2023-09-29T23:24:36.283194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:39:43.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283014+0000","last_change":"2023-09-29T23:23:41.049685+0000","last_active":"2023-09-29T23:24:36.283014+0000","last_peered":"2023-09-29T23:24:36.283014+0000","last_clean":"2023-09-29T23:24:36.283014+0000","last_became_active":"2023-09-29T23:23:41.049442+0000","last_became_peered":"2023-09-29T23:23:41.049442+0000","last_unstale":"2023-09-29T23:24:36.283014+0000","last_undegraded":"2023-09-29T23:24:36.283014+0000","last_fullsized":"2023-09-29T23:24:36.283014+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:52:33.065724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.277891+0000","last_change":"2023-09-29T23:23:45.092293+0000","last_active":"2023-09-29T23:24:36.277891+0000","last_peered":"2023-09-29T23:24:36.277891+0000","last_clean":"2023-09-29T23:24:36.277891+0000","last_became_active":"2023-09-29T23:23:45.092042+0000","last_became_peered":"2023-09-29T23:23:45.092042+0000","last_unstale":"2023-09-29T23:24:36.277891+0000","last_undegraded":"2023-09-29T23:24:36.277891+0000","last_fullsized":"2023-09-29T23:24:36.277891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:07:16.838088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280566+0000","last_change":"2023-09-29T23:23:45.461917+0000","last_active":"2023-09-29T23:24:36.280566+0000","last_peered":"2023-09-29T23:24:36.280566+0000","last_clean":"2023-09-29T23:24:36.280566+0000","last_became_active":"2023-09-29T23:23:45.461228+0000","last_became_peered":"2023-09-29T23:23:45.461228+0000","last_unstale":"2023-09-29T23:24:36.280566+0000","last_undegraded":"2023-09-29T23:24:36.280566+0000","last_fullsized":"2023-09-29T23:24:36.280566+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:54:19.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.280520+0000","last_change":"2023-09-29T23:23:41.051041+0000","last_active":"2023-09-29T23:24:36.280520+0000","last_peered":"2023-09-29T23:24:36.280520+0000","last_clean":"2023-09-29T23:24:36.280520+0000","last_became_active":"2023-09-29T23:23:41.050731+0000","last_became_peered":"2023-09-29T23:23:41.050731+0000","last_unstale":"2023-09-29T23:24:36.280520+0000","last_undegraded":"2023-09-29T23:24:36.280520+0000","last_fullsized":"2023-09-29T23:24:36.280520+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:17:20.303147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281103+0000","last_change":"2023-09-29T23:23:45.088759+0000","last_active":"2023-09-29T23:24:36.281103+0000","last_peered":"2023-09-29T23:24:36.281103+0000","last_clean":"2023-09-29T23:24:36.281103+0000","last_became_active":"2023-09-29T23:23:45.088510+0000","last_became_peered":"2023-09-29T23:23:45.088510+0000","last_unstale":"2023-09-29T23:24:36.281103+0000","last_undegraded":"2023-09-29T23:24:36.281103+0000","last_fullsized":"2023-09-29T23:24:36.281103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:27:56.918672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281062+0000","last_change":"2023-09-29T23:23:45.472092+0000","last_active":"2023-09-29T23:24:36.281062+0000","last_peered":"2023-09-29T23:24:36.281062+0000","last_clean":"2023-09-29T23:24:36.281062+0000","last_became_active":"2023-09-29T23:23:45.461672+0000","last_became_peered":"2023-09-29T23:23:45.461672+0000","last_unstale":"2023-09-29T23:24:36.281062+0000","last_undegraded":"2023-09-29T23:24:36.281062+0000","last_fullsized":"2023-09-29T23:24:36.281062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:58:16.565151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278081+0000","last_change":"2023-09-29T23:23:41.047062+0000","last_active":"2023-09-29T23:24:36.278081+0000","last_peered":"2023-09-29T23:24:36.278081+0000","last_clean":"2023-09-29T23:24:36.278081+0000","last_became_active":"2023-09-29T23:23:41.046803+0000","last_became_peered":"2023-09-29T23:23:41.046803+0000","last_unstale":"2023-09-29T23:24:36.278081+0000","last_undegraded":"2023-09-29T23:24:36.278081+0000","last_fullsized":"2023-09-29T23:24:36.278081+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:22:14.657466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283094+0000","last_change":"2023-09-29T23:23:45.073226+0000","last_active":"2023-09-29T23:24:36.283094+0000","last_peered":"2023-09-29T23:24:36.283094+0000","last_clean":"2023-09-29T23:24:36.283094+0000","last_became_active":"2023-09-29T23:23:45.072973+0000","last_became_peered":"2023-09-29T23:23:45.072973+0000","last_unstale":"2023-09-29T23:24:36.283094+0000","last_undegraded":"2023-09-29T23:24:36.283094+0000","last_fullsized":"2023-09-29T23:24:36.283094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:27:56.918672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283910+0000","last_change":"2023-09-29T23:23:45.477628+0000","last_active":"2023-09-29T23:24:36.283910+0000","last_peered":"2023-09-29T23:24:36.283910+0000","last_clean":"2023-09-29T23:24:36.283910+0000","last_became_active":"2023-09-29T23:23:45.474318+0000","last_became_peered":"2023-09-29T23:23:45.474318+0000","last_unstale":"2023-09-29T23:24:36.283910+0000","last_undegraded":"2023-09-29T23:24:36.283910+0000","last_fullsized":"2023-09-29T23:24:36.283910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:46:02.634499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282673+0000","last_change":"2023-09-29T23:23:41.050883+0000","last_active":"2023-09-29T23:24:36.282673+0000","last_peered":"2023-09-29T23:24:36.282673+0000","last_clean":"2023-09-29T23:24:36.282673+0000","last_became_active":"2023-09-29T23:23:41.050639+0000","last_became_peered":"2023-09-29T23:23:41.050639+0000","last_unstale":"2023-09-29T23:24:36.282673+0000","last_undegraded":"2023-09-29T23:24:36.282673+0000","last_fullsized":"2023-09-29T23:24:36.282673+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:35:26.897753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281455+0000","last_change":"2023-09-29T23:23:45.077040+0000","last_active":"2023-09-29T23:24:36.281455+0000","last_peered":"2023-09-29T23:24:36.281455+0000","last_clean":"2023-09-29T23:24:36.281455+0000","last_became_active":"2023-09-29T23:23:45.076806+0000","last_became_peered":"2023-09-29T23:23:45.076806+0000","last_unstale":"2023-09-29T23:24:36.281455+0000","last_undegraded":"2023-09-29T23:24:36.281455+0000","last_fullsized":"2023-09-29T23:24:36.281455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:26:19.661567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281570+0000","last_change":"2023-09-29T23:23:45.462067+0000","last_active":"2023-09-29T23:24:36.281570+0000","last_peered":"2023-09-29T23:24:36.281570+0000","last_clean":"2023-09-29T23:24:36.281570+0000","last_became_active":"2023-09-29T23:23:45.460913+0000","last_became_peered":"2023-09-29T23:23:45.460913+0000","last_unstale":"2023-09-29T23:24:36.281570+0000","last_undegraded":"2023-09-29T23:24:36.281570+0000","last_fullsized":"2023-09-29T23:24:36.281570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:14:06.275738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.282020+0000","last_change":"2023-09-29T23:23:41.050074+0000","last_active":"2023-09-29T23:24:36.282020+0000","last_peered":"2023-09-29T23:24:36.282020+0000","last_clean":"2023-09-29T23:24:36.282020+0000","last_became_active":"2023-09-29T23:23:41.049783+0000","last_became_peered":"2023-09-29T23:23:41.049783+0000","last_unstale":"2023-09-29T23:24:36.282020+0000","last_undegraded":"2023-09-29T23:24:36.282020+0000","last_fullsized":"2023-09-29T23:24:36.282020+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:37:01.405113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281488+0000","last_change":"2023-09-29T23:23:45.076087+0000","last_active":"2023-09-29T23:24:36.281488+0000","last_peered":"2023-09-29T23:24:36.281488+0000","last_clean":"2023-09-29T23:24:36.281488+0000","last_became_active":"2023-09-29T23:23:45.075273+0000","last_became_peered":"2023-09-29T23:23:45.075273+0000","last_unstale":"2023-09-29T23:24:36.281488+0000","last_undegraded":"2023-09-29T23:24:36.281488+0000","last_fullsized":"2023-09-29T23:24:36.281488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:54:27.356997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278693+0000","last_change":"2023-09-29T23:23:45.459071+0000","last_active":"2023-09-29T23:24:36.278693+0000","last_peered":"2023-09-29T23:24:36.278693+0000","last_clean":"2023-09-29T23:24:36.278693+0000","last_became_active":"2023-09-29T23:23:45.458250+0000","last_became_peered":"2023-09-29T23:23:45.458250+0000","last_unstale":"2023-09-29T23:24:36.278693+0000","last_undegraded":"2023-09-29T23:24:36.278693+0000","last_fullsized":"2023-09-29T23:24:36.278693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:13:21.349787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"16'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283297+0000","last_change":"2023-09-29T23:23:45.076932+0000","last_active":"2023-09-29T23:24:36.283297+0000","last_peered":"2023-09-29T23:24:36.283297+0000","last_clean":"2023-09-29T23:24:36.283297+0000","last_became_active":"2023-09-29T23:23:45.076638+0000","last_became_peered":"2023-09-29T23:23:45.076638+0000","last_unstale":"2023-09-29T23:24:36.283297+0000","last_undegraded":"2023-09-29T23:24:36.283297+0000","last_fullsized":"2023-09-29T23:24:36.283297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:35:07.825057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278736+0000","last_change":"2023-09-29T23:23:45.471332+0000","last_active":"2023-09-29T23:24:36.278736+0000","last_peered":"2023-09-29T23:24:36.278736+0000","last_clean":"2023-09-29T23:24:36.278736+0000","last_became_active":"2023-09-29T23:23:45.471013+0000","last_became_peered":"2023-09-29T23:23:45.471013+0000","last_unstale":"2023-09-29T23:24:36.278736+0000","last_undegraded":"2023-09-29T23:24:36.278736+0000","last_fullsized":"2023-09-29T23:24:36.278736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:18:16.258901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"16'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.295660+0000","last_change":"2023-09-29T23:24:37.295660+0000","last_active":"2023-09-29T23:24:37.295660+0000","last_peered":"2023-09-29T23:24:37.295660+0000","last_clean":"2023-09-29T23:24:37.295660+0000","last_became_active":"2023-09-29T23:24:37.292123+0000","last_became_peered":"2023-09-29T23:24:37.292123+0000","last_unstale":"2023-09-29T23:24:37.295660+0000","last_undegraded":"2023-09-29T23:24:37.295660+0000","last_fullsized":"2023-09-29T23:24:37.295660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:31:58.939763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281307+0000","last_change":"2023-09-29T23:23:45.471929+0000","last_active":"2023-09-29T23:24:36.281307+0000","last_peered":"2023-09-29T23:24:36.281307+0000","last_clean":"2023-09-29T23:24:36.281307+0000","last_became_active":"2023-09-29T23:23:45.471673+0000","last_became_peered":"2023-09-29T23:23:45.471673+0000","last_unstale":"2023-09-29T23:24:36.281307+0000","last_undegraded":"2023-09-29T23:24:36.281307+0000","last_fullsized":"2023-09-29T23:24:36.281307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:50:06.119952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278632+0000","last_change":"2023-09-29T23:23:45.092434+0000","last_active":"2023-09-29T23:24:36.278632+0000","last_peered":"2023-09-29T23:24:36.278632+0000","last_clean":"2023-09-29T23:24:36.278632+0000","last_became_active":"2023-09-29T23:23:45.092203+0000","last_became_peered":"2023-09-29T23:23:45.092203+0000","last_unstale":"2023-09-29T23:24:36.278632+0000","last_undegraded":"2023-09-29T23:24:36.278632+0000","last_fullsized":"2023-09-29T23:24:36.278632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284145+0000","last_change":"2023-09-29T23:23:45.464734+0000","last_active":"2023-09-29T23:24:36.284145+0000","last_peered":"2023-09-29T23:24:36.284145+0000","last_clean":"2023-09-29T23:24:36.284145+0000","last_became_active":"2023-09-29T23:23:45.464202+0000","last_became_peered":"2023-09-29T23:23:45.464202+0000","last_unstale":"2023-09-29T23:24:36.284145+0000","last_undegraded":"2023-09-29T23:24:36.284145+0000","last_fullsized":"2023-09-29T23:24:36.284145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:59:25.888959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1f","version":"16'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.284086+0000","last_change":"2023-09-29T23:23:45.074017+0000","last_active":"2023-09-29T23:24:36.284086+0000","last_peered":"2023-09-29T23:24:36.284086+0000","last_clean":"2023-09-29T23:24:36.284086+0000","last_became_active":"2023-09-29T23:23:45.073772+0000","last_became_peered":"2023-09-29T23:23:45.073772+0000","last_unstale":"2023-09-29T23:24:36.284086+0000","last_undegraded":"2023-09-29T23:24:36.284086+0000","last_fullsized":"2023-09-29T23:24:36.284086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:05:48.094963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278944+0000","last_change":"2023-09-29T23:23:45.460786+0000","last_active":"2023-09-29T23:24:36.278944+0000","last_peered":"2023-09-29T23:24:36.278944+0000","last_clean":"2023-09-29T23:24:36.278944+0000","last_became_active":"2023-09-29T23:23:45.460548+0000","last_became_peered":"2023-09-29T23:23:45.460548+0000","last_unstale":"2023-09-29T23:24:36.278944+0000","last_undegraded":"2023-09-29T23:24:36.278944+0000","last_fullsized":"2023-09-29T23:24:36.278944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:09:25.160546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278067+0000","last_change":"2023-09-29T23:23:45.471512+0000","last_active":"2023-09-29T23:24:36.278067+0000","last_peered":"2023-09-29T23:24:36.278067+0000","last_clean":"2023-09-29T23:24:36.278067+0000","last_became_active":"2023-09-29T23:23:45.471294+0000","last_became_peered":"2023-09-29T23:23:45.471294+0000","last_unstale":"2023-09-29T23:24:36.278067+0000","last_undegraded":"2023-09-29T23:24:36.278067+0000","last_fullsized":"2023-09-29T23:24:36.278067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:29:14.066786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.278131+0000","last_change":"2023-09-29T23:23:45.462314+0000","last_active":"2023-09-29T23:24:36.278131+0000","last_peered":"2023-09-29T23:24:36.278131+0000","last_clean":"2023-09-29T23:24:36.278131+0000","last_became_active":"2023-09-29T23:23:45.461188+0000","last_became_peered":"2023-09-29T23:23:45.461188+0000","last_unstale":"2023-09-29T23:24:36.278131+0000","last_undegraded":"2023-09-29T23:24:36.278131+0000","last_fullsized":"2023-09-29T23:24:36.278131+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:01:06.913634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283328+0000","last_change":"2023-09-29T23:23:45.473685+0000","last_active":"2023-09-29T23:24:36.283328+0000","last_peered":"2023-09-29T23:24:36.283328+0000","last_clean":"2023-09-29T23:24:36.283328+0000","last_became_active":"2023-09-29T23:23:45.473438+0000","last_became_peered":"2023-09-29T23:23:45.473438+0000","last_unstale":"2023-09-29T23:24:36.283328+0000","last_undegraded":"2023-09-29T23:24:36.283328+0000","last_fullsized":"2023-09-29T23:24:36.283328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:39:59.923188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283991+0000","last_change":"2023-09-29T23:23:45.477880+0000","last_active":"2023-09-29T23:24:36.283991+0000","last_peered":"2023-09-29T23:24:36.283991+0000","last_clean":"2023-09-29T23:24:36.283991+0000","last_became_active":"2023-09-29T23:23:45.474163+0000","last_became_peered":"2023-09-29T23:23:45.474163+0000","last_unstale":"2023-09-29T23:24:36.283991+0000","last_undegraded":"2023-09-29T23:24:36.283991+0000","last_fullsized":"2023-09-29T23:24:36.283991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:40:09.175714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.283486+0000","last_change":"2023-09-29T23:23:45.473292+0000","last_active":"2023-09-29T23:24:36.283486+0000","last_peered":"2023-09-29T23:24:36.283486+0000","last_clean":"2023-09-29T23:24:36.283486+0000","last_became_active":"2023-09-29T23:23:45.473063+0000","last_became_peered":"2023-09-29T23:23:45.473063+0000","last_unstale":"2023-09-29T23:24:36.283486+0000","last_undegraded":"2023-09-29T23:24:36.283486+0000","last_fullsized":"2023-09-29T23:24:36.283486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:06:47.738713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-29T23:24:36.281692+0000","last_change":"2023-09-29T23:23:45.463712+0000","last_active":"2023-09-29T23:24:36.281692+0000","last_peered":"2023-09-29T23:24:36.281692+0000","last_clean":"2023-09-29T23:24:36.281692+0000","last_became_active":"2023-09-29T23:23:45.463269+0000","last_became_peered":"2023-09-29T23:23:45.463269+0000","last_unstale":"2023-09-29T23:24:36.281692+0000","last_undegraded":"2023-09-29T23:24:36.281692+0000","last_fullsized":"2023-09-29T23:24:36.281692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:32.643729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705731,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5572,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852028,"statfs":{"total":107374182400,"available":107368476672,"internally_reserved":0,"allocated":192512,"data_stored":54287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 29 23:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.27600000000000002},"min":{"1min":0.191,"5min":0.14499999999999999,"15min":0.14499999999999999},"max":{"1min":0.39800000000000002,"5min":0.435,"15min":0.435},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.29099999999999998,"15min":0.27400000000000002},"min":{"1min":0.20100000000000001,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.42799999999999999,"5min":0.437,"15min":0.437},"last":0.25600000000000001}]},{"osd":2,"last update":"Fri Sep 29 23:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.29599999999999999,"15min":0.27800000000000002},"min":{"1min":0.216,"5min":0.186,"15min":0.186},"max":{"1min":0.42599999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.223},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.309,"15min":0.29299999999999998},"min":{"1min":0.20899999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.45100000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.27800000000000002}]}]},{"osd":2,"up_from":8,"seq":34359738435,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5500,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":104852100,"statfs":{"total":107374182400,"available":107368550400,"internally_reserved":0,"allocated":184320,"data_stored":53655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 29 23:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.28299999999999997,"15min":0.28899999999999998},"min":{"1min":0.19700000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.218},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.29099999999999998,"15min":0.29699999999999999},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.433,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.24399999999999999}]},{"osd":1,"last update":"Fri Sep 29 23:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.21199999999999999,"5min":0.189,"15min":0.189},"max":{"1min":0.46200000000000002,"5min":0.498,"15min":0.498},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.307,"5min":0.313,"15min":0.317},"min":{"1min":0.23499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48099999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.25600000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5624,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":104851976,"statfs":{"total":107374182400,"available":107368423424,"internally_reserved":0,"allocated":180224,"data_stored":52715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 29 23:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.27800000000000002,"15min":0.28399999999999997},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.39900000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.315},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.28199999999999997,"15min":0.27000000000000002},"min":{"1min":0.221,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.41599999999999998,"5min":0.44,"15min":0.44},"last":0.27300000000000002}]},{"osd":2,"last update":"Fri Sep 29 23:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.28100000000000003,"5min":0.28699999999999998,"15min":0.26900000000000002},"min":{"1min":0.22,"5min":0.191,"15min":0.191},"max":{"1min":0.438,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.29099999999999998,"5min":0.29799999999999999,"15min":0.28799999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.45300000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-29T23:29:02.867 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.867 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.867 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.867 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.867 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.867 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.868 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.868 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.868 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.868 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.868 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.868 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.868 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.868 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.869 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.869 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.869 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.869 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.869 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.869 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.869 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.869 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.869 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.870 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.870 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.870 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.870 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.870 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.870 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.870 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.870 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.871 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.871 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.871 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.871 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.871 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.871 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.871 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.871 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.872 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.872 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.872 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.872 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.872 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.872 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.872 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.872 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.872 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.873 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.873 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.873 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.873 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.873 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.873 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.873 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.874 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.874 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.874 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.874 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.874 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.874 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.875 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.875 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.875 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.875 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.875 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.875 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.875 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.875 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.876 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.876 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.876 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.876 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.876 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.876 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.876 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.877 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.877 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.877 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.877 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.877 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.877 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.877 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.877 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.878 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.878 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.878 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.878 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.878 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.878 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.878 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.878 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.879 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.879 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.879 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.879 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.879 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.879 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.879 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.879 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.880 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.880 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.880 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.880 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:02.880 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-29T23:29:22.881 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:29:23.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.000+0000 7f5a411ce700 1 Processor -- start 2023-09-29T23:29:23.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.000+0000 7f5a411ce700 1 -- start start 2023-09-29T23:29:23.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.000+0000 7f5a411ce700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5a3c12c8b0 0x7f5a3c134400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:23.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.000+0000 7f5a411ce700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3c0685e0 con 0x7f5a3c067eb0 2023-09-29T23:29:23.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.000+0000 7f5a411ce700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3c068280 con 0x7f5a3c12c8b0 2023-09-29T23:29:23.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.000+0000 7f5a3b7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5a3c12c8b0 0x7f5a3c134400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:23.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.000+0000 7f5a3bfff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f5a3c067eb0 0x7f5a3c12c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:56530/0 (socket says 172.21.15.92:56530) 2023-09-29T23:29:23.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.000+0000 7f5a3bfff700 1 -- 172.21.15.92:0/3937815 learned_addr learned my addr 172.21.15.92:0/3937815 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:29:23.002 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.001+0000 7f5a3b7fe700 1 -- 172.21.15.92:0/3937815 >> v1:172.21.15.92:6789/0 conn(0x7f5a3c067eb0 legacy=0x7f5a3c12c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:23.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.001+0000 7f5a3b7fe700 1 -- 172.21.15.92:0/3937815 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c12cce0 con 0x7f5a3c12c8b0 2023-09-29T23:29:23.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.001+0000 7f5a3b7fe700 1 --2- 172.21.15.92:0/3937815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a3c12c8b0 0x7f5a3c134400 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009860 tx=0x7f5a300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9fc59fa8517645 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:23.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.001+0000 7f5a3affd700 1 -- 172.21.15.92:0/3937815 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a3000b680 con 0x7f5a3c12c8b0 2023-09-29T23:29:23.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.001+0000 7f5a3affd700 1 -- 172.21.15.92:0/3937815 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3000b7e0 con 0x7f5a3c12c8b0 2023-09-29T23:29:23.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.001+0000 7f5a3affd700 1 -- 172.21.15.92:0/3937815 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a3000bad0 con 0x7f5a3c12c8b0 2023-09-29T23:29:23.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.001+0000 7f5a411ce700 1 -- 172.21.15.92:0/3937815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a3c12c8b0 msgr2=0x7f5a3c134400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:23.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.001+0000 7f5a411ce700 1 --2- 172.21.15.92:0/3937815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a3c12c8b0 0x7f5a3c134400 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009860 tx=0x7f5a300091a0 comp rx=0 tx=0).stop 2023-09-29T23:29:23.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.001+0000 7f5a411ce700 1 -- 172.21.15.92:0/3937815 shutdown_connections 2023-09-29T23:29:23.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.001+0000 7f5a411ce700 1 --2- 172.21.15.92:0/3937815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a3c12c8b0 0x7f5a3c134400 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:23.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.001+0000 7f5a411ce700 1 -- 172.21.15.92:0/3937815 >> 172.21.15.92:0/3937815 conn(0x7f5a3c094df0 msgr2=0x7f5a3c06d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:23.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.001+0000 7f5a411ce700 1 -- 172.21.15.92:0/3937815 shutdown_connections 2023-09-29T23:29:23.003 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.001+0000 7f5a411ce700 1 -- 172.21.15.92:0/3937815 wait complete. 2023-09-29T23:29:23.005 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.002+0000 7f5a411ce700 1 Processor -- start 2023-09-29T23:29:23.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.002+0000 7f5a411ce700 1 -- start start 2023-09-29T23:29:23.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.003+0000 7f5a411ce700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a3c067eb0 0x7f5a3c131f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:23.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.003+0000 7f5a411ce700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c116ae0 con 0x7f5a3c067eb0 2023-09-29T23:29:23.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.003+0000 7f5a3bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a3c067eb0 0x7f5a3c131f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:23.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.003+0000 7f5a3bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a3c067eb0 0x7f5a3c131f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51518/0 (socket says 172.21.15.92:51518) 2023-09-29T23:29:23.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.003+0000 7f5a3bfff700 1 -- 172.21.15.92:0/319868228 learned_addr learned my addr 172.21.15.92:0/319868228 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:29:23.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.003+0000 7f5a3bfff700 1 -- 172.21.15.92:0/319868228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a30009420 con 0x7f5a3c067eb0 2023-09-29T23:29:23.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.003+0000 7f5a3bfff700 1 --2- 172.21.15.92:0/319868228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a3c067eb0 0x7f5a3c131f50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00c460 tx=0x7f5a2c001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:23.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.003+0000 7f5a23fff700 1 -- 172.21.15.92:0/319868228 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a2c005b30 con 0x7f5a3c067eb0 2023-09-29T23:29:23.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.003+0000 7f5a23fff700 1 -- 172.21.15.92:0/319868228 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c005c90 con 0x7f5a3c067eb0 2023-09-29T23:29:23.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.003+0000 7f5a411ce700 1 -- 172.21.15.92:0/319868228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3c1175f0 con 0x7f5a3c067eb0 2023-09-29T23:29:23.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.004+0000 7f5a23fff700 1 -- 172.21.15.92:0/319868228 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a2c0070d0 con 0x7f5a3c067eb0 2023-09-29T23:29:23.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.004+0000 7f5a411ce700 1 -- 172.21.15.92:0/319868228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3c118020 con 0x7f5a3c067eb0 2023-09-29T23:29:23.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.004+0000 7f5a23fff700 1 -- 172.21.15.92:0/319868228 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f5a2c007230 con 0x7f5a3c067eb0 2023-09-29T23:29:23.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.004+0000 7f5a23fff700 1 --2- 172.21.15.92:0/319868228 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5a28035630 0x7f5a28037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:23.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.004+0000 7f5a23fff700 1 -- 172.21.15.92:0/319868228 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f5a2c046850 con 0x7f5a3c067eb0 2023-09-29T23:29:23.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.004+0000 7f5a411ce700 1 -- 172.21.15.92:0/319868228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3c06f7e0 con 0x7f5a3c067eb0 2023-09-29T23:29:23.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.005+0000 7f5a3b7fe700 1 --2- 172.21.15.92:0/319868228 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5a28035630 0x7f5a28037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:23.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.005+0000 7f5a3b7fe700 1 --2- 172.21.15.92:0/319868228 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5a28035630 0x7f5a28037ae0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5a300091e0 tx=0x7f5a30016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:23.009 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.009+0000 7f5a23fff700 1 -- 172.21.15.92:0/319868228 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a2c017020 con 0x7f5a3c067eb0 2023-09-29T23:29:23.188 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.188+0000 7f5a411ce700 1 -- 172.21.15.92:0/319868228 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a3c09f180 con 0x7f5a28035630 2023-09-29T23:29:23.195 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.195+0000 7f5a23fff700 1 -- 172.21.15.92:0/319868228 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+262270 (secure 0 0 0) 0x7f5a3c09f180 con 0x7f5a28035630 2023-09-29T23:29:23.198 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:29:23.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.198+0000 7f5a411ce700 1 -- 172.21.15.92:0/319868228 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5a28035630 msgr2=0x7f5a28037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:23.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.198+0000 7f5a411ce700 1 --2- 172.21.15.92:0/319868228 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5a28035630 0x7f5a28037ae0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5a300091e0 tx=0x7f5a30016000 comp rx=0 tx=0).stop 2023-09-29T23:29:23.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.198+0000 7f5a411ce700 1 -- 172.21.15.92:0/319868228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a3c067eb0 msgr2=0x7f5a3c131f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:23.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.198+0000 7f5a411ce700 1 --2- 172.21.15.92:0/319868228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a3c067eb0 0x7f5a3c131f50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00c460 tx=0x7f5a2c001020 comp rx=0 tx=0).stop 2023-09-29T23:29:23.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.198+0000 7f5a411ce700 1 -- 172.21.15.92:0/319868228 shutdown_connections 2023-09-29T23:29:23.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.198+0000 7f5a411ce700 1 --2- 172.21.15.92:0/319868228 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f5a28035630 0x7f5a28037ae0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:23.200 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.198+0000 7f5a411ce700 1 --2- 172.21.15.92:0/319868228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a3c067eb0 0x7f5a3c131f50 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:23.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.198+0000 7f5a411ce700 1 -- 172.21.15.92:0/319868228 >> 172.21.15.92:0/319868228 conn(0x7f5a3c094df0 msgr2=0x7f5a3c12aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:23.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.198+0000 7f5a411ce700 1 -- 172.21.15.92:0/319868228 shutdown_connections 2023-09-29T23:29:23.201 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:23.198+0000 7f5a411ce700 1 -- 172.21.15.92:0/319868228 wait complete. 2023-09-29T23:29:23.201 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-09-29T23:29:23.209 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2023-09-29T23:29:22.113923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":208,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":16696,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":314556104,"statfs":{"total":322122547200,"available":322105450496,"internally_reserved":0,"allocated":557056,"data_stored":160657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003134"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287388+0000","last_change":"2023-09-29T23:23:45.465624+0000","last_active":"2023-09-29T23:24:37.287388+0000","last_peered":"2023-09-29T23:24:37.287388+0000","last_clean":"2023-09-29T23:24:37.287388+0000","last_became_active":"2023-09-29T23:23:45.464271+0000","last_became_peered":"2023-09-29T23:23:45.464271+0000","last_unstale":"2023-09-29T23:24:37.287388+0000","last_undegraded":"2023-09-29T23:24:37.287388+0000","last_fullsized":"2023-09-29T23:24:37.287388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:03.249509+0000","last_change":"2023-09-29T23:29:03.249480+0000","last_active":"2023-09-29T23:29:03.249509+0000","last_peered":"2023-09-29T23:29:03.249509+0000","last_clean":"2023-09-29T23:29:03.249509+0000","last_became_active":"2023-09-29T23:23:45.466338+0000","last_became_peered":"2023-09-29T23:23:45.466338+0000","last_unstale":"2023-09-29T23:29:03.249509+0000","last_undegraded":"2023-09-29T23:29:03.249509+0000","last_fullsized":"2023-09-29T23:29:03.249509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:03.249418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:03.249418+0000","last_clean_scrub_stamp":"2023-09-29T23:29:03.249418+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:59:00.108261+0000","scrub_duration":0.0011124380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287634+0000","last_change":"2023-09-29T23:23:45.477248+0000","last_active":"2023-09-29T23:24:37.287634+0000","last_peered":"2023-09-29T23:24:37.287634+0000","last_clean":"2023-09-29T23:24:37.287634+0000","last_became_active":"2023-09-29T23:23:45.474129+0000","last_became_peered":"2023-09-29T23:23:45.474129+0000","last_unstale":"2023-09-29T23:24:37.287634+0000","last_undegraded":"2023-09-29T23:24:37.287634+0000","last_fullsized":"2023-09-29T23:24:37.287634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:17.855334+0000","last_change":"2023-09-29T23:29:17.855305+0000","last_active":"2023-09-29T23:29:17.855334+0000","last_peered":"2023-09-29T23:29:17.855334+0000","last_clean":"2023-09-29T23:29:17.855334+0000","last_became_active":"2023-09-29T23:23:45.470971+0000","last_became_peered":"2023-09-29T23:23:45.470971+0000","last_unstale":"2023-09-29T23:29:17.855334+0000","last_undegraded":"2023-09-29T23:29:17.855334+0000","last_fullsized":"2023-09-29T23:29:17.855334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:17.855232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:17.855232+0000","last_clean_scrub_stamp":"2023-09-29T23:29:17.855232+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:07:36.954319+0000","scrub_duration":0.0012669980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286897+0000","last_change":"2023-09-29T23:23:45.473831+0000","last_active":"2023-09-29T23:24:37.286897+0000","last_peered":"2023-09-29T23:24:37.286897+0000","last_clean":"2023-09-29T23:24:37.286897+0000","last_became_active":"2023-09-29T23:23:45.473570+0000","last_became_peered":"2023-09-29T23:23:45.473570+0000","last_unstale":"2023-09-29T23:24:37.286897+0000","last_undegraded":"2023-09-29T23:24:37.286897+0000","last_fullsized":"2023-09-29T23:24:37.286897+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:11.848798+0000","last_change":"2023-09-29T23:29:11.848767+0000","last_active":"2023-09-29T23:29:11.848798+0000","last_peered":"2023-09-29T23:29:11.848798+0000","last_clean":"2023-09-29T23:29:11.848798+0000","last_became_active":"2023-09-29T23:23:45.470349+0000","last_became_peered":"2023-09-29T23:23:45.470349+0000","last_unstale":"2023-09-29T23:29:11.848798+0000","last_undegraded":"2023-09-29T23:29:11.848798+0000","last_fullsized":"2023-09-29T23:29:11.848798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:11.848689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:11.848689+0000","last_clean_scrub_stamp":"2023-09-29T23:29:11.848689+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:18:31.778625+0000","scrub_duration":0.001396563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286523+0000","last_change":"2023-09-29T23:23:45.465376+0000","last_active":"2023-09-29T23:24:37.286523+0000","last_peered":"2023-09-29T23:24:37.286523+0000","last_clean":"2023-09-29T23:24:37.286523+0000","last_became_active":"2023-09-29T23:23:45.464893+0000","last_became_peered":"2023-09-29T23:23:45.464893+0000","last_unstale":"2023-09-29T23:24:37.286523+0000","last_undegraded":"2023-09-29T23:24:37.286523+0000","last_fullsized":"2023-09-29T23:24:37.286523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283288+0000","last_change":"2023-09-29T23:23:45.463286+0000","last_active":"2023-09-29T23:24:37.283288+0000","last_peered":"2023-09-29T23:24:37.283288+0000","last_clean":"2023-09-29T23:24:37.283288+0000","last_became_active":"2023-09-29T23:23:45.462888+0000","last_became_peered":"2023-09-29T23:23:45.462888+0000","last_unstale":"2023-09-29T23:24:37.283288+0000","last_undegraded":"2023-09-29T23:24:37.283288+0000","last_fullsized":"2023-09-29T23:24:37.283288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.282063+0000","last_change":"2023-09-29T23:23:45.468860+0000","last_active":"2023-09-29T23:24:37.282063+0000","last_peered":"2023-09-29T23:24:37.282063+0000","last_clean":"2023-09-29T23:24:37.282063+0000","last_became_active":"2023-09-29T23:23:45.468303+0000","last_became_peered":"2023-09-29T23:23:45.468303+0000","last_unstale":"2023-09-29T23:24:37.282063+0000","last_undegraded":"2023-09-29T23:24:37.282063+0000","last_fullsized":"2023-09-29T23:24:37.282063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.292057+0000","last_change":"2023-09-29T23:24:37.285573+0000","last_active":"2023-09-29T23:24:37.292057+0000","last_peered":"2023-09-29T23:24:37.292057+0000","last_clean":"2023-09-29T23:24:37.292057+0000","last_became_active":"2023-09-29T23:24:37.285339+0000","last_became_peered":"2023-09-29T23:24:37.285339+0000","last_unstale":"2023-09-29T23:24:37.292057+0000","last_undegraded":"2023-09-29T23:24:37.292057+0000","last_fullsized":"2023-09-29T23:24:37.292057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287570+0000","last_change":"2023-09-29T23:23:45.467858+0000","last_active":"2023-09-29T23:24:37.287570+0000","last_peered":"2023-09-29T23:24:37.287570+0000","last_clean":"2023-09-29T23:24:37.287570+0000","last_became_active":"2023-09-29T23:23:45.464083+0000","last_became_peered":"2023-09-29T23:23:45.464083+0000","last_unstale":"2023-09-29T23:24:37.287570+0000","last_undegraded":"2023-09-29T23:24:37.287570+0000","last_fullsized":"2023-09-29T23:24:37.287570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287315+0000","last_change":"2023-09-29T23:23:45.466588+0000","last_active":"2023-09-29T23:24:37.287315+0000","last_peered":"2023-09-29T23:24:37.287315+0000","last_clean":"2023-09-29T23:24:37.287315+0000","last_became_active":"2023-09-29T23:23:45.466161+0000","last_became_peered":"2023-09-29T23:23:45.466161+0000","last_unstale":"2023-09-29T23:24:37.287315+0000","last_undegraded":"2023-09-29T23:24:37.287315+0000","last_fullsized":"2023-09-29T23:24:37.287315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:04.477680+0000","last_change":"2023-09-29T23:29:04.477657+0000","last_active":"2023-09-29T23:29:04.477680+0000","last_peered":"2023-09-29T23:29:04.477680+0000","last_clean":"2023-09-29T23:29:04.477680+0000","last_became_active":"2023-09-29T23:23:45.467178+0000","last_became_peered":"2023-09-29T23:23:45.467178+0000","last_unstale":"2023-09-29T23:29:04.477680+0000","last_undegraded":"2023-09-29T23:29:04.477680+0000","last_fullsized":"2023-09-29T23:29:04.477680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:04.477596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:04.477596+0000","last_clean_scrub_stamp":"2023-09-29T23:29:04.477596+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:49.700926+0000","scrub_duration":0.001119543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286605+0000","last_change":"2023-09-29T23:23:45.465231+0000","last_active":"2023-09-29T23:24:37.286605+0000","last_peered":"2023-09-29T23:24:37.286605+0000","last_clean":"2023-09-29T23:24:37.286605+0000","last_became_active":"2023-09-29T23:23:45.464523+0000","last_became_peered":"2023-09-29T23:23:45.464523+0000","last_unstale":"2023-09-29T23:24:37.286605+0000","last_undegraded":"2023-09-29T23:24:37.286605+0000","last_fullsized":"2023-09-29T23:24:37.286605+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281097+0000","last_change":"2023-09-29T23:23:45.470349+0000","last_active":"2023-09-29T23:24:37.281097+0000","last_peered":"2023-09-29T23:24:37.281097+0000","last_clean":"2023-09-29T23:24:37.281097+0000","last_became_active":"2023-09-29T23:23:45.467004+0000","last_became_peered":"2023-09-29T23:23:45.467004+0000","last_unstale":"2023-09-29T23:24:37.281097+0000","last_undegraded":"2023-09-29T23:24:37.281097+0000","last_fullsized":"2023-09-29T23:24:37.281097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283339+0000","last_change":"2023-09-29T23:23:45.471536+0000","last_active":"2023-09-29T23:24:37.283339+0000","last_peered":"2023-09-29T23:24:37.283339+0000","last_clean":"2023-09-29T23:24:37.283339+0000","last_became_active":"2023-09-29T23:23:45.471334+0000","last_became_peered":"2023-09-29T23:23:45.471334+0000","last_unstale":"2023-09-29T23:24:37.283339+0000","last_undegraded":"2023-09-29T23:24:37.283339+0000","last_fullsized":"2023-09-29T23:24:37.283339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.282337+0000","last_change":"2023-09-29T23:23:45.468857+0000","last_active":"2023-09-29T23:24:37.282337+0000","last_peered":"2023-09-29T23:24:37.282337+0000","last_clean":"2023-09-29T23:24:37.282337+0000","last_became_active":"2023-09-29T23:23:45.468001+0000","last_became_peered":"2023-09-29T23:23:45.468001+0000","last_unstale":"2023-09-29T23:24:37.282337+0000","last_undegraded":"2023-09-29T23:24:37.282337+0000","last_fullsized":"2023-09-29T23:24:37.282337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283970+0000","last_change":"2023-09-29T23:23:45.467819+0000","last_active":"2023-09-29T23:24:37.283970+0000","last_peered":"2023-09-29T23:24:37.283970+0000","last_clean":"2023-09-29T23:24:37.283970+0000","last_became_active":"2023-09-29T23:23:45.467434+0000","last_became_peered":"2023-09-29T23:23:45.467434+0000","last_unstale":"2023-09-29T23:24:37.283970+0000","last_undegraded":"2023-09-29T23:24:37.283970+0000","last_fullsized":"2023-09-29T23:24:37.283970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287439+0000","last_change":"2023-09-29T23:23:45.473751+0000","last_active":"2023-09-29T23:24:37.287439+0000","last_peered":"2023-09-29T23:24:37.287439+0000","last_clean":"2023-09-29T23:24:37.287439+0000","last_became_active":"2023-09-29T23:23:45.473326+0000","last_became_peered":"2023-09-29T23:23:45.473326+0000","last_unstale":"2023-09-29T23:24:37.287439+0000","last_undegraded":"2023-09-29T23:24:37.287439+0000","last_fullsized":"2023-09-29T23:24:37.287439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:02.476624+0000","last_change":"2023-09-29T23:29:02.476605+0000","last_active":"2023-09-29T23:29:02.476624+0000","last_peered":"2023-09-29T23:29:02.476624+0000","last_clean":"2023-09-29T23:29:02.476624+0000","last_became_active":"2023-09-29T23:23:45.467494+0000","last_became_peered":"2023-09-29T23:23:45.467494+0000","last_unstale":"2023-09-29T23:29:02.476624+0000","last_undegraded":"2023-09-29T23:29:02.476624+0000","last_fullsized":"2023-09-29T23:29:02.476624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:02.476541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:02.476541+0000","last_clean_scrub_stamp":"2023-09-29T23:29:02.476541+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:07:21.575629+0000","scrub_duration":0.0011731350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:06.426368+0000","last_change":"2023-09-29T23:29:06.426326+0000","last_active":"2023-09-29T23:29:06.426368+0000","last_peered":"2023-09-29T23:29:06.426368+0000","last_clean":"2023-09-29T23:29:06.426368+0000","last_became_active":"2023-09-29T23:23:45.477408+0000","last_became_peered":"2023-09-29T23:23:45.477408+0000","last_unstale":"2023-09-29T23:29:06.426368+0000","last_undegraded":"2023-09-29T23:29:06.426368+0000","last_fullsized":"2023-09-29T23:29:06.426368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:06.426255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:06.426255+0000","last_clean_scrub_stamp":"2023-09-29T23:29:06.426255+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:16:36.592771+0000","scrub_duration":0.001349893,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.280950+0000","last_change":"2023-09-29T23:23:45.471232+0000","last_active":"2023-09-29T23:24:37.280950+0000","last_peered":"2023-09-29T23:24:37.280950+0000","last_clean":"2023-09-29T23:24:37.280950+0000","last_became_active":"2023-09-29T23:23:45.470574+0000","last_became_peered":"2023-09-29T23:23:45.470574+0000","last_unstale":"2023-09-29T23:24:37.280950+0000","last_undegraded":"2023-09-29T23:24:37.280950+0000","last_fullsized":"2023-09-29T23:24:37.280950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:07.470966+0000","last_change":"2023-09-29T23:29:07.470936+0000","last_active":"2023-09-29T23:29:07.470966+0000","last_peered":"2023-09-29T23:29:07.470966+0000","last_clean":"2023-09-29T23:29:07.470966+0000","last_became_active":"2023-09-29T23:23:45.473789+0000","last_became_peered":"2023-09-29T23:23:45.473789+0000","last_unstale":"2023-09-29T23:29:07.470966+0000","last_undegraded":"2023-09-29T23:29:07.470966+0000","last_fullsized":"2023-09-29T23:29:07.470966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:07.470870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:07.470870+0000","last_clean_scrub_stamp":"2023-09-29T23:29:07.470870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:35:33.595449+0000","scrub_duration":0.0012289239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:03.460784+0000","last_change":"2023-09-29T23:29:03.460762+0000","last_active":"2023-09-29T23:29:03.460784+0000","last_peered":"2023-09-29T23:29:03.460784+0000","last_clean":"2023-09-29T23:29:03.460784+0000","last_became_active":"2023-09-29T23:23:45.465443+0000","last_became_peered":"2023-09-29T23:23:45.465443+0000","last_unstale":"2023-09-29T23:29:03.460784+0000","last_undegraded":"2023-09-29T23:29:03.460784+0000","last_fullsized":"2023-09-29T23:29:03.460784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:03.460703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:03.460703+0000","last_clean_scrub_stamp":"2023-09-29T23:29:03.460703+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:59:00.319545+0000","scrub_duration":0.00097215699999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283832+0000","last_change":"2023-09-29T23:23:45.458032+0000","last_active":"2023-09-29T23:24:37.283832+0000","last_peered":"2023-09-29T23:24:37.283832+0000","last_clean":"2023-09-29T23:24:37.283832+0000","last_became_active":"2023-09-29T23:23:45.457799+0000","last_became_peered":"2023-09-29T23:23:45.457799+0000","last_unstale":"2023-09-29T23:24:37.283832+0000","last_undegraded":"2023-09-29T23:24:37.283832+0000","last_fullsized":"2023-09-29T23:24:37.283832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:15.837977+0000","last_change":"2023-09-29T23:29:15.837942+0000","last_active":"2023-09-29T23:29:15.837977+0000","last_peered":"2023-09-29T23:29:15.837977+0000","last_clean":"2023-09-29T23:29:15.837977+0000","last_became_active":"2023-09-29T23:23:45.467730+0000","last_became_peered":"2023-09-29T23:23:45.467730+0000","last_unstale":"2023-09-29T23:29:15.837977+0000","last_undegraded":"2023-09-29T23:29:15.837977+0000","last_fullsized":"2023-09-29T23:29:15.837977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:15.837865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:15.837865+0000","last_clean_scrub_stamp":"2023-09-29T23:29:15.837865+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:04:13.297945+0000","scrub_duration":0.001397206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"16'1","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:06.283311+0000","last_change":"2023-09-29T23:29:06.283268+0000","last_active":"2023-09-29T23:29:06.283311+0000","last_peered":"2023-09-29T23:29:06.283311+0000","last_clean":"2023-09-29T23:29:06.283311+0000","last_became_active":"2023-09-29T23:23:45.075848+0000","last_became_peered":"2023-09-29T23:23:45.075848+0000","last_unstale":"2023-09-29T23:29:06.283311+0000","last_undegraded":"2023-09-29T23:29:06.283311+0000","last_fullsized":"2023-09-29T23:29:06.283311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'1","last_scrub_stamp":"2023-09-29T23:29:06.283188+0000","last_deep_scrub":"16'1","last_deep_scrub_stamp":"2023-09-29T23:29:06.283188+0000","last_clean_scrub_stamp":"2023-09-29T23:29:06.283188+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:16:36.449704+0000","scrub_duration":0.0013356450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:04.277638+0000","last_change":"2023-09-29T23:29:04.277614+0000","last_active":"2023-09-29T23:29:04.277638+0000","last_peered":"2023-09-29T23:29:04.277638+0000","last_clean":"2023-09-29T23:29:04.277638+0000","last_became_active":"2023-09-29T23:23:45.462155+0000","last_became_peered":"2023-09-29T23:23:45.462155+0000","last_unstale":"2023-09-29T23:29:04.277638+0000","last_undegraded":"2023-09-29T23:29:04.277638+0000","last_fullsized":"2023-09-29T23:29:04.277638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:04.277542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:04.277542+0000","last_clean_scrub_stamp":"2023-09-29T23:29:04.277542+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:49.500872+0000","scrub_duration":0.0010848310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283570+0000","last_change":"2023-09-29T23:23:45.092553+0000","last_active":"2023-09-29T23:24:37.283570+0000","last_peered":"2023-09-29T23:24:37.283570+0000","last_clean":"2023-09-29T23:24:37.283570+0000","last_became_active":"2023-09-29T23:23:45.092273+0000","last_became_peered":"2023-09-29T23:23:45.092273+0000","last_unstale":"2023-09-29T23:24:37.283570+0000","last_undegraded":"2023-09-29T23:24:37.283570+0000","last_fullsized":"2023-09-29T23:24:37.283570+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286985+0000","last_change":"2023-09-29T23:23:45.464637+0000","last_active":"2023-09-29T23:24:37.286985+0000","last_peered":"2023-09-29T23:24:37.286985+0000","last_clean":"2023-09-29T23:24:37.286985+0000","last_became_active":"2023-09-29T23:23:45.464027+0000","last_became_peered":"2023-09-29T23:23:45.464027+0000","last_unstale":"2023-09-29T23:24:37.286985+0000","last_undegraded":"2023-09-29T23:24:37.286985+0000","last_fullsized":"2023-09-29T23:24:37.286985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286762+0000","last_change":"2023-09-29T23:23:45.088658+0000","last_active":"2023-09-29T23:24:37.286762+0000","last_peered":"2023-09-29T23:24:37.286762+0000","last_clean":"2023-09-29T23:24:37.286762+0000","last_became_active":"2023-09-29T23:23:45.088405+0000","last_became_peered":"2023-09-29T23:23:45.088405+0000","last_unstale":"2023-09-29T23:24:37.286762+0000","last_undegraded":"2023-09-29T23:24:37.286762+0000","last_fullsized":"2023-09-29T23:24:37.286762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:18.842822+0000","last_change":"2023-09-29T23:29:18.842794+0000","last_active":"2023-09-29T23:29:18.842822+0000","last_peered":"2023-09-29T23:29:18.842822+0000","last_clean":"2023-09-29T23:29:18.842822+0000","last_became_active":"2023-09-29T23:23:45.470917+0000","last_became_peered":"2023-09-29T23:23:45.470917+0000","last_unstale":"2023-09-29T23:29:18.842822+0000","last_undegraded":"2023-09-29T23:29:18.842822+0000","last_fullsized":"2023-09-29T23:29:18.842822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:18.842718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:18.842718+0000","last_clean_scrub_stamp":"2023-09-29T23:29:18.842718+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:59:15.701560+0000","scrub_duration":0.0012829569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286548+0000","last_change":"2023-09-29T23:23:45.070764+0000","last_active":"2023-09-29T23:24:37.286548+0000","last_peered":"2023-09-29T23:24:37.286548+0000","last_clean":"2023-09-29T23:24:37.286548+0000","last_became_active":"2023-09-29T23:23:45.070610+0000","last_became_peered":"2023-09-29T23:23:45.070610+0000","last_unstale":"2023-09-29T23:24:37.286548+0000","last_undegraded":"2023-09-29T23:24:37.286548+0000","last_fullsized":"2023-09-29T23:24:37.286548+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281016+0000","last_change":"2023-09-29T23:23:45.475877+0000","last_active":"2023-09-29T23:24:37.281016+0000","last_peered":"2023-09-29T23:24:37.281016+0000","last_clean":"2023-09-29T23:24:37.281016+0000","last_became_active":"2023-09-29T23:23:45.475634+0000","last_became_peered":"2023-09-29T23:23:45.475634+0000","last_unstale":"2023-09-29T23:24:37.281016+0000","last_undegraded":"2023-09-29T23:24:37.281016+0000","last_fullsized":"2023-09-29T23:24:37.281016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:16.093276+0000","last_change":"2023-09-29T23:29:16.093250+0000","last_active":"2023-09-29T23:29:16.093276+0000","last_peered":"2023-09-29T23:29:16.093276+0000","last_clean":"2023-09-29T23:29:16.093276+0000","last_became_active":"2023-09-29T23:23:45.091317+0000","last_became_peered":"2023-09-29T23:23:45.091317+0000","last_unstale":"2023-09-29T23:29:16.093276+0000","last_undegraded":"2023-09-29T23:29:16.093276+0000","last_fullsized":"2023-09-29T23:29:16.093276+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:16.093182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:16.093182+0000","last_clean_scrub_stamp":"2023-09-29T23:29:16.093182+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:31:53.593525+0000","scrub_duration":0.001347411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.284053+0000","last_change":"2023-09-29T23:23:45.458805+0000","last_active":"2023-09-29T23:24:37.284053+0000","last_peered":"2023-09-29T23:24:37.284053+0000","last_clean":"2023-09-29T23:24:37.284053+0000","last_became_active":"2023-09-29T23:23:45.458585+0000","last_became_peered":"2023-09-29T23:23:45.458585+0000","last_unstale":"2023-09-29T23:24:37.284053+0000","last_undegraded":"2023-09-29T23:24:37.284053+0000","last_fullsized":"2023-09-29T23:24:37.284053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287376+0000","last_change":"2023-09-29T23:23:45.071269+0000","last_active":"2023-09-29T23:24:37.287376+0000","last_peered":"2023-09-29T23:24:37.287376+0000","last_clean":"2023-09-29T23:24:37.287376+0000","last_became_active":"2023-09-29T23:23:45.070986+0000","last_became_peered":"2023-09-29T23:23:45.070986+0000","last_unstale":"2023-09-29T23:24:37.287376+0000","last_undegraded":"2023-09-29T23:24:37.287376+0000","last_fullsized":"2023-09-29T23:24:37.287376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287222+0000","last_change":"2023-09-29T23:23:45.464917+0000","last_active":"2023-09-29T23:24:37.287222+0000","last_peered":"2023-09-29T23:24:37.287222+0000","last_clean":"2023-09-29T23:24:37.287222+0000","last_became_active":"2023-09-29T23:23:45.464510+0000","last_became_peered":"2023-09-29T23:23:45.464510+0000","last_unstale":"2023-09-29T23:24:37.287222+0000","last_undegraded":"2023-09-29T23:24:37.287222+0000","last_fullsized":"2023-09-29T23:24:37.287222+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"16'3","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281697+0000","last_change":"2023-09-29T23:23:45.077097+0000","last_active":"2023-09-29T23:24:37.281697+0000","last_peered":"2023-09-29T23:24:37.281697+0000","last_clean":"2023-09-29T23:24:37.281697+0000","last_became_active":"2023-09-29T23:23:45.076856+0000","last_became_peered":"2023-09-29T23:23:45.076856+0000","last_unstale":"2023-09-29T23:24:37.281697+0000","last_undegraded":"2023-09-29T23:24:37.281697+0000","last_fullsized":"2023-09-29T23:24:37.281697+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281536+0000","last_change":"2023-09-29T23:23:45.462198+0000","last_active":"2023-09-29T23:24:37.281536+0000","last_peered":"2023-09-29T23:24:37.281536+0000","last_clean":"2023-09-29T23:24:37.281536+0000","last_became_active":"2023-09-29T23:23:45.461199+0000","last_became_peered":"2023-09-29T23:23:45.461199+0000","last_unstale":"2023-09-29T23:24:37.281536+0000","last_undegraded":"2023-09-29T23:24:37.281536+0000","last_fullsized":"2023-09-29T23:24:37.281536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"16'6","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.284018+0000","last_change":"2023-09-29T23:23:45.093720+0000","last_active":"2023-09-29T23:24:37.284018+0000","last_peered":"2023-09-29T23:24:37.284018+0000","last_clean":"2023-09-29T23:24:37.284018+0000","last_became_active":"2023-09-29T23:23:45.093487+0000","last_became_peered":"2023-09-29T23:23:45.093487+0000","last_unstale":"2023-09-29T23:24:37.284018+0000","last_undegraded":"2023-09-29T23:24:37.284018+0000","last_fullsized":"2023-09-29T23:24:37.284018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287508+0000","last_change":"2023-09-29T23:23:45.466875+0000","last_active":"2023-09-29T23:24:37.287508+0000","last_peered":"2023-09-29T23:24:37.287508+0000","last_clean":"2023-09-29T23:24:37.287508+0000","last_became_active":"2023-09-29T23:23:45.466667+0000","last_became_peered":"2023-09-29T23:23:45.466667+0000","last_unstale":"2023-09-29T23:24:37.287508+0000","last_undegraded":"2023-09-29T23:24:37.287508+0000","last_fullsized":"2023-09-29T23:24:37.287508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287078+0000","last_change":"2023-09-29T23:23:45.089727+0000","last_active":"2023-09-29T23:24:37.287078+0000","last_peered":"2023-09-29T23:24:37.287078+0000","last_clean":"2023-09-29T23:24:37.287078+0000","last_became_active":"2023-09-29T23:23:45.089450+0000","last_became_peered":"2023-09-29T23:23:45.089450+0000","last_unstale":"2023-09-29T23:24:37.287078+0000","last_undegraded":"2023-09-29T23:24:37.287078+0000","last_fullsized":"2023-09-29T23:24:37.287078+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286785+0000","last_change":"2023-09-29T23:23:45.468316+0000","last_active":"2023-09-29T23:24:37.286785+0000","last_peered":"2023-09-29T23:24:37.286785+0000","last_clean":"2023-09-29T23:24:37.286785+0000","last_became_active":"2023-09-29T23:23:45.464801+0000","last_became_peered":"2023-09-29T23:23:45.464801+0000","last_unstale":"2023-09-29T23:24:37.286785+0000","last_undegraded":"2023-09-29T23:24:37.286785+0000","last_fullsized":"2023-09-29T23:24:37.286785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283593+0000","last_change":"2023-09-29T23:23:45.093148+0000","last_active":"2023-09-29T23:24:37.283593+0000","last_peered":"2023-09-29T23:24:37.283593+0000","last_clean":"2023-09-29T23:24:37.283593+0000","last_became_active":"2023-09-29T23:23:45.092902+0000","last_became_peered":"2023-09-29T23:23:45.092902+0000","last_unstale":"2023-09-29T23:24:37.283593+0000","last_undegraded":"2023-09-29T23:24:37.283593+0000","last_fullsized":"2023-09-29T23:24:37.283593+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281103+0000","last_change":"2023-09-29T23:23:45.466007+0000","last_active":"2023-09-29T23:24:37.281103+0000","last_peered":"2023-09-29T23:24:37.281103+0000","last_clean":"2023-09-29T23:24:37.281103+0000","last_became_active":"2023-09-29T23:23:45.465743+0000","last_became_peered":"2023-09-29T23:23:45.465743+0000","last_unstale":"2023-09-29T23:24:37.281103+0000","last_undegraded":"2023-09-29T23:24:37.281103+0000","last_fullsized":"2023-09-29T23:24:37.281103+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286677+0000","last_change":"2023-09-29T23:23:45.072234+0000","last_active":"2023-09-29T23:24:37.286677+0000","last_peered":"2023-09-29T23:24:37.286677+0000","last_clean":"2023-09-29T23:24:37.286677+0000","last_became_active":"2023-09-29T23:23:45.072009+0000","last_became_peered":"2023-09-29T23:23:45.072009+0000","last_unstale":"2023-09-29T23:24:37.286677+0000","last_undegraded":"2023-09-29T23:24:37.286677+0000","last_fullsized":"2023-09-29T23:24:37.286677+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281068+0000","last_change":"2023-09-29T23:23:45.466374+0000","last_active":"2023-09-29T23:24:37.281068+0000","last_peered":"2023-09-29T23:24:37.281068+0000","last_clean":"2023-09-29T23:24:37.281068+0000","last_became_active":"2023-09-29T23:23:45.466169+0000","last_became_peered":"2023-09-29T23:23:45.466169+0000","last_unstale":"2023-09-29T23:24:37.281068+0000","last_undegraded":"2023-09-29T23:24:37.281068+0000","last_fullsized":"2023-09-29T23:24:37.281068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"16'8","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283640+0000","last_change":"2023-09-29T23:23:45.091762+0000","last_active":"2023-09-29T23:24:37.283640+0000","last_peered":"2023-09-29T23:24:37.283640+0000","last_clean":"2023-09-29T23:24:37.283640+0000","last_became_active":"2023-09-29T23:23:45.091386+0000","last_became_peered":"2023-09-29T23:23:45.091386+0000","last_unstale":"2023-09-29T23:24:37.283640+0000","last_undegraded":"2023-09-29T23:24:37.283640+0000","last_fullsized":"2023-09-29T23:24:37.283640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:05.861334+0000","last_change":"2023-09-29T23:29:05.861311+0000","last_active":"2023-09-29T23:29:05.861334+0000","last_peered":"2023-09-29T23:29:05.861334+0000","last_clean":"2023-09-29T23:29:05.861334+0000","last_became_active":"2023-09-29T23:23:45.460643+0000","last_became_peered":"2023-09-29T23:23:45.460643+0000","last_unstale":"2023-09-29T23:29:05.861334+0000","last_undegraded":"2023-09-29T23:29:05.861334+0000","last_fullsized":"2023-09-29T23:29:05.861334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:05.861236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:05.861236+0000","last_clean_scrub_stamp":"2023-09-29T23:29:05.861236+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:01:12.962284+0000","scrub_duration":0.0013132969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"16'1","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287157+0000","last_change":"2023-09-29T23:23:45.078091+0000","last_active":"2023-09-29T23:24:37.287157+0000","last_peered":"2023-09-29T23:24:37.287157+0000","last_clean":"2023-09-29T23:24:37.287157+0000","last_became_active":"2023-09-29T23:23:45.077734+0000","last_became_peered":"2023-09-29T23:23:45.077734+0000","last_unstale":"2023-09-29T23:24:37.287157+0000","last_undegraded":"2023-09-29T23:24:37.287157+0000","last_fullsized":"2023-09-29T23:24:37.287157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:21.923919+0000","last_change":"2023-09-29T23:29:21.923888+0000","last_active":"2023-09-29T23:29:21.923919+0000","last_peered":"2023-09-29T23:29:21.923919+0000","last_clean":"2023-09-29T23:29:21.923919+0000","last_became_active":"2023-09-29T23:23:45.467555+0000","last_became_peered":"2023-09-29T23:23:45.467555+0000","last_unstale":"2023-09-29T23:29:21.923919+0000","last_undegraded":"2023-09-29T23:29:21.923919+0000","last_fullsized":"2023-09-29T23:29:21.923919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:21.923791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:21.923791+0000","last_clean_scrub_stamp":"2023-09-29T23:29:21.923791+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:16:52.090307+0000","scrub_duration":0.0011468419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"16'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.284121+0000","last_change":"2023-09-29T23:23:45.092471+0000","last_active":"2023-09-29T23:24:37.284121+0000","last_peered":"2023-09-29T23:24:37.284121+0000","last_clean":"2023-09-29T23:24:37.284121+0000","last_became_active":"2023-09-29T23:23:45.092185+0000","last_became_peered":"2023-09-29T23:23:45.092185+0000","last_unstale":"2023-09-29T23:24:37.284121+0000","last_undegraded":"2023-09-29T23:24:37.284121+0000","last_fullsized":"2023-09-29T23:24:37.284121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287302+0000","last_change":"2023-09-29T23:23:45.464504+0000","last_active":"2023-09-29T23:24:37.287302+0000","last_peered":"2023-09-29T23:24:37.287302+0000","last_clean":"2023-09-29T23:24:37.287302+0000","last_became_active":"2023-09-29T23:23:45.463806+0000","last_became_peered":"2023-09-29T23:23:45.463806+0000","last_unstale":"2023-09-29T23:24:37.287302+0000","last_undegraded":"2023-09-29T23:24:37.287302+0000","last_fullsized":"2023-09-29T23:24:37.287302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"16'1","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281401+0000","last_change":"2023-09-29T23:23:45.088776+0000","last_active":"2023-09-29T23:24:37.281401+0000","last_peered":"2023-09-29T23:24:37.281401+0000","last_clean":"2023-09-29T23:24:37.281401+0000","last_became_active":"2023-09-29T23:23:45.088535+0000","last_became_peered":"2023-09-29T23:23:45.088535+0000","last_unstale":"2023-09-29T23:24:37.281401+0000","last_undegraded":"2023-09-29T23:24:37.281401+0000","last_fullsized":"2023-09-29T23:24:37.281401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287209+0000","last_change":"2023-09-29T23:23:45.466379+0000","last_active":"2023-09-29T23:24:37.287209+0000","last_peered":"2023-09-29T23:24:37.287209+0000","last_clean":"2023-09-29T23:24:37.287209+0000","last_became_active":"2023-09-29T23:23:45.465855+0000","last_became_peered":"2023-09-29T23:23:45.465855+0000","last_unstale":"2023-09-29T23:24:37.287209+0000","last_undegraded":"2023-09-29T23:24:37.287209+0000","last_fullsized":"2023-09-29T23:24:37.287209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283914+0000","last_change":"2023-09-29T23:23:45.092714+0000","last_active":"2023-09-29T23:24:37.283914+0000","last_peered":"2023-09-29T23:24:37.283914+0000","last_clean":"2023-09-29T23:24:37.283914+0000","last_became_active":"2023-09-29T23:23:45.092476+0000","last_became_peered":"2023-09-29T23:23:45.092476+0000","last_unstale":"2023-09-29T23:24:37.283914+0000","last_undegraded":"2023-09-29T23:24:37.283914+0000","last_fullsized":"2023-09-29T23:24:37.283914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281635+0000","last_change":"2023-09-29T23:23:45.467010+0000","last_active":"2023-09-29T23:24:37.281635+0000","last_peered":"2023-09-29T23:24:37.281635+0000","last_clean":"2023-09-29T23:24:37.281635+0000","last_became_active":"2023-09-29T23:23:45.466694+0000","last_became_peered":"2023-09-29T23:23:45.466694+0000","last_unstale":"2023-09-29T23:24:37.281635+0000","last_undegraded":"2023-09-29T23:24:37.281635+0000","last_fullsized":"2023-09-29T23:24:37.281635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"16'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287019+0000","last_change":"2023-09-29T23:23:45.089622+0000","last_active":"2023-09-29T23:24:37.287019+0000","last_peered":"2023-09-29T23:24:37.287019+0000","last_clean":"2023-09-29T23:24:37.287019+0000","last_became_active":"2023-09-29T23:23:45.089176+0000","last_became_peered":"2023-09-29T23:23:45.089176+0000","last_unstale":"2023-09-29T23:24:37.287019+0000","last_undegraded":"2023-09-29T23:24:37.287019+0000","last_fullsized":"2023-09-29T23:24:37.287019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286787+0000","last_change":"2023-09-29T23:23:45.465798+0000","last_active":"2023-09-29T23:24:37.286787+0000","last_peered":"2023-09-29T23:24:37.286787+0000","last_clean":"2023-09-29T23:24:37.286787+0000","last_became_active":"2023-09-29T23:23:45.465127+0000","last_became_peered":"2023-09-29T23:23:45.465127+0000","last_unstale":"2023-09-29T23:24:37.286787+0000","last_undegraded":"2023-09-29T23:24:37.286787+0000","last_fullsized":"2023-09-29T23:24:37.286787+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281286+0000","last_change":"2023-09-29T23:23:45.075630+0000","last_active":"2023-09-29T23:24:37.281286+0000","last_peered":"2023-09-29T23:24:37.281286+0000","last_clean":"2023-09-29T23:24:37.281286+0000","last_became_active":"2023-09-29T23:23:45.075313+0000","last_became_peered":"2023-09-29T23:23:45.075313+0000","last_unstale":"2023-09-29T23:24:37.281286+0000","last_undegraded":"2023-09-29T23:24:37.281286+0000","last_fullsized":"2023-09-29T23:24:37.281286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.292070+0000","last_change":"2023-09-29T23:24:37.288465+0000","last_active":"2023-09-29T23:24:37.292070+0000","last_peered":"2023-09-29T23:24:37.292070+0000","last_clean":"2023-09-29T23:24:37.292070+0000","last_became_active":"2023-09-29T23:24:37.288220+0000","last_became_peered":"2023-09-29T23:24:37.288220+0000","last_unstale":"2023-09-29T23:24:37.292070+0000","last_undegraded":"2023-09-29T23:24:37.292070+0000","last_fullsized":"2023-09-29T23:24:37.292070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281009+0000","last_change":"2023-09-29T23:23:45.075998+0000","last_active":"2023-09-29T23:24:37.281009+0000","last_peered":"2023-09-29T23:24:37.281009+0000","last_clean":"2023-09-29T23:24:37.281009+0000","last_became_active":"2023-09-29T23:23:45.075772+0000","last_became_peered":"2023-09-29T23:23:45.075772+0000","last_unstale":"2023-09-29T23:24:37.281009+0000","last_undegraded":"2023-09-29T23:24:37.281009+0000","last_fullsized":"2023-09-29T23:24:37.281009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283383+0000","last_change":"2023-09-29T23:23:45.463124+0000","last_active":"2023-09-29T23:24:37.283383+0000","last_peered":"2023-09-29T23:24:37.283383+0000","last_clean":"2023-09-29T23:24:37.283383+0000","last_became_active":"2023-09-29T23:23:45.462583+0000","last_became_peered":"2023-09-29T23:23:45.462583+0000","last_unstale":"2023-09-29T23:24:37.283383+0000","last_undegraded":"2023-09-29T23:24:37.283383+0000","last_fullsized":"2023-09-29T23:24:37.283383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286442+0000","last_change":"2023-09-29T23:23:45.088750+0000","last_active":"2023-09-29T23:24:37.286442+0000","last_peered":"2023-09-29T23:24:37.286442+0000","last_clean":"2023-09-29T23:24:37.286442+0000","last_became_active":"2023-09-29T23:23:45.088506+0000","last_became_peered":"2023-09-29T23:23:45.088506+0000","last_unstale":"2023-09-29T23:24:37.286442+0000","last_undegraded":"2023-09-29T23:24:37.286442+0000","last_fullsized":"2023-09-29T23:24:37.286442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286795+0000","last_change":"2023-09-29T23:23:45.477617+0000","last_active":"2023-09-29T23:24:37.286795+0000","last_peered":"2023-09-29T23:24:37.286795+0000","last_clean":"2023-09-29T23:24:37.286795+0000","last_became_active":"2023-09-29T23:23:45.477335+0000","last_became_peered":"2023-09-29T23:23:45.477335+0000","last_unstale":"2023-09-29T23:24:37.286795+0000","last_undegraded":"2023-09-29T23:24:37.286795+0000","last_fullsized":"2023-09-29T23:24:37.286795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283916+0000","last_change":"2023-09-29T23:23:41.047954+0000","last_active":"2023-09-29T23:24:37.283916+0000","last_peered":"2023-09-29T23:24:37.283916+0000","last_clean":"2023-09-29T23:24:37.283916+0000","last_became_active":"2023-09-29T23:23:41.047701+0000","last_became_peered":"2023-09-29T23:23:41.047701+0000","last_unstale":"2023-09-29T23:24:37.283916+0000","last_undegraded":"2023-09-29T23:24:37.283916+0000","last_fullsized":"2023-09-29T23:24:37.283916+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"17'1","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281983+0000","last_change":"2023-09-29T23:23:45.075607+0000","last_active":"2023-09-29T23:24:37.281983+0000","last_peered":"2023-09-29T23:24:37.281983+0000","last_clean":"2023-09-29T23:24:37.281983+0000","last_became_active":"2023-09-29T23:23:45.075249+0000","last_became_peered":"2023-09-29T23:23:45.075249+0000","last_unstale":"2023-09-29T23:24:37.281983+0000","last_undegraded":"2023-09-29T23:24:37.281983+0000","last_fullsized":"2023-09-29T23:24:37.281983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283910+0000","last_change":"2023-09-29T23:23:45.460164+0000","last_active":"2023-09-29T23:24:37.283910+0000","last_peered":"2023-09-29T23:24:37.283910+0000","last_clean":"2023-09-29T23:24:37.283910+0000","last_became_active":"2023-09-29T23:23:45.459933+0000","last_became_peered":"2023-09-29T23:23:45.459933+0000","last_unstale":"2023-09-29T23:24:37.283910+0000","last_undegraded":"2023-09-29T23:24:37.283910+0000","last_fullsized":"2023-09-29T23:24:37.283910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281338+0000","last_change":"2023-09-29T23:23:41.051640+0000","last_active":"2023-09-29T23:24:37.281338+0000","last_peered":"2023-09-29T23:24:37.281338+0000","last_clean":"2023-09-29T23:24:37.281338+0000","last_became_active":"2023-09-29T23:23:41.051398+0000","last_became_peered":"2023-09-29T23:23:41.051398+0000","last_unstale":"2023-09-29T23:24:37.281338+0000","last_undegraded":"2023-09-29T23:24:37.281338+0000","last_fullsized":"2023-09-29T23:24:37.281338+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"16'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.282142+0000","last_change":"2023-09-29T23:23:45.076540+0000","last_active":"2023-09-29T23:24:37.282142+0000","last_peered":"2023-09-29T23:24:37.282142+0000","last_clean":"2023-09-29T23:24:37.282142+0000","last_became_active":"2023-09-29T23:23:45.076293+0000","last_became_peered":"2023-09-29T23:23:45.076293+0000","last_unstale":"2023-09-29T23:24:37.282142+0000","last_undegraded":"2023-09-29T23:24:37.282142+0000","last_fullsized":"2023-09-29T23:24:37.282142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287527+0000","last_change":"2023-09-29T23:23:45.466336+0000","last_active":"2023-09-29T23:24:37.287527+0000","last_peered":"2023-09-29T23:24:37.287527+0000","last_clean":"2023-09-29T23:24:37.287527+0000","last_became_active":"2023-09-29T23:23:45.466115+0000","last_became_peered":"2023-09-29T23:23:45.466115+0000","last_unstale":"2023-09-29T23:24:37.287527+0000","last_undegraded":"2023-09-29T23:24:37.287527+0000","last_fullsized":"2023-09-29T23:24:37.287527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281002+0000","last_change":"2023-09-29T23:23:41.050066+0000","last_active":"2023-09-29T23:24:37.281002+0000","last_peered":"2023-09-29T23:24:37.281002+0000","last_clean":"2023-09-29T23:24:37.281002+0000","last_became_active":"2023-09-29T23:23:41.049786+0000","last_became_peered":"2023-09-29T23:23:41.049786+0000","last_unstale":"2023-09-29T23:24:37.281002+0000","last_undegraded":"2023-09-29T23:24:37.281002+0000","last_fullsized":"2023-09-29T23:24:37.281002+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283572+0000","last_change":"2023-09-29T23:23:45.091590+0000","last_active":"2023-09-29T23:24:37.283572+0000","last_peered":"2023-09-29T23:24:37.283572+0000","last_clean":"2023-09-29T23:24:37.283572+0000","last_became_active":"2023-09-29T23:23:45.091162+0000","last_became_peered":"2023-09-29T23:23:45.091162+0000","last_unstale":"2023-09-29T23:24:37.283572+0000","last_undegraded":"2023-09-29T23:24:37.283572+0000","last_fullsized":"2023-09-29T23:24:37.283572+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286716+0000","last_change":"2023-09-29T23:23:45.474238+0000","last_active":"2023-09-29T23:24:37.286716+0000","last_peered":"2023-09-29T23:24:37.286716+0000","last_clean":"2023-09-29T23:24:37.286716+0000","last_became_active":"2023-09-29T23:23:45.473861+0000","last_became_peered":"2023-09-29T23:23:45.473861+0000","last_unstale":"2023-09-29T23:24:37.286716+0000","last_undegraded":"2023-09-29T23:24:37.286716+0000","last_fullsized":"2023-09-29T23:24:37.286716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286677+0000","last_change":"2023-09-29T23:23:41.049685+0000","last_active":"2023-09-29T23:24:37.286677+0000","last_peered":"2023-09-29T23:24:37.286677+0000","last_clean":"2023-09-29T23:24:37.286677+0000","last_became_active":"2023-09-29T23:23:41.049442+0000","last_became_peered":"2023-09-29T23:23:41.049442+0000","last_unstale":"2023-09-29T23:24:37.286677+0000","last_undegraded":"2023-09-29T23:24:37.286677+0000","last_fullsized":"2023-09-29T23:24:37.286677+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283453+0000","last_change":"2023-09-29T23:23:45.092293+0000","last_active":"2023-09-29T23:24:37.283453+0000","last_peered":"2023-09-29T23:24:37.283453+0000","last_clean":"2023-09-29T23:24:37.283453+0000","last_became_active":"2023-09-29T23:23:45.092042+0000","last_became_peered":"2023-09-29T23:23:45.092042+0000","last_unstale":"2023-09-29T23:24:37.283453+0000","last_undegraded":"2023-09-29T23:24:37.283453+0000","last_fullsized":"2023-09-29T23:24:37.283453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.280857+0000","last_change":"2023-09-29T23:23:45.461917+0000","last_active":"2023-09-29T23:24:37.280857+0000","last_peered":"2023-09-29T23:24:37.280857+0000","last_clean":"2023-09-29T23:24:37.280857+0000","last_became_active":"2023-09-29T23:23:45.461228+0000","last_became_peered":"2023-09-29T23:23:45.461228+0000","last_unstale":"2023-09-29T23:24:37.280857+0000","last_undegraded":"2023-09-29T23:24:37.280857+0000","last_fullsized":"2023-09-29T23:24:37.280857+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.280771+0000","last_change":"2023-09-29T23:23:41.051041+0000","last_active":"2023-09-29T23:24:37.280771+0000","last_peered":"2023-09-29T23:24:37.280771+0000","last_clean":"2023-09-29T23:24:37.280771+0000","last_became_active":"2023-09-29T23:23:41.050731+0000","last_became_peered":"2023-09-29T23:23:41.050731+0000","last_unstale":"2023-09-29T23:24:37.280771+0000","last_undegraded":"2023-09-29T23:24:37.280771+0000","last_fullsized":"2023-09-29T23:24:37.280771+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.280998+0000","last_change":"2023-09-29T23:23:45.088759+0000","last_active":"2023-09-29T23:24:37.280998+0000","last_peered":"2023-09-29T23:24:37.280998+0000","last_clean":"2023-09-29T23:24:37.280998+0000","last_became_active":"2023-09-29T23:23:45.088510+0000","last_became_peered":"2023-09-29T23:23:45.088510+0000","last_unstale":"2023-09-29T23:24:37.280998+0000","last_undegraded":"2023-09-29T23:24:37.280998+0000","last_fullsized":"2023-09-29T23:24:37.280998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:02.256509+0000","last_change":"2023-09-29T23:29:02.256478+0000","last_active":"2023-09-29T23:29:02.256509+0000","last_peered":"2023-09-29T23:29:02.256509+0000","last_clean":"2023-09-29T23:29:02.256509+0000","last_became_active":"2023-09-29T23:23:45.461672+0000","last_became_peered":"2023-09-29T23:23:45.461672+0000","last_unstale":"2023-09-29T23:29:02.256509+0000","last_undegraded":"2023-09-29T23:29:02.256509+0000","last_fullsized":"2023-09-29T23:29:02.256509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:02.256385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:02.256385+0000","last_clean_scrub_stamp":"2023-09-29T23:29:02.256385+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:07:21.355472+0000","scrub_duration":0.0012288970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283736+0000","last_change":"2023-09-29T23:23:41.047062+0000","last_active":"2023-09-29T23:24:37.283736+0000","last_peered":"2023-09-29T23:24:37.283736+0000","last_clean":"2023-09-29T23:24:37.283736+0000","last_became_active":"2023-09-29T23:23:41.046803+0000","last_became_peered":"2023-09-29T23:23:41.046803+0000","last_unstale":"2023-09-29T23:24:37.283736+0000","last_undegraded":"2023-09-29T23:24:37.283736+0000","last_fullsized":"2023-09-29T23:24:37.283736+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286695+0000","last_change":"2023-09-29T23:23:45.073226+0000","last_active":"2023-09-29T23:24:37.286695+0000","last_peered":"2023-09-29T23:24:37.286695+0000","last_clean":"2023-09-29T23:24:37.286695+0000","last_became_active":"2023-09-29T23:23:45.072973+0000","last_became_peered":"2023-09-29T23:23:45.072973+0000","last_unstale":"2023-09-29T23:24:37.286695+0000","last_undegraded":"2023-09-29T23:24:37.286695+0000","last_fullsized":"2023-09-29T23:24:37.286695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287097+0000","last_change":"2023-09-29T23:23:45.477628+0000","last_active":"2023-09-29T23:24:37.287097+0000","last_peered":"2023-09-29T23:24:37.287097+0000","last_clean":"2023-09-29T23:24:37.287097+0000","last_became_active":"2023-09-29T23:23:45.474318+0000","last_became_peered":"2023-09-29T23:23:45.474318+0000","last_unstale":"2023-09-29T23:24:37.287097+0000","last_undegraded":"2023-09-29T23:24:37.287097+0000","last_fullsized":"2023-09-29T23:24:37.287097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.282064+0000","last_change":"2023-09-29T23:23:41.050883+0000","last_active":"2023-09-29T23:24:37.282064+0000","last_peered":"2023-09-29T23:24:37.282064+0000","last_clean":"2023-09-29T23:24:37.282064+0000","last_became_active":"2023-09-29T23:23:41.050639+0000","last_became_peered":"2023-09-29T23:23:41.050639+0000","last_unstale":"2023-09-29T23:24:37.282064+0000","last_undegraded":"2023-09-29T23:24:37.282064+0000","last_fullsized":"2023-09-29T23:24:37.282064+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281476+0000","last_change":"2023-09-29T23:23:45.077040+0000","last_active":"2023-09-29T23:24:37.281476+0000","last_peered":"2023-09-29T23:24:37.281476+0000","last_clean":"2023-09-29T23:24:37.281476+0000","last_became_active":"2023-09-29T23:23:45.076806+0000","last_became_peered":"2023-09-29T23:23:45.076806+0000","last_unstale":"2023-09-29T23:24:37.281476+0000","last_undegraded":"2023-09-29T23:24:37.281476+0000","last_fullsized":"2023-09-29T23:24:37.281476+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:07.259573+0000","last_change":"2023-09-29T23:29:07.259539+0000","last_active":"2023-09-29T23:29:07.259573+0000","last_peered":"2023-09-29T23:29:07.259573+0000","last_clean":"2023-09-29T23:29:07.259573+0000","last_became_active":"2023-09-29T23:23:45.460913+0000","last_became_peered":"2023-09-29T23:23:45.460913+0000","last_unstale":"2023-09-29T23:29:07.259573+0000","last_undegraded":"2023-09-29T23:29:07.259573+0000","last_fullsized":"2023-09-29T23:29:07.259573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:07.259462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:07.259462+0000","last_clean_scrub_stamp":"2023-09-29T23:29:07.259462+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:35:33.384041+0000","scrub_duration":0.001325735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.282135+0000","last_change":"2023-09-29T23:23:41.050074+0000","last_active":"2023-09-29T23:24:37.282135+0000","last_peered":"2023-09-29T23:24:37.282135+0000","last_clean":"2023-09-29T23:24:37.282135+0000","last_became_active":"2023-09-29T23:23:41.049783+0000","last_became_peered":"2023-09-29T23:23:41.049783+0000","last_unstale":"2023-09-29T23:24:37.282135+0000","last_undegraded":"2023-09-29T23:24:37.282135+0000","last_fullsized":"2023-09-29T23:24:37.282135+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281543+0000","last_change":"2023-09-29T23:23:45.076087+0000","last_active":"2023-09-29T23:24:37.281543+0000","last_peered":"2023-09-29T23:24:37.281543+0000","last_clean":"2023-09-29T23:24:37.281543+0000","last_became_active":"2023-09-29T23:23:45.075273+0000","last_became_peered":"2023-09-29T23:23:45.075273+0000","last_unstale":"2023-09-29T23:24:37.281543+0000","last_undegraded":"2023-09-29T23:24:37.281543+0000","last_fullsized":"2023-09-29T23:24:37.281543+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.284018+0000","last_change":"2023-09-29T23:23:45.459071+0000","last_active":"2023-09-29T23:24:37.284018+0000","last_peered":"2023-09-29T23:24:37.284018+0000","last_clean":"2023-09-29T23:24:37.284018+0000","last_became_active":"2023-09-29T23:23:45.458250+0000","last_became_peered":"2023-09-29T23:23:45.458250+0000","last_unstale":"2023-09-29T23:24:37.284018+0000","last_undegraded":"2023-09-29T23:24:37.284018+0000","last_fullsized":"2023-09-29T23:24:37.284018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"16'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287008+0000","last_change":"2023-09-29T23:23:45.076932+0000","last_active":"2023-09-29T23:24:37.287008+0000","last_peered":"2023-09-29T23:24:37.287008+0000","last_clean":"2023-09-29T23:24:37.287008+0000","last_became_active":"2023-09-29T23:23:45.076638+0000","last_became_peered":"2023-09-29T23:23:45.076638+0000","last_unstale":"2023-09-29T23:24:37.287008+0000","last_undegraded":"2023-09-29T23:24:37.287008+0000","last_fullsized":"2023-09-29T23:24:37.287008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.284072+0000","last_change":"2023-09-29T23:23:45.471332+0000","last_active":"2023-09-29T23:24:37.284072+0000","last_peered":"2023-09-29T23:24:37.284072+0000","last_clean":"2023-09-29T23:24:37.284072+0000","last_became_active":"2023-09-29T23:23:45.471013+0000","last_became_peered":"2023-09-29T23:23:45.471013+0000","last_unstale":"2023-09-29T23:24:37.284072+0000","last_undegraded":"2023-09-29T23:24:37.284072+0000","last_fullsized":"2023-09-29T23:24:37.284072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"16'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.298264+0000","last_change":"2023-09-29T23:24:37.295660+0000","last_active":"2023-09-29T23:24:37.298264+0000","last_peered":"2023-09-29T23:24:37.298264+0000","last_clean":"2023-09-29T23:24:37.298264+0000","last_became_active":"2023-09-29T23:24:37.292123+0000","last_became_peered":"2023-09-29T23:24:37.292123+0000","last_unstale":"2023-09-29T23:24:37.298264+0000","last_undegraded":"2023-09-29T23:24:37.298264+0000","last_fullsized":"2023-09-29T23:24:37.298264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281244+0000","last_change":"2023-09-29T23:23:45.471929+0000","last_active":"2023-09-29T23:24:37.281244+0000","last_peered":"2023-09-29T23:24:37.281244+0000","last_clean":"2023-09-29T23:24:37.281244+0000","last_became_active":"2023-09-29T23:23:45.471673+0000","last_became_peered":"2023-09-29T23:23:45.471673+0000","last_unstale":"2023-09-29T23:24:37.281244+0000","last_undegraded":"2023-09-29T23:24:37.281244+0000","last_fullsized":"2023-09-29T23:24:37.281244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283998+0000","last_change":"2023-09-29T23:23:45.092434+0000","last_active":"2023-09-29T23:24:37.283998+0000","last_peered":"2023-09-29T23:24:37.283998+0000","last_clean":"2023-09-29T23:24:37.283998+0000","last_became_active":"2023-09-29T23:23:45.092203+0000","last_became_peered":"2023-09-29T23:23:45.092203+0000","last_unstale":"2023-09-29T23:24:37.283998+0000","last_undegraded":"2023-09-29T23:24:37.283998+0000","last_fullsized":"2023-09-29T23:24:37.283998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287347+0000","last_change":"2023-09-29T23:23:45.464734+0000","last_active":"2023-09-29T23:24:37.287347+0000","last_peered":"2023-09-29T23:24:37.287347+0000","last_clean":"2023-09-29T23:24:37.287347+0000","last_became_active":"2023-09-29T23:23:45.464202+0000","last_became_peered":"2023-09-29T23:23:45.464202+0000","last_unstale":"2023-09-29T23:24:37.287347+0000","last_undegraded":"2023-09-29T23:24:37.287347+0000","last_fullsized":"2023-09-29T23:24:37.287347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1f","version":"16'4","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287250+0000","last_change":"2023-09-29T23:23:45.074017+0000","last_active":"2023-09-29T23:24:37.287250+0000","last_peered":"2023-09-29T23:24:37.287250+0000","last_clean":"2023-09-29T23:24:37.287250+0000","last_became_active":"2023-09-29T23:23:45.073772+0000","last_became_peered":"2023-09-29T23:23:45.073772+0000","last_unstale":"2023-09-29T23:24:37.287250+0000","last_undegraded":"2023-09-29T23:24:37.287250+0000","last_fullsized":"2023-09-29T23:24:37.287250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:14.852011+0000","last_change":"2023-09-29T23:29:14.851983+0000","last_active":"2023-09-29T23:29:14.852011+0000","last_peered":"2023-09-29T23:29:14.852011+0000","last_clean":"2023-09-29T23:29:14.852011+0000","last_became_active":"2023-09-29T23:23:45.460548+0000","last_became_peered":"2023-09-29T23:23:45.460548+0000","last_unstale":"2023-09-29T23:29:14.852011+0000","last_undegraded":"2023-09-29T23:29:14.852011+0000","last_fullsized":"2023-09-29T23:29:14.852011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:14.851891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:14.851891+0000","last_clean_scrub_stamp":"2023-09-29T23:29:14.851891+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:08:19.031301+0000","scrub_duration":0.0015205469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:19.888652+0000","last_change":"2023-09-29T23:29:19.888625+0000","last_active":"2023-09-29T23:29:19.888652+0000","last_peered":"2023-09-29T23:29:19.888652+0000","last_clean":"2023-09-29T23:29:19.888652+0000","last_became_active":"2023-09-29T23:23:45.471294+0000","last_became_peered":"2023-09-29T23:23:45.471294+0000","last_unstale":"2023-09-29T23:29:19.888652+0000","last_undegraded":"2023-09-29T23:29:19.888652+0000","last_fullsized":"2023-09-29T23:29:19.888652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:19.888553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:19.888553+0000","last_clean_scrub_stamp":"2023-09-29T23:29:19.888553+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:21:05.111883+0000","scrub_duration":0.0012268019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:16.870489+0000","last_change":"2023-09-29T23:29:16.870462+0000","last_active":"2023-09-29T23:29:16.870489+0000","last_peered":"2023-09-29T23:29:16.870489+0000","last_clean":"2023-09-29T23:29:16.870489+0000","last_became_active":"2023-09-29T23:23:45.461188+0000","last_became_peered":"2023-09-29T23:23:45.461188+0000","last_unstale":"2023-09-29T23:29:16.870489+0000","last_undegraded":"2023-09-29T23:29:16.870489+0000","last_fullsized":"2023-09-29T23:29:16.870489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:16.870393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:16.870393+0000","last_clean_scrub_stamp":"2023-09-29T23:29:16.870393+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:08:57.437070+0000","scrub_duration":0.00131145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286879+0000","last_change":"2023-09-29T23:23:45.473685+0000","last_active":"2023-09-29T23:24:37.286879+0000","last_peered":"2023-09-29T23:24:37.286879+0000","last_clean":"2023-09-29T23:24:37.286879+0000","last_became_active":"2023-09-29T23:23:45.473438+0000","last_became_peered":"2023-09-29T23:23:45.473438+0000","last_unstale":"2023-09-29T23:24:37.286879+0000","last_undegraded":"2023-09-29T23:24:37.286879+0000","last_fullsized":"2023-09-29T23:24:37.286879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287164+0000","last_change":"2023-09-29T23:23:45.477880+0000","last_active":"2023-09-29T23:24:37.287164+0000","last_peered":"2023-09-29T23:24:37.287164+0000","last_clean":"2023-09-29T23:24:37.287164+0000","last_became_active":"2023-09-29T23:23:45.474163+0000","last_became_peered":"2023-09-29T23:23:45.474163+0000","last_unstale":"2023-09-29T23:24:37.287164+0000","last_undegraded":"2023-09-29T23:24:37.287164+0000","last_fullsized":"2023-09-29T23:24:37.287164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:16.435331+0000","last_change":"2023-09-29T23:29:16.435290+0000","last_active":"2023-09-29T23:29:16.435331+0000","last_peered":"2023-09-29T23:29:16.435331+0000","last_clean":"2023-09-29T23:29:16.435331+0000","last_became_active":"2023-09-29T23:23:45.473063+0000","last_became_peered":"2023-09-29T23:23:45.473063+0000","last_unstale":"2023-09-29T23:29:16.435331+0000","last_undegraded":"2023-09-29T23:29:16.435331+0000","last_fullsized":"2023-09-29T23:29:16.435331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:16.435179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:16.435179+0000","last_clean_scrub_stamp":"2023-09-29T23:29:16.435179+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:31:53.935521+0000","scrub_duration":0.001480377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281861+0000","last_change":"2023-09-29T23:23:45.463712+0000","last_active":"2023-09-29T23:24:37.281861+0000","last_peered":"2023-09-29T23:24:37.281861+0000","last_clean":"2023-09-29T23:24:37.281861+0000","last_became_active":"2023-09-29T23:23:45.463269+0000","last_became_peered":"2023-09-29T23:23:45.463269+0000","last_unstale":"2023-09-29T23:24:37.281861+0000","last_undegraded":"2023-09-29T23:24:37.281861+0000","last_fullsized":"2023-09-29T23:24:37.281861+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705735,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5572,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852028,"statfs":{"total":107374182400,"available":107368476672,"internally_reserved":0,"allocated":192512,"data_stored":54287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 29 23:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.27600000000000002},"min":{"1min":0.191,"5min":0.14499999999999999,"15min":0.14499999999999999},"max":{"1min":0.39800000000000002,"5min":0.435,"15min":0.435},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.29099999999999998,"15min":0.27400000000000002},"min":{"1min":0.20100000000000001,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.42799999999999999,"5min":0.437,"15min":0.437},"last":0.25800000000000001}]},{"osd":2,"last update":"Fri Sep 29 23:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.29599999999999999,"15min":0.27800000000000002},"min":{"1min":0.216,"5min":0.186,"15min":0.186},"max":{"1min":0.42599999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.309,"15min":0.29299999999999998},"min":{"1min":0.20899999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.45100000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.29399999999999998}]}]},{"osd":2,"up_from":8,"seq":34359738439,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5500,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":104852100,"statfs":{"total":107374182400,"available":107368550400,"internally_reserved":0,"allocated":184320,"data_stored":53655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 29 23:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.28299999999999997,"15min":0.28899999999999998},"min":{"1min":0.19700000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.375},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.29099999999999998,"15min":0.29699999999999999},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.433,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Sep 29 23:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.21199999999999999,"5min":0.189,"15min":0.189},"max":{"1min":0.46200000000000002,"5min":0.498,"15min":0.498},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.307,"5min":0.313,"15min":0.317},"min":{"1min":0.23499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48099999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.40799999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705734,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5624,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":104851976,"statfs":{"total":107374182400,"available":107368423424,"internally_reserved":0,"allocated":180224,"data_stored":52715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 29 23:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.27800000000000002,"15min":0.28399999999999997},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.39900000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.28199999999999997,"15min":0.27000000000000002},"min":{"1min":0.221,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.41599999999999998,"5min":0.44,"15min":0.44},"last":0.246}]},{"osd":2,"last update":"Fri Sep 29 23:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.28100000000000003,"5min":0.28699999999999998,"15min":0.26900000000000002},"min":{"1min":0.22,"5min":0.191,"15min":0.191},"max":{"1min":0.438,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.29099999999999998,"5min":0.29799999999999999,"15min":0.28799999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.45300000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.26500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-29T23:29:23.216 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.216 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.216 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.216 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.216 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.217 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.217 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.217 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.217 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.217 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.217 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.217 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.217 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.218 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.218 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.218 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.218 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.218 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.218 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.218 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.218 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.219 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.219 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.219 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.219 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.219 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.219 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.219 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.219 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.220 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.220 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.220 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.220 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.220 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.220 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.220 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.220 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.221 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.221 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.221 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.221 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.221 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.221 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.221 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.221 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.222 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.222 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.222 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.222 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.222 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.222 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.222 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.222 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.222 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.223 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.223 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.223 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.223 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.223 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.223 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.223 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.223 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.224 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.224 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.224 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.224 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.224 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.224 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.224 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.224 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.224 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.225 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.225 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.225 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.225 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.225 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.225 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.225 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.225 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.226 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.226 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.226 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.226 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:23.226 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-29T23:29:43.227 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:29:43.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.352+0000 7fd9b7416700 1 Processor -- start 2023-09-29T23:29:43.352 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.352+0000 7fd9b7416700 1 -- start start 2023-09-29T23:29:43.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.352+0000 7fd9b7416700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd9b006f210 0x7fd9b0069930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:43.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.352+0000 7fd9b7416700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b00a1580 con 0x7fd9b0069e70 2023-09-29T23:29:43.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.352+0000 7fd9b7416700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b006f5e0 con 0x7fd9b006f210 2023-09-29T23:29:43.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.352+0000 7fd9b51b2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd9b006f210 0x7fd9b0069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:43.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.352+0000 7fd9b49b1700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fd9b0069e70 0x7fd9b012f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:45164/0 (socket says 172.21.15.92:45164) 2023-09-29T23:29:43.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.352+0000 7fd9b49b1700 1 -- 172.21.15.92:0/849370820 learned_addr learned my addr 172.21.15.92:0/849370820 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:29:43.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.353+0000 7fd9b51b2700 1 -- 172.21.15.92:0/849370820 >> v1:172.21.15.92:6789/0 conn(0x7fd9b0069e70 legacy=0x7fd9b012f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:43.354 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.353+0000 7fd9b51b2700 1 -- 172.21.15.92:0/849370820 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b009cc70 con 0x7fd9b006f210 2023-09-29T23:29:43.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.353+0000 7fd9b51b2700 1 --2- 172.21.15.92:0/849370820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9b006f210 0x7fd9b0069930 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac009e30 tx=0x7fd9ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6291f81bb02977cd server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:43.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.353+0000 7fd9a7fff700 1 -- 172.21.15.92:0/849370820 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9ac00e070 con 0x7fd9b006f210 2023-09-29T23:29:43.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.353+0000 7fd9a7fff700 1 -- 172.21.15.92:0/849370820 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ac00bd70 con 0x7fd9b006f210 2023-09-29T23:29:43.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.353+0000 7fd9a7fff700 1 -- 172.21.15.92:0/849370820 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9ac0125b0 con 0x7fd9b006f210 2023-09-29T23:29:43.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.353+0000 7fd9b7416700 1 -- 172.21.15.92:0/849370820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9b006f210 msgr2=0x7fd9b0069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:43.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.353+0000 7fd9b7416700 1 --2- 172.21.15.92:0/849370820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9b006f210 0x7fd9b0069930 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac009e30 tx=0x7fd9ac009780 comp rx=0 tx=0).stop 2023-09-29T23:29:43.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.353+0000 7fd9b7416700 1 -- 172.21.15.92:0/849370820 shutdown_connections 2023-09-29T23:29:43.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.353+0000 7fd9b7416700 1 --2- 172.21.15.92:0/849370820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9b006f210 0x7fd9b0069930 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:43.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.353+0000 7fd9b7416700 1 -- 172.21.15.92:0/849370820 >> 172.21.15.92:0/849370820 conn(0x7fd9b0094a70 msgr2=0x7fd9b006eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:43.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.354+0000 7fd9b7416700 1 -- 172.21.15.92:0/849370820 shutdown_connections 2023-09-29T23:29:43.355 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.354+0000 7fd9b7416700 1 -- 172.21.15.92:0/849370820 wait complete. 2023-09-29T23:29:43.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.354+0000 7fd9b7416700 1 Processor -- start 2023-09-29T23:29:43.357 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.354+0000 7fd9b7416700 1 -- start start 2023-09-29T23:29:43.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.355+0000 7fd9b7416700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9b0069e70 0x7fd9b011bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:43.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.355+0000 7fd9b7416700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b012cc40 con 0x7fd9b0069e70 2023-09-29T23:29:43.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.355+0000 7fd9b51b2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9b0069e70 0x7fd9b011bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:43.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.355+0000 7fd9b51b2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9b0069e70 0x7fd9b011bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35032/0 (socket says 172.21.15.92:35032) 2023-09-29T23:29:43.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.355+0000 7fd9b51b2700 1 -- 172.21.15.92:0/3431569202 learned_addr learned my addr 172.21.15.92:0/3431569202 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:29:43.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.355+0000 7fd9b51b2700 1 -- 172.21.15.92:0/3431569202 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac009a20 con 0x7fd9b0069e70 2023-09-29T23:29:43.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.355+0000 7fd9b51b2700 1 --2- 172.21.15.92:0/3431569202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9b0069e70 0x7fd9b011bcd0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac0099f0 tx=0x7fd9ac018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:43.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.355+0000 7fd9a57fa700 1 -- 172.21.15.92:0/3431569202 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9ac027470 con 0x7fd9b0069e70 2023-09-29T23:29:43.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.355+0000 7fd9a57fa700 1 -- 172.21.15.92:0/3431569202 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ac0275f0 con 0x7fd9b0069e70 2023-09-29T23:29:43.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.355+0000 7fd9a57fa700 1 -- 172.21.15.92:0/3431569202 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9ac0278e0 con 0x7fd9b0069e70 2023-09-29T23:29:43.358 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.355+0000 7fd9b7416700 1 -- 172.21.15.92:0/3431569202 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b011a680 con 0x7fd9b0069e70 2023-09-29T23:29:43.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.356+0000 7fd9b7416700 1 -- 172.21.15.92:0/3431569202 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b011b580 con 0x7fd9b0069e70 2023-09-29T23:29:43.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.356+0000 7fd9a57fa700 1 -- 172.21.15.92:0/3431569202 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fd9ac024070 con 0x7fd9b0069e70 2023-09-29T23:29:43.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.356+0000 7fd9a57fa700 1 --2- 172.21.15.92:0/3431569202 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd994035630 0x7fd994037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:29:43.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.356+0000 7fd9b7416700 1 -- 172.21.15.92:0/3431569202 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b011c4e0 con 0x7fd9b0069e70 2023-09-29T23:29:43.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.356+0000 7fd9a57fa700 1 -- 172.21.15.92:0/3431569202 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fd9ac049d80 con 0x7fd9b0069e70 2023-09-29T23:29:43.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.356+0000 7fd9b49b1700 1 --2- 172.21.15.92:0/3431569202 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd994035630 0x7fd994037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:29:43.359 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.357+0000 7fd9b49b1700 1 --2- 172.21.15.92:0/3431569202 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd994035630 0x7fd994037ae0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0007fd0 tx=0x7fd9a0007b90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:29:43.361 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.361+0000 7fd9a57fa700 1 -- 172.21.15.92:0/3431569202 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9ac01e430 con 0x7fd9b0069e70 2023-09-29T23:29:43.543 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.542+0000 7fd9b7416700 1 -- 172.21.15.92:0/3431569202 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9b005f230 con 0x7fd994035630 2023-09-29T23:29:43.549 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.549+0000 7fd9a57fa700 1 -- 172.21.15.92:0/3431569202 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263600 (secure 0 0 0) 0x7fd9b005f230 con 0x7fd994035630 2023-09-29T23:29:43.552 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:29:43.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.553+0000 7fd9b7416700 1 -- 172.21.15.92:0/3431569202 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd994035630 msgr2=0x7fd994037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:43.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.553+0000 7fd9b7416700 1 --2- 172.21.15.92:0/3431569202 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd994035630 0x7fd994037ae0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0007fd0 tx=0x7fd9a0007b90 comp rx=0 tx=0).stop 2023-09-29T23:29:43.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.553+0000 7fd9b7416700 1 -- 172.21.15.92:0/3431569202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9b0069e70 msgr2=0x7fd9b011bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:29:43.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.553+0000 7fd9b7416700 1 --2- 172.21.15.92:0/3431569202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9b0069e70 0x7fd9b011bcd0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac0099f0 tx=0x7fd9ac018000 comp rx=0 tx=0).stop 2023-09-29T23:29:43.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.553+0000 7fd9b7416700 1 -- 172.21.15.92:0/3431569202 shutdown_connections 2023-09-29T23:29:43.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.553+0000 7fd9b7416700 1 --2- 172.21.15.92:0/3431569202 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fd994035630 0x7fd994037ae0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:43.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.553+0000 7fd9b7416700 1 --2- 172.21.15.92:0/3431569202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9b0069e70 0x7fd9b011bcd0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:29:43.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.553+0000 7fd9b7416700 1 -- 172.21.15.92:0/3431569202 >> 172.21.15.92:0/3431569202 conn(0x7fd9b0094a70 msgr2=0x7fd9b006d080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:29:43.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.553+0000 7fd9b7416700 1 -- 172.21.15.92:0/3431569202 shutdown_connections 2023-09-29T23:29:43.555 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:29:43.553+0000 7fd9b7416700 1 -- 172.21.15.92:0/3431569202 wait complete. 2023-09-29T23:29:43.555 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-09-29T23:29:43.564 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2023-09-29T23:29:42.118657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":208,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":16824,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":16256,"kb_avail":314555976,"statfs":{"total":322122547200,"available":322105319424,"internally_reserved":0,"allocated":557056,"data_stored":160657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16646144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002946"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287388+0000","last_change":"2023-09-29T23:23:45.465624+0000","last_active":"2023-09-29T23:24:37.287388+0000","last_peered":"2023-09-29T23:24:37.287388+0000","last_clean":"2023-09-29T23:24:37.287388+0000","last_became_active":"2023-09-29T23:23:45.464271+0000","last_became_peered":"2023-09-29T23:23:45.464271+0000","last_unstale":"2023-09-29T23:24:37.287388+0000","last_undegraded":"2023-09-29T23:24:37.287388+0000","last_fullsized":"2023-09-29T23:24:37.287388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:03.249509+0000","last_change":"2023-09-29T23:29:03.249480+0000","last_active":"2023-09-29T23:29:03.249509+0000","last_peered":"2023-09-29T23:29:03.249509+0000","last_clean":"2023-09-29T23:29:03.249509+0000","last_became_active":"2023-09-29T23:23:45.466338+0000","last_became_peered":"2023-09-29T23:23:45.466338+0000","last_unstale":"2023-09-29T23:29:03.249509+0000","last_undegraded":"2023-09-29T23:29:03.249509+0000","last_fullsized":"2023-09-29T23:29:03.249509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:03.249418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:03.249418+0000","last_clean_scrub_stamp":"2023-09-29T23:29:03.249418+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:59:00.108261+0000","scrub_duration":0.0011124380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287634+0000","last_change":"2023-09-29T23:23:45.477248+0000","last_active":"2023-09-29T23:24:37.287634+0000","last_peered":"2023-09-29T23:24:37.287634+0000","last_clean":"2023-09-29T23:24:37.287634+0000","last_became_active":"2023-09-29T23:23:45.474129+0000","last_became_peered":"2023-09-29T23:23:45.474129+0000","last_unstale":"2023-09-29T23:24:37.287634+0000","last_undegraded":"2023-09-29T23:24:37.287634+0000","last_fullsized":"2023-09-29T23:24:37.287634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:17.855334+0000","last_change":"2023-09-29T23:29:17.855305+0000","last_active":"2023-09-29T23:29:17.855334+0000","last_peered":"2023-09-29T23:29:17.855334+0000","last_clean":"2023-09-29T23:29:17.855334+0000","last_became_active":"2023-09-29T23:23:45.470971+0000","last_became_peered":"2023-09-29T23:23:45.470971+0000","last_unstale":"2023-09-29T23:29:17.855334+0000","last_undegraded":"2023-09-29T23:29:17.855334+0000","last_fullsized":"2023-09-29T23:29:17.855334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:17.855232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:17.855232+0000","last_clean_scrub_stamp":"2023-09-29T23:29:17.855232+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:07:36.954319+0000","scrub_duration":0.0012669980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286897+0000","last_change":"2023-09-29T23:23:45.473831+0000","last_active":"2023-09-29T23:24:37.286897+0000","last_peered":"2023-09-29T23:24:37.286897+0000","last_clean":"2023-09-29T23:24:37.286897+0000","last_became_active":"2023-09-29T23:23:45.473570+0000","last_became_peered":"2023-09-29T23:23:45.473570+0000","last_unstale":"2023-09-29T23:24:37.286897+0000","last_undegraded":"2023-09-29T23:24:37.286897+0000","last_fullsized":"2023-09-29T23:24:37.286897+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:11.848798+0000","last_change":"2023-09-29T23:29:11.848767+0000","last_active":"2023-09-29T23:29:11.848798+0000","last_peered":"2023-09-29T23:29:11.848798+0000","last_clean":"2023-09-29T23:29:11.848798+0000","last_became_active":"2023-09-29T23:23:45.470349+0000","last_became_peered":"2023-09-29T23:23:45.470349+0000","last_unstale":"2023-09-29T23:29:11.848798+0000","last_undegraded":"2023-09-29T23:29:11.848798+0000","last_fullsized":"2023-09-29T23:29:11.848798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:11.848689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:11.848689+0000","last_clean_scrub_stamp":"2023-09-29T23:29:11.848689+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:18:31.778625+0000","scrub_duration":0.001396563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286523+0000","last_change":"2023-09-29T23:23:45.465376+0000","last_active":"2023-09-29T23:24:37.286523+0000","last_peered":"2023-09-29T23:24:37.286523+0000","last_clean":"2023-09-29T23:24:37.286523+0000","last_became_active":"2023-09-29T23:23:45.464893+0000","last_became_peered":"2023-09-29T23:23:45.464893+0000","last_unstale":"2023-09-29T23:24:37.286523+0000","last_undegraded":"2023-09-29T23:24:37.286523+0000","last_fullsized":"2023-09-29T23:24:37.286523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283288+0000","last_change":"2023-09-29T23:23:45.463286+0000","last_active":"2023-09-29T23:24:37.283288+0000","last_peered":"2023-09-29T23:24:37.283288+0000","last_clean":"2023-09-29T23:24:37.283288+0000","last_became_active":"2023-09-29T23:23:45.462888+0000","last_became_peered":"2023-09-29T23:23:45.462888+0000","last_unstale":"2023-09-29T23:24:37.283288+0000","last_undegraded":"2023-09-29T23:24:37.283288+0000","last_fullsized":"2023-09-29T23:24:37.283288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.282063+0000","last_change":"2023-09-29T23:23:45.468860+0000","last_active":"2023-09-29T23:24:37.282063+0000","last_peered":"2023-09-29T23:24:37.282063+0000","last_clean":"2023-09-29T23:24:37.282063+0000","last_became_active":"2023-09-29T23:23:45.468303+0000","last_became_peered":"2023-09-29T23:23:45.468303+0000","last_unstale":"2023-09-29T23:24:37.282063+0000","last_undegraded":"2023-09-29T23:24:37.282063+0000","last_fullsized":"2023-09-29T23:24:37.282063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.292057+0000","last_change":"2023-09-29T23:24:37.285573+0000","last_active":"2023-09-29T23:24:37.292057+0000","last_peered":"2023-09-29T23:24:37.292057+0000","last_clean":"2023-09-29T23:24:37.292057+0000","last_became_active":"2023-09-29T23:24:37.285339+0000","last_became_peered":"2023-09-29T23:24:37.285339+0000","last_unstale":"2023-09-29T23:24:37.292057+0000","last_undegraded":"2023-09-29T23:24:37.292057+0000","last_fullsized":"2023-09-29T23:24:37.292057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287570+0000","last_change":"2023-09-29T23:23:45.467858+0000","last_active":"2023-09-29T23:24:37.287570+0000","last_peered":"2023-09-29T23:24:37.287570+0000","last_clean":"2023-09-29T23:24:37.287570+0000","last_became_active":"2023-09-29T23:23:45.464083+0000","last_became_peered":"2023-09-29T23:23:45.464083+0000","last_unstale":"2023-09-29T23:24:37.287570+0000","last_undegraded":"2023-09-29T23:24:37.287570+0000","last_fullsized":"2023-09-29T23:24:37.287570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287315+0000","last_change":"2023-09-29T23:23:45.466588+0000","last_active":"2023-09-29T23:24:37.287315+0000","last_peered":"2023-09-29T23:24:37.287315+0000","last_clean":"2023-09-29T23:24:37.287315+0000","last_became_active":"2023-09-29T23:23:45.466161+0000","last_became_peered":"2023-09-29T23:23:45.466161+0000","last_unstale":"2023-09-29T23:24:37.287315+0000","last_undegraded":"2023-09-29T23:24:37.287315+0000","last_fullsized":"2023-09-29T23:24:37.287315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:04.477680+0000","last_change":"2023-09-29T23:29:04.477657+0000","last_active":"2023-09-29T23:29:04.477680+0000","last_peered":"2023-09-29T23:29:04.477680+0000","last_clean":"2023-09-29T23:29:04.477680+0000","last_became_active":"2023-09-29T23:23:45.467178+0000","last_became_peered":"2023-09-29T23:23:45.467178+0000","last_unstale":"2023-09-29T23:29:04.477680+0000","last_undegraded":"2023-09-29T23:29:04.477680+0000","last_fullsized":"2023-09-29T23:29:04.477680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:04.477596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:04.477596+0000","last_clean_scrub_stamp":"2023-09-29T23:29:04.477596+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:49.700926+0000","scrub_duration":0.001119543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:20.545759+0000","last_change":"2023-09-29T23:29:20.545730+0000","last_active":"2023-09-29T23:29:20.545759+0000","last_peered":"2023-09-29T23:29:20.545759+0000","last_clean":"2023-09-29T23:29:20.545759+0000","last_became_active":"2023-09-29T23:23:45.464523+0000","last_became_peered":"2023-09-29T23:23:45.464523+0000","last_unstale":"2023-09-29T23:29:20.545759+0000","last_undegraded":"2023-09-29T23:29:20.545759+0000","last_fullsized":"2023-09-29T23:29:20.545759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:20.545655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:20.545655+0000","last_clean_scrub_stamp":"2023-09-29T23:29:20.545655+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:33:27.694060+0000","scrub_duration":0.0013252279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281097+0000","last_change":"2023-09-29T23:23:45.470349+0000","last_active":"2023-09-29T23:24:37.281097+0000","last_peered":"2023-09-29T23:24:37.281097+0000","last_clean":"2023-09-29T23:24:37.281097+0000","last_became_active":"2023-09-29T23:23:45.467004+0000","last_became_peered":"2023-09-29T23:23:45.467004+0000","last_unstale":"2023-09-29T23:24:37.281097+0000","last_undegraded":"2023-09-29T23:24:37.281097+0000","last_fullsized":"2023-09-29T23:24:37.281097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283339+0000","last_change":"2023-09-29T23:23:45.471536+0000","last_active":"2023-09-29T23:24:37.283339+0000","last_peered":"2023-09-29T23:24:37.283339+0000","last_clean":"2023-09-29T23:24:37.283339+0000","last_became_active":"2023-09-29T23:23:45.471334+0000","last_became_peered":"2023-09-29T23:23:45.471334+0000","last_unstale":"2023-09-29T23:24:37.283339+0000","last_undegraded":"2023-09-29T23:24:37.283339+0000","last_fullsized":"2023-09-29T23:24:37.283339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.282337+0000","last_change":"2023-09-29T23:23:45.468857+0000","last_active":"2023-09-29T23:24:37.282337+0000","last_peered":"2023-09-29T23:24:37.282337+0000","last_clean":"2023-09-29T23:24:37.282337+0000","last_became_active":"2023-09-29T23:23:45.468001+0000","last_became_peered":"2023-09-29T23:23:45.468001+0000","last_unstale":"2023-09-29T23:24:37.282337+0000","last_undegraded":"2023-09-29T23:24:37.282337+0000","last_fullsized":"2023-09-29T23:24:37.282337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283970+0000","last_change":"2023-09-29T23:23:45.467819+0000","last_active":"2023-09-29T23:24:37.283970+0000","last_peered":"2023-09-29T23:24:37.283970+0000","last_clean":"2023-09-29T23:24:37.283970+0000","last_became_active":"2023-09-29T23:23:45.467434+0000","last_became_peered":"2023-09-29T23:23:45.467434+0000","last_unstale":"2023-09-29T23:24:37.283970+0000","last_undegraded":"2023-09-29T23:24:37.283970+0000","last_fullsized":"2023-09-29T23:24:37.283970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287439+0000","last_change":"2023-09-29T23:23:45.473751+0000","last_active":"2023-09-29T23:24:37.287439+0000","last_peered":"2023-09-29T23:24:37.287439+0000","last_clean":"2023-09-29T23:24:37.287439+0000","last_became_active":"2023-09-29T23:23:45.473326+0000","last_became_peered":"2023-09-29T23:23:45.473326+0000","last_unstale":"2023-09-29T23:24:37.287439+0000","last_undegraded":"2023-09-29T23:24:37.287439+0000","last_fullsized":"2023-09-29T23:24:37.287439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:02.476624+0000","last_change":"2023-09-29T23:29:02.476605+0000","last_active":"2023-09-29T23:29:02.476624+0000","last_peered":"2023-09-29T23:29:02.476624+0000","last_clean":"2023-09-29T23:29:02.476624+0000","last_became_active":"2023-09-29T23:23:45.467494+0000","last_became_peered":"2023-09-29T23:23:45.467494+0000","last_unstale":"2023-09-29T23:29:02.476624+0000","last_undegraded":"2023-09-29T23:29:02.476624+0000","last_fullsized":"2023-09-29T23:29:02.476624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:02.476541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:02.476541+0000","last_clean_scrub_stamp":"2023-09-29T23:29:02.476541+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:07:21.575629+0000","scrub_duration":0.0011731350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:06.426368+0000","last_change":"2023-09-29T23:29:06.426326+0000","last_active":"2023-09-29T23:29:06.426368+0000","last_peered":"2023-09-29T23:29:06.426368+0000","last_clean":"2023-09-29T23:29:06.426368+0000","last_became_active":"2023-09-29T23:23:45.477408+0000","last_became_peered":"2023-09-29T23:23:45.477408+0000","last_unstale":"2023-09-29T23:29:06.426368+0000","last_undegraded":"2023-09-29T23:29:06.426368+0000","last_fullsized":"2023-09-29T23:29:06.426368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:06.426255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:06.426255+0000","last_clean_scrub_stamp":"2023-09-29T23:29:06.426255+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:16:36.592771+0000","scrub_duration":0.001349893,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.280950+0000","last_change":"2023-09-29T23:23:45.471232+0000","last_active":"2023-09-29T23:24:37.280950+0000","last_peered":"2023-09-29T23:24:37.280950+0000","last_clean":"2023-09-29T23:24:37.280950+0000","last_became_active":"2023-09-29T23:23:45.470574+0000","last_became_peered":"2023-09-29T23:23:45.470574+0000","last_unstale":"2023-09-29T23:24:37.280950+0000","last_undegraded":"2023-09-29T23:24:37.280950+0000","last_fullsized":"2023-09-29T23:24:37.280950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:07.470966+0000","last_change":"2023-09-29T23:29:07.470936+0000","last_active":"2023-09-29T23:29:07.470966+0000","last_peered":"2023-09-29T23:29:07.470966+0000","last_clean":"2023-09-29T23:29:07.470966+0000","last_became_active":"2023-09-29T23:23:45.473789+0000","last_became_peered":"2023-09-29T23:23:45.473789+0000","last_unstale":"2023-09-29T23:29:07.470966+0000","last_undegraded":"2023-09-29T23:29:07.470966+0000","last_fullsized":"2023-09-29T23:29:07.470966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:07.470870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:07.470870+0000","last_clean_scrub_stamp":"2023-09-29T23:29:07.470870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:35:33.595449+0000","scrub_duration":0.0012289239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:03.460784+0000","last_change":"2023-09-29T23:29:03.460762+0000","last_active":"2023-09-29T23:29:03.460784+0000","last_peered":"2023-09-29T23:29:03.460784+0000","last_clean":"2023-09-29T23:29:03.460784+0000","last_became_active":"2023-09-29T23:23:45.465443+0000","last_became_peered":"2023-09-29T23:23:45.465443+0000","last_unstale":"2023-09-29T23:29:03.460784+0000","last_undegraded":"2023-09-29T23:29:03.460784+0000","last_fullsized":"2023-09-29T23:29:03.460784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:03.460703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:03.460703+0000","last_clean_scrub_stamp":"2023-09-29T23:29:03.460703+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:59:00.319545+0000","scrub_duration":0.00097215699999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283832+0000","last_change":"2023-09-29T23:23:45.458032+0000","last_active":"2023-09-29T23:24:37.283832+0000","last_peered":"2023-09-29T23:24:37.283832+0000","last_clean":"2023-09-29T23:24:37.283832+0000","last_became_active":"2023-09-29T23:23:45.457799+0000","last_became_peered":"2023-09-29T23:23:45.457799+0000","last_unstale":"2023-09-29T23:24:37.283832+0000","last_undegraded":"2023-09-29T23:24:37.283832+0000","last_fullsized":"2023-09-29T23:24:37.283832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:15.837977+0000","last_change":"2023-09-29T23:29:15.837942+0000","last_active":"2023-09-29T23:29:15.837977+0000","last_peered":"2023-09-29T23:29:15.837977+0000","last_clean":"2023-09-29T23:29:15.837977+0000","last_became_active":"2023-09-29T23:23:45.467730+0000","last_became_peered":"2023-09-29T23:23:45.467730+0000","last_unstale":"2023-09-29T23:29:15.837977+0000","last_undegraded":"2023-09-29T23:29:15.837977+0000","last_fullsized":"2023-09-29T23:29:15.837977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:15.837865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:15.837865+0000","last_clean_scrub_stamp":"2023-09-29T23:29:15.837865+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:04:13.297945+0000","scrub_duration":0.001397206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"16'1","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:06.283311+0000","last_change":"2023-09-29T23:29:06.283268+0000","last_active":"2023-09-29T23:29:06.283311+0000","last_peered":"2023-09-29T23:29:06.283311+0000","last_clean":"2023-09-29T23:29:06.283311+0000","last_became_active":"2023-09-29T23:23:45.075848+0000","last_became_peered":"2023-09-29T23:23:45.075848+0000","last_unstale":"2023-09-29T23:29:06.283311+0000","last_undegraded":"2023-09-29T23:29:06.283311+0000","last_fullsized":"2023-09-29T23:29:06.283311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'1","last_scrub_stamp":"2023-09-29T23:29:06.283188+0000","last_deep_scrub":"16'1","last_deep_scrub_stamp":"2023-09-29T23:29:06.283188+0000","last_clean_scrub_stamp":"2023-09-29T23:29:06.283188+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:16:36.449704+0000","scrub_duration":0.0013356450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:04.277638+0000","last_change":"2023-09-29T23:29:04.277614+0000","last_active":"2023-09-29T23:29:04.277638+0000","last_peered":"2023-09-29T23:29:04.277638+0000","last_clean":"2023-09-29T23:29:04.277638+0000","last_became_active":"2023-09-29T23:23:45.462155+0000","last_became_peered":"2023-09-29T23:23:45.462155+0000","last_unstale":"2023-09-29T23:29:04.277638+0000","last_undegraded":"2023-09-29T23:29:04.277638+0000","last_fullsized":"2023-09-29T23:29:04.277638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:04.277542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:04.277542+0000","last_clean_scrub_stamp":"2023-09-29T23:29:04.277542+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:49.500872+0000","scrub_duration":0.0010848310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:22.883137+0000","last_change":"2023-09-29T23:29:22.883103+0000","last_active":"2023-09-29T23:29:22.883137+0000","last_peered":"2023-09-29T23:29:22.883137+0000","last_clean":"2023-09-29T23:29:22.883137+0000","last_became_active":"2023-09-29T23:23:45.092273+0000","last_became_peered":"2023-09-29T23:23:45.092273+0000","last_unstale":"2023-09-29T23:29:22.883137+0000","last_undegraded":"2023-09-29T23:29:22.883137+0000","last_fullsized":"2023-09-29T23:29:22.883137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'1","last_scrub_stamp":"2023-09-29T23:29:22.883002+0000","last_deep_scrub":"16'1","last_deep_scrub_stamp":"2023-09-29T23:29:22.883002+0000","last_clean_scrub_stamp":"2023-09-29T23:29:22.883002+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:35:49.007581+0000","scrub_duration":0.001353417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:37.545175+0000","last_change":"2023-09-29T23:29:37.545146+0000","last_active":"2023-09-29T23:29:37.545175+0000","last_peered":"2023-09-29T23:29:37.545175+0000","last_clean":"2023-09-29T23:29:37.545175+0000","last_became_active":"2023-09-29T23:23:45.464027+0000","last_became_peered":"2023-09-29T23:23:45.464027+0000","last_unstale":"2023-09-29T23:29:37.545175+0000","last_undegraded":"2023-09-29T23:29:37.545175+0000","last_fullsized":"2023-09-29T23:29:37.545175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:37.545065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:37.545065+0000","last_clean_scrub_stamp":"2023-09-29T23:29:37.545065+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:31:27.151684+0000","scrub_duration":0.001339413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286762+0000","last_change":"2023-09-29T23:23:45.088658+0000","last_active":"2023-09-29T23:24:37.286762+0000","last_peered":"2023-09-29T23:24:37.286762+0000","last_clean":"2023-09-29T23:24:37.286762+0000","last_became_active":"2023-09-29T23:23:45.088405+0000","last_became_peered":"2023-09-29T23:23:45.088405+0000","last_unstale":"2023-09-29T23:24:37.286762+0000","last_undegraded":"2023-09-29T23:24:37.286762+0000","last_fullsized":"2023-09-29T23:24:37.286762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:18.842822+0000","last_change":"2023-09-29T23:29:18.842794+0000","last_active":"2023-09-29T23:29:18.842822+0000","last_peered":"2023-09-29T23:29:18.842822+0000","last_clean":"2023-09-29T23:29:18.842822+0000","last_became_active":"2023-09-29T23:23:45.470917+0000","last_became_peered":"2023-09-29T23:23:45.470917+0000","last_unstale":"2023-09-29T23:29:18.842822+0000","last_undegraded":"2023-09-29T23:29:18.842822+0000","last_fullsized":"2023-09-29T23:29:18.842822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:18.842718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:18.842718+0000","last_clean_scrub_stamp":"2023-09-29T23:29:18.842718+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:59:15.701560+0000","scrub_duration":0.0012829569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286548+0000","last_change":"2023-09-29T23:23:45.070764+0000","last_active":"2023-09-29T23:24:37.286548+0000","last_peered":"2023-09-29T23:24:37.286548+0000","last_clean":"2023-09-29T23:24:37.286548+0000","last_became_active":"2023-09-29T23:23:45.070610+0000","last_became_peered":"2023-09-29T23:23:45.070610+0000","last_unstale":"2023-09-29T23:24:37.286548+0000","last_undegraded":"2023-09-29T23:24:37.286548+0000","last_fullsized":"2023-09-29T23:24:37.286548+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:32.058629+0000","last_change":"2023-09-29T23:29:32.058597+0000","last_active":"2023-09-29T23:29:32.058629+0000","last_peered":"2023-09-29T23:29:32.058629+0000","last_clean":"2023-09-29T23:29:32.058629+0000","last_became_active":"2023-09-29T23:23:45.475634+0000","last_became_peered":"2023-09-29T23:23:45.475634+0000","last_unstale":"2023-09-29T23:29:32.058629+0000","last_undegraded":"2023-09-29T23:29:32.058629+0000","last_fullsized":"2023-09-29T23:29:32.058629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:32.058524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:32.058524+0000","last_clean_scrub_stamp":"2023-09-29T23:29:32.058524+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:28:19.384325+0000","scrub_duration":0.0012732959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:16.093276+0000","last_change":"2023-09-29T23:29:16.093250+0000","last_active":"2023-09-29T23:29:16.093276+0000","last_peered":"2023-09-29T23:29:16.093276+0000","last_clean":"2023-09-29T23:29:16.093276+0000","last_became_active":"2023-09-29T23:23:45.091317+0000","last_became_peered":"2023-09-29T23:23:45.091317+0000","last_unstale":"2023-09-29T23:29:16.093276+0000","last_undegraded":"2023-09-29T23:29:16.093276+0000","last_fullsized":"2023-09-29T23:29:16.093276+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:16.093182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:16.093182+0000","last_clean_scrub_stamp":"2023-09-29T23:29:16.093182+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:31:53.593525+0000","scrub_duration":0.001347411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:36.981638+0000","last_change":"2023-09-29T23:29:36.981613+0000","last_active":"2023-09-29T23:29:36.981638+0000","last_peered":"2023-09-29T23:29:36.981638+0000","last_clean":"2023-09-29T23:29:36.981638+0000","last_became_active":"2023-09-29T23:23:45.458585+0000","last_became_peered":"2023-09-29T23:23:45.458585+0000","last_unstale":"2023-09-29T23:29:36.981638+0000","last_undegraded":"2023-09-29T23:29:36.981638+0000","last_fullsized":"2023-09-29T23:29:36.981638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:36.981533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:36.981533+0000","last_clean_scrub_stamp":"2023-09-29T23:29:36.981533+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:12:03.229046+0000","scrub_duration":0.001333363,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287376+0000","last_change":"2023-09-29T23:23:45.071269+0000","last_active":"2023-09-29T23:24:37.287376+0000","last_peered":"2023-09-29T23:24:37.287376+0000","last_clean":"2023-09-29T23:24:37.287376+0000","last_became_active":"2023-09-29T23:23:45.070986+0000","last_became_peered":"2023-09-29T23:23:45.070986+0000","last_unstale":"2023-09-29T23:24:37.287376+0000","last_undegraded":"2023-09-29T23:24:37.287376+0000","last_fullsized":"2023-09-29T23:24:37.287376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287222+0000","last_change":"2023-09-29T23:23:45.464917+0000","last_active":"2023-09-29T23:24:37.287222+0000","last_peered":"2023-09-29T23:24:37.287222+0000","last_clean":"2023-09-29T23:24:37.287222+0000","last_became_active":"2023-09-29T23:23:45.464510+0000","last_became_peered":"2023-09-29T23:23:45.464510+0000","last_unstale":"2023-09-29T23:24:37.287222+0000","last_undegraded":"2023-09-29T23:24:37.287222+0000","last_fullsized":"2023-09-29T23:24:37.287222+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'5","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:20.978198+0000","last_change":"2023-09-29T23:29:20.978161+0000","last_active":"2023-09-29T23:29:20.978198+0000","last_peered":"2023-09-29T23:29:20.978198+0000","last_clean":"2023-09-29T23:29:20.978198+0000","last_became_active":"2023-09-29T23:23:45.076856+0000","last_became_peered":"2023-09-29T23:23:45.076856+0000","last_unstale":"2023-09-29T23:29:20.978198+0000","last_undegraded":"2023-09-29T23:29:20.978198+0000","last_fullsized":"2023-09-29T23:29:20.978198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2023-09-29T23:29:20.978063+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2023-09-29T23:29:20.978063+0000","last_clean_scrub_stamp":"2023-09-29T23:29:20.978063+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:43:25.681012+0000","scrub_duration":0.002692945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:22.024275+0000","last_change":"2023-09-29T23:29:22.024242+0000","last_active":"2023-09-29T23:29:22.024275+0000","last_peered":"2023-09-29T23:29:22.024275+0000","last_clean":"2023-09-29T23:29:22.024275+0000","last_became_active":"2023-09-29T23:23:45.461199+0000","last_became_peered":"2023-09-29T23:23:45.461199+0000","last_unstale":"2023-09-29T23:29:22.024275+0000","last_undegraded":"2023-09-29T23:29:22.024275+0000","last_fullsized":"2023-09-29T23:29:22.024275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:22.024151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:22.024151+0000","last_clean_scrub_stamp":"2023-09-29T23:29:22.024151+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:13:23.585922+0000","scrub_duration":0.001280705,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"19'10","reported_seq":33,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:35.954350+0000","last_change":"2023-09-29T23:29:35.954319+0000","last_active":"2023-09-29T23:29:35.954350+0000","last_peered":"2023-09-29T23:29:35.954350+0000","last_clean":"2023-09-29T23:29:35.954350+0000","last_became_active":"2023-09-29T23:23:45.093487+0000","last_became_peered":"2023-09-29T23:23:45.093487+0000","last_unstale":"2023-09-29T23:29:35.954350+0000","last_undegraded":"2023-09-29T23:29:35.954350+0000","last_fullsized":"2023-09-29T23:29:35.954350+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'10","last_scrub_stamp":"2023-09-29T23:29:35.954248+0000","last_deep_scrub":"19'10","last_deep_scrub_stamp":"2023-09-29T23:29:35.954248+0000","last_clean_scrub_stamp":"2023-09-29T23:29:35.954248+0000","objects_scrubbed":4,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:33:43.102652+0000","scrub_duration":0.0072578629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:32.588353+0000","last_change":"2023-09-29T23:29:32.588319+0000","last_active":"2023-09-29T23:29:32.588353+0000","last_peered":"2023-09-29T23:29:32.588353+0000","last_clean":"2023-09-29T23:29:32.588353+0000","last_became_active":"2023-09-29T23:23:45.466667+0000","last_became_peered":"2023-09-29T23:23:45.466667+0000","last_unstale":"2023-09-29T23:29:32.588353+0000","last_undegraded":"2023-09-29T23:29:32.588353+0000","last_fullsized":"2023-09-29T23:29:32.588353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:32.588241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:32.588241+0000","last_clean_scrub_stamp":"2023-09-29T23:29:32.588241+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:40:31.970519+0000","scrub_duration":0.001381953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287078+0000","last_change":"2023-09-29T23:23:45.089727+0000","last_active":"2023-09-29T23:24:37.287078+0000","last_peered":"2023-09-29T23:24:37.287078+0000","last_clean":"2023-09-29T23:24:37.287078+0000","last_became_active":"2023-09-29T23:23:45.089450+0000","last_became_peered":"2023-09-29T23:23:45.089450+0000","last_unstale":"2023-09-29T23:24:37.287078+0000","last_undegraded":"2023-09-29T23:24:37.287078+0000","last_fullsized":"2023-09-29T23:24:37.287078+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286785+0000","last_change":"2023-09-29T23:23:45.468316+0000","last_active":"2023-09-29T23:24:37.286785+0000","last_peered":"2023-09-29T23:24:37.286785+0000","last_clean":"2023-09-29T23:24:37.286785+0000","last_became_active":"2023-09-29T23:23:45.464801+0000","last_became_peered":"2023-09-29T23:23:45.464801+0000","last_unstale":"2023-09-29T23:24:37.286785+0000","last_undegraded":"2023-09-29T23:24:37.286785+0000","last_fullsized":"2023-09-29T23:24:37.286785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:37.951615+0000","last_change":"2023-09-29T23:29:37.951590+0000","last_active":"2023-09-29T23:29:37.951615+0000","last_peered":"2023-09-29T23:29:37.951615+0000","last_clean":"2023-09-29T23:29:37.951615+0000","last_became_active":"2023-09-29T23:23:45.092902+0000","last_became_peered":"2023-09-29T23:23:45.092902+0000","last_unstale":"2023-09-29T23:29:37.951615+0000","last_undegraded":"2023-09-29T23:29:37.951615+0000","last_fullsized":"2023-09-29T23:29:37.951615+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:37.951522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:37.951522+0000","last_clean_scrub_stamp":"2023-09-29T23:29:37.951522+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:13:39.513294+0000","scrub_duration":0.0012267249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:30.055361+0000","last_change":"2023-09-29T23:29:30.055315+0000","last_active":"2023-09-29T23:29:30.055361+0000","last_peered":"2023-09-29T23:29:30.055361+0000","last_clean":"2023-09-29T23:29:30.055361+0000","last_became_active":"2023-09-29T23:23:45.465743+0000","last_became_peered":"2023-09-29T23:23:45.465743+0000","last_unstale":"2023-09-29T23:29:30.055361+0000","last_undegraded":"2023-09-29T23:29:30.055361+0000","last_fullsized":"2023-09-29T23:29:30.055361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:30.055241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:30.055241+0000","last_clean_scrub_stamp":"2023-09-29T23:29:30.055241+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:37:44.486033+0000","scrub_duration":0.001322852,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286677+0000","last_change":"2023-09-29T23:23:45.072234+0000","last_active":"2023-09-29T23:24:37.286677+0000","last_peered":"2023-09-29T23:24:37.286677+0000","last_clean":"2023-09-29T23:24:37.286677+0000","last_became_active":"2023-09-29T23:23:45.072009+0000","last_became_peered":"2023-09-29T23:23:45.072009+0000","last_unstale":"2023-09-29T23:24:37.286677+0000","last_undegraded":"2023-09-29T23:24:37.286677+0000","last_fullsized":"2023-09-29T23:24:37.286677+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:36.169278+0000","last_change":"2023-09-29T23:29:36.169248+0000","last_active":"2023-09-29T23:29:36.169278+0000","last_peered":"2023-09-29T23:29:36.169278+0000","last_clean":"2023-09-29T23:29:36.169278+0000","last_became_active":"2023-09-29T23:23:45.466169+0000","last_became_peered":"2023-09-29T23:23:45.466169+0000","last_unstale":"2023-09-29T23:29:36.169278+0000","last_undegraded":"2023-09-29T23:29:36.169278+0000","last_fullsized":"2023-09-29T23:29:36.169278+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:36.169178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:36.169178+0000","last_clean_scrub_stamp":"2023-09-29T23:29:36.169178+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:19:28.821242+0000","scrub_duration":0.001334238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"16'8","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283640+0000","last_change":"2023-09-29T23:23:45.091762+0000","last_active":"2023-09-29T23:24:37.283640+0000","last_peered":"2023-09-29T23:24:37.283640+0000","last_clean":"2023-09-29T23:24:37.283640+0000","last_became_active":"2023-09-29T23:23:45.091386+0000","last_became_peered":"2023-09-29T23:23:45.091386+0000","last_unstale":"2023-09-29T23:24:37.283640+0000","last_undegraded":"2023-09-29T23:24:37.283640+0000","last_fullsized":"2023-09-29T23:24:37.283640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:05.861334+0000","last_change":"2023-09-29T23:29:05.861311+0000","last_active":"2023-09-29T23:29:05.861334+0000","last_peered":"2023-09-29T23:29:05.861334+0000","last_clean":"2023-09-29T23:29:05.861334+0000","last_became_active":"2023-09-29T23:23:45.460643+0000","last_became_peered":"2023-09-29T23:23:45.460643+0000","last_unstale":"2023-09-29T23:29:05.861334+0000","last_undegraded":"2023-09-29T23:29:05.861334+0000","last_fullsized":"2023-09-29T23:29:05.861334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:05.861236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:05.861236+0000","last_clean_scrub_stamp":"2023-09-29T23:29:05.861236+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:01:12.962284+0000","scrub_duration":0.0013132969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"16'1","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287157+0000","last_change":"2023-09-29T23:23:45.078091+0000","last_active":"2023-09-29T23:24:37.287157+0000","last_peered":"2023-09-29T23:24:37.287157+0000","last_clean":"2023-09-29T23:24:37.287157+0000","last_became_active":"2023-09-29T23:23:45.077734+0000","last_became_peered":"2023-09-29T23:23:45.077734+0000","last_unstale":"2023-09-29T23:24:37.287157+0000","last_undegraded":"2023-09-29T23:24:37.287157+0000","last_fullsized":"2023-09-29T23:24:37.287157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:21.923919+0000","last_change":"2023-09-29T23:29:21.923888+0000","last_active":"2023-09-29T23:29:21.923919+0000","last_peered":"2023-09-29T23:29:21.923919+0000","last_clean":"2023-09-29T23:29:21.923919+0000","last_became_active":"2023-09-29T23:23:45.467555+0000","last_became_peered":"2023-09-29T23:23:45.467555+0000","last_unstale":"2023-09-29T23:29:21.923919+0000","last_undegraded":"2023-09-29T23:29:21.923919+0000","last_fullsized":"2023-09-29T23:29:21.923919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:21.923791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:21.923791+0000","last_clean_scrub_stamp":"2023-09-29T23:29:21.923791+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:16:52.090307+0000","scrub_duration":0.0011468419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"16'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.284121+0000","last_change":"2023-09-29T23:23:45.092471+0000","last_active":"2023-09-29T23:24:37.284121+0000","last_peered":"2023-09-29T23:24:37.284121+0000","last_clean":"2023-09-29T23:24:37.284121+0000","last_became_active":"2023-09-29T23:23:45.092185+0000","last_became_peered":"2023-09-29T23:23:45.092185+0000","last_unstale":"2023-09-29T23:24:37.284121+0000","last_undegraded":"2023-09-29T23:24:37.284121+0000","last_fullsized":"2023-09-29T23:24:37.284121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:30.603213+0000","last_change":"2023-09-29T23:29:30.603186+0000","last_active":"2023-09-29T23:29:30.603213+0000","last_peered":"2023-09-29T23:29:30.603213+0000","last_clean":"2023-09-29T23:29:30.603213+0000","last_became_active":"2023-09-29T23:23:45.463806+0000","last_became_peered":"2023-09-29T23:23:45.463806+0000","last_unstale":"2023-09-29T23:29:30.603213+0000","last_undegraded":"2023-09-29T23:29:30.603213+0000","last_fullsized":"2023-09-29T23:29:30.603213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:30.603106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:30.603106+0000","last_clean_scrub_stamp":"2023-09-29T23:29:30.603106+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:58:06.609302+0000","scrub_duration":0.001486621,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'2","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:25.020656+0000","last_change":"2023-09-29T23:29:25.020628+0000","last_active":"2023-09-29T23:29:25.020656+0000","last_peered":"2023-09-29T23:29:25.020656+0000","last_clean":"2023-09-29T23:29:25.020656+0000","last_became_active":"2023-09-29T23:23:45.088535+0000","last_became_peered":"2023-09-29T23:23:45.088535+0000","last_unstale":"2023-09-29T23:29:25.020656+0000","last_undegraded":"2023-09-29T23:29:25.020656+0000","last_fullsized":"2023-09-29T23:29:25.020656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2023-09-29T23:29:25.020562+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2023-09-29T23:29:25.020562+0000","last_clean_scrub_stamp":"2023-09-29T23:29:25.020562+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:48:08.201258+0000","scrub_duration":0.0023368690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:22.533037+0000","last_change":"2023-09-29T23:29:22.533013+0000","last_active":"2023-09-29T23:29:22.533037+0000","last_peered":"2023-09-29T23:29:22.533037+0000","last_clean":"2023-09-29T23:29:22.533037+0000","last_became_active":"2023-09-29T23:23:45.465855+0000","last_became_peered":"2023-09-29T23:23:45.465855+0000","last_unstale":"2023-09-29T23:29:22.533037+0000","last_undegraded":"2023-09-29T23:29:22.533037+0000","last_fullsized":"2023-09-29T23:29:22.533037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:22.532933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:22.532933+0000","last_clean_scrub_stamp":"2023-09-29T23:29:22.532933+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:13:24.094704+0000","scrub_duration":0.001327693,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283914+0000","last_change":"2023-09-29T23:23:45.092714+0000","last_active":"2023-09-29T23:24:37.283914+0000","last_peered":"2023-09-29T23:24:37.283914+0000","last_clean":"2023-09-29T23:24:37.283914+0000","last_became_active":"2023-09-29T23:23:45.092476+0000","last_became_peered":"2023-09-29T23:23:45.092476+0000","last_unstale":"2023-09-29T23:24:37.283914+0000","last_undegraded":"2023-09-29T23:24:37.283914+0000","last_fullsized":"2023-09-29T23:24:37.283914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281635+0000","last_change":"2023-09-29T23:23:45.467010+0000","last_active":"2023-09-29T23:24:37.281635+0000","last_peered":"2023-09-29T23:24:37.281635+0000","last_clean":"2023-09-29T23:24:37.281635+0000","last_became_active":"2023-09-29T23:23:45.466694+0000","last_became_peered":"2023-09-29T23:23:45.466694+0000","last_unstale":"2023-09-29T23:24:37.281635+0000","last_undegraded":"2023-09-29T23:24:37.281635+0000","last_fullsized":"2023-09-29T23:24:37.281635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"16'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287019+0000","last_change":"2023-09-29T23:23:45.089622+0000","last_active":"2023-09-29T23:24:37.287019+0000","last_peered":"2023-09-29T23:24:37.287019+0000","last_clean":"2023-09-29T23:24:37.287019+0000","last_became_active":"2023-09-29T23:23:45.089176+0000","last_became_peered":"2023-09-29T23:23:45.089176+0000","last_unstale":"2023-09-29T23:24:37.287019+0000","last_undegraded":"2023-09-29T23:24:37.287019+0000","last_fullsized":"2023-09-29T23:24:37.287019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:27.538075+0000","last_change":"2023-09-29T23:29:27.538029+0000","last_active":"2023-09-29T23:29:27.538075+0000","last_peered":"2023-09-29T23:29:27.538075+0000","last_clean":"2023-09-29T23:29:27.538075+0000","last_became_active":"2023-09-29T23:23:45.465127+0000","last_became_peered":"2023-09-29T23:23:45.465127+0000","last_unstale":"2023-09-29T23:29:27.538075+0000","last_undegraded":"2023-09-29T23:29:27.538075+0000","last_fullsized":"2023-09-29T23:29:27.538075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:27.537939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:27.537939+0000","last_clean_scrub_stamp":"2023-09-29T23:29:27.537939+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:00:35.594777+0000","scrub_duration":0.00147858,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:31.072328+0000","last_change":"2023-09-29T23:29:31.072300+0000","last_active":"2023-09-29T23:29:31.072328+0000","last_peered":"2023-09-29T23:29:31.072328+0000","last_clean":"2023-09-29T23:29:31.072328+0000","last_became_active":"2023-09-29T23:23:45.075313+0000","last_became_peered":"2023-09-29T23:23:45.075313+0000","last_unstale":"2023-09-29T23:29:31.072328+0000","last_undegraded":"2023-09-29T23:29:31.072328+0000","last_fullsized":"2023-09-29T23:29:31.072328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:31.072231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:31.072231+0000","last_clean_scrub_stamp":"2023-09-29T23:29:31.072231+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:58:07.078428+0000","scrub_duration":0.001297475,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:20.010506+0000","last_change":"2023-09-29T23:29:20.010458+0000","last_active":"2023-09-29T23:29:20.010506+0000","last_peered":"2023-09-29T23:29:20.010506+0000","last_clean":"2023-09-29T23:29:20.010506+0000","last_became_active":"2023-09-29T23:24:37.288220+0000","last_became_peered":"2023-09-29T23:24:37.288220+0000","last_unstale":"2023-09-29T23:29:20.010506+0000","last_undegraded":"2023-09-29T23:29:20.010506+0000","last_fullsized":"2023-09-29T23:29:20.010506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:20.010379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:20.010379+0000","last_clean_scrub_stamp":"2023-09-29T23:29:20.010379+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:33:27.158783+0000","scrub_duration":0.0012507110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:34.135079+0000","last_change":"2023-09-29T23:29:34.135052+0000","last_active":"2023-09-29T23:29:34.135079+0000","last_peered":"2023-09-29T23:29:34.135079+0000","last_clean":"2023-09-29T23:29:34.135079+0000","last_became_active":"2023-09-29T23:23:45.075772+0000","last_became_peered":"2023-09-29T23:23:45.075772+0000","last_unstale":"2023-09-29T23:29:34.135079+0000","last_undegraded":"2023-09-29T23:29:34.135079+0000","last_fullsized":"2023-09-29T23:29:34.135079+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:34.134977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:34.134977+0000","last_clean_scrub_stamp":"2023-09-29T23:29:34.134977+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:55:00.205293+0000","scrub_duration":0.0011951520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283383+0000","last_change":"2023-09-29T23:23:45.463124+0000","last_active":"2023-09-29T23:24:37.283383+0000","last_peered":"2023-09-29T23:24:37.283383+0000","last_clean":"2023-09-29T23:24:37.283383+0000","last_became_active":"2023-09-29T23:23:45.462583+0000","last_became_peered":"2023-09-29T23:23:45.462583+0000","last_unstale":"2023-09-29T23:24:37.283383+0000","last_undegraded":"2023-09-29T23:24:37.283383+0000","last_fullsized":"2023-09-29T23:24:37.283383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286442+0000","last_change":"2023-09-29T23:23:45.088750+0000","last_active":"2023-09-29T23:24:37.286442+0000","last_peered":"2023-09-29T23:24:37.286442+0000","last_clean":"2023-09-29T23:24:37.286442+0000","last_became_active":"2023-09-29T23:23:45.088506+0000","last_became_peered":"2023-09-29T23:23:45.088506+0000","last_unstale":"2023-09-29T23:24:37.286442+0000","last_undegraded":"2023-09-29T23:24:37.286442+0000","last_fullsized":"2023-09-29T23:24:37.286442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:25.556018+0000","last_change":"2023-09-29T23:29:25.555980+0000","last_active":"2023-09-29T23:29:25.556018+0000","last_peered":"2023-09-29T23:29:25.556018+0000","last_clean":"2023-09-29T23:29:25.556018+0000","last_became_active":"2023-09-29T23:23:45.477335+0000","last_became_peered":"2023-09-29T23:23:45.477335+0000","last_unstale":"2023-09-29T23:29:25.556018+0000","last_undegraded":"2023-09-29T23:29:25.556018+0000","last_fullsized":"2023-09-29T23:29:25.556018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:25.555859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:25.555859+0000","last_clean_scrub_stamp":"2023-09-29T23:29:25.555859+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:48:08.736556+0000","scrub_duration":0.001410761,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283916+0000","last_change":"2023-09-29T23:23:41.047954+0000","last_active":"2023-09-29T23:24:37.283916+0000","last_peered":"2023-09-29T23:24:37.283916+0000","last_clean":"2023-09-29T23:24:37.283916+0000","last_became_active":"2023-09-29T23:23:41.047701+0000","last_became_peered":"2023-09-29T23:23:41.047701+0000","last_unstale":"2023-09-29T23:24:37.283916+0000","last_undegraded":"2023-09-29T23:24:37.283916+0000","last_fullsized":"2023-09-29T23:24:37.283916+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"17'1","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281983+0000","last_change":"2023-09-29T23:23:45.075607+0000","last_active":"2023-09-29T23:24:37.281983+0000","last_peered":"2023-09-29T23:24:37.281983+0000","last_clean":"2023-09-29T23:24:37.281983+0000","last_became_active":"2023-09-29T23:23:45.075249+0000","last_became_peered":"2023-09-29T23:23:45.075249+0000","last_unstale":"2023-09-29T23:24:37.281983+0000","last_undegraded":"2023-09-29T23:24:37.281983+0000","last_fullsized":"2023-09-29T23:24:37.281983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283910+0000","last_change":"2023-09-29T23:23:45.460164+0000","last_active":"2023-09-29T23:24:37.283910+0000","last_peered":"2023-09-29T23:24:37.283910+0000","last_clean":"2023-09-29T23:24:37.283910+0000","last_became_active":"2023-09-29T23:23:45.459933+0000","last_became_peered":"2023-09-29T23:23:45.459933+0000","last_unstale":"2023-09-29T23:24:37.283910+0000","last_undegraded":"2023-09-29T23:24:37.283910+0000","last_fullsized":"2023-09-29T23:24:37.283910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281338+0000","last_change":"2023-09-29T23:23:41.051640+0000","last_active":"2023-09-29T23:24:37.281338+0000","last_peered":"2023-09-29T23:24:37.281338+0000","last_clean":"2023-09-29T23:24:37.281338+0000","last_became_active":"2023-09-29T23:23:41.051398+0000","last_became_peered":"2023-09-29T23:23:41.051398+0000","last_unstale":"2023-09-29T23:24:37.281338+0000","last_undegraded":"2023-09-29T23:24:37.281338+0000","last_fullsized":"2023-09-29T23:24:37.281338+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"16'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.282142+0000","last_change":"2023-09-29T23:23:45.076540+0000","last_active":"2023-09-29T23:24:37.282142+0000","last_peered":"2023-09-29T23:24:37.282142+0000","last_clean":"2023-09-29T23:24:37.282142+0000","last_became_active":"2023-09-29T23:23:45.076293+0000","last_became_peered":"2023-09-29T23:23:45.076293+0000","last_unstale":"2023-09-29T23:24:37.282142+0000","last_undegraded":"2023-09-29T23:24:37.282142+0000","last_fullsized":"2023-09-29T23:24:37.282142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:29.587702+0000","last_change":"2023-09-29T23:29:29.587659+0000","last_active":"2023-09-29T23:29:29.587702+0000","last_peered":"2023-09-29T23:29:29.587702+0000","last_clean":"2023-09-29T23:29:29.587702+0000","last_became_active":"2023-09-29T23:23:45.466115+0000","last_became_peered":"2023-09-29T23:23:45.466115+0000","last_unstale":"2023-09-29T23:29:29.587702+0000","last_undegraded":"2023-09-29T23:29:29.587702+0000","last_fullsized":"2023-09-29T23:29:29.587702+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:29.587583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:29.587583+0000","last_clean_scrub_stamp":"2023-09-29T23:29:29.587583+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:37:44.018376+0000","scrub_duration":0.001426788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281002+0000","last_change":"2023-09-29T23:23:41.050066+0000","last_active":"2023-09-29T23:24:37.281002+0000","last_peered":"2023-09-29T23:24:37.281002+0000","last_clean":"2023-09-29T23:24:37.281002+0000","last_became_active":"2023-09-29T23:23:41.049786+0000","last_became_peered":"2023-09-29T23:23:41.049786+0000","last_unstale":"2023-09-29T23:24:37.281002+0000","last_undegraded":"2023-09-29T23:24:37.281002+0000","last_fullsized":"2023-09-29T23:24:37.281002+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283572+0000","last_change":"2023-09-29T23:23:45.091590+0000","last_active":"2023-09-29T23:24:37.283572+0000","last_peered":"2023-09-29T23:24:37.283572+0000","last_clean":"2023-09-29T23:24:37.283572+0000","last_became_active":"2023-09-29T23:23:45.091162+0000","last_became_peered":"2023-09-29T23:23:45.091162+0000","last_unstale":"2023-09-29T23:24:37.283572+0000","last_undegraded":"2023-09-29T23:24:37.283572+0000","last_fullsized":"2023-09-29T23:24:37.283572+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:35.597361+0000","last_change":"2023-09-29T23:29:35.597332+0000","last_active":"2023-09-29T23:29:35.597361+0000","last_peered":"2023-09-29T23:29:35.597361+0000","last_clean":"2023-09-29T23:29:35.597361+0000","last_became_active":"2023-09-29T23:23:45.473861+0000","last_became_peered":"2023-09-29T23:23:45.473861+0000","last_unstale":"2023-09-29T23:29:35.597361+0000","last_undegraded":"2023-09-29T23:29:35.597361+0000","last_fullsized":"2023-09-29T23:29:35.597361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:35.597256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:35.597256+0000","last_clean_scrub_stamp":"2023-09-29T23:29:35.597256+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:19:28.249320+0000","scrub_duration":0.001352902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286677+0000","last_change":"2023-09-29T23:23:41.049685+0000","last_active":"2023-09-29T23:24:37.286677+0000","last_peered":"2023-09-29T23:24:37.286677+0000","last_clean":"2023-09-29T23:24:37.286677+0000","last_became_active":"2023-09-29T23:23:41.049442+0000","last_became_peered":"2023-09-29T23:23:41.049442+0000","last_unstale":"2023-09-29T23:24:37.286677+0000","last_undegraded":"2023-09-29T23:24:37.286677+0000","last_fullsized":"2023-09-29T23:24:37.286677+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283453+0000","last_change":"2023-09-29T23:23:45.092293+0000","last_active":"2023-09-29T23:24:37.283453+0000","last_peered":"2023-09-29T23:24:37.283453+0000","last_clean":"2023-09-29T23:24:37.283453+0000","last_became_active":"2023-09-29T23:23:45.092042+0000","last_became_peered":"2023-09-29T23:23:45.092042+0000","last_unstale":"2023-09-29T23:24:37.283453+0000","last_undegraded":"2023-09-29T23:24:37.283453+0000","last_fullsized":"2023-09-29T23:24:37.283453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.280857+0000","last_change":"2023-09-29T23:23:45.461917+0000","last_active":"2023-09-29T23:24:37.280857+0000","last_peered":"2023-09-29T23:24:37.280857+0000","last_clean":"2023-09-29T23:24:37.280857+0000","last_became_active":"2023-09-29T23:23:45.461228+0000","last_became_peered":"2023-09-29T23:23:45.461228+0000","last_unstale":"2023-09-29T23:24:37.280857+0000","last_undegraded":"2023-09-29T23:24:37.280857+0000","last_fullsized":"2023-09-29T23:24:37.280857+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.280771+0000","last_change":"2023-09-29T23:23:41.051041+0000","last_active":"2023-09-29T23:24:37.280771+0000","last_peered":"2023-09-29T23:24:37.280771+0000","last_clean":"2023-09-29T23:24:37.280771+0000","last_became_active":"2023-09-29T23:23:41.050731+0000","last_became_peered":"2023-09-29T23:23:41.050731+0000","last_unstale":"2023-09-29T23:24:37.280771+0000","last_undegraded":"2023-09-29T23:24:37.280771+0000","last_fullsized":"2023-09-29T23:24:37.280771+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.280998+0000","last_change":"2023-09-29T23:23:45.088759+0000","last_active":"2023-09-29T23:24:37.280998+0000","last_peered":"2023-09-29T23:24:37.280998+0000","last_clean":"2023-09-29T23:24:37.280998+0000","last_became_active":"2023-09-29T23:23:45.088510+0000","last_became_peered":"2023-09-29T23:23:45.088510+0000","last_unstale":"2023-09-29T23:24:37.280998+0000","last_undegraded":"2023-09-29T23:24:37.280998+0000","last_fullsized":"2023-09-29T23:24:37.280998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:02.256509+0000","last_change":"2023-09-29T23:29:02.256478+0000","last_active":"2023-09-29T23:29:02.256509+0000","last_peered":"2023-09-29T23:29:02.256509+0000","last_clean":"2023-09-29T23:29:02.256509+0000","last_became_active":"2023-09-29T23:23:45.461672+0000","last_became_peered":"2023-09-29T23:23:45.461672+0000","last_unstale":"2023-09-29T23:29:02.256509+0000","last_undegraded":"2023-09-29T23:29:02.256509+0000","last_fullsized":"2023-09-29T23:29:02.256509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:02.256385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:02.256385+0000","last_clean_scrub_stamp":"2023-09-29T23:29:02.256385+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:07:21.355472+0000","scrub_duration":0.0012288970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:40.998542+0000","last_change":"2023-09-29T23:29:40.998515+0000","last_active":"2023-09-29T23:29:40.998542+0000","last_peered":"2023-09-29T23:29:40.998542+0000","last_clean":"2023-09-29T23:29:40.998542+0000","last_became_active":"2023-09-29T23:23:41.046803+0000","last_became_peered":"2023-09-29T23:23:41.046803+0000","last_unstale":"2023-09-29T23:29:40.998542+0000","last_undegraded":"2023-09-29T23:29:40.998542+0000","last_fullsized":"2023-09-29T23:29:40.998542+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:40.998440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:40.998440+0000","last_clean_scrub_stamp":"2023-09-29T23:29:40.998440+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:39:47.280530+0000","scrub_duration":0.0015252709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286695+0000","last_change":"2023-09-29T23:23:45.073226+0000","last_active":"2023-09-29T23:24:37.286695+0000","last_peered":"2023-09-29T23:24:37.286695+0000","last_clean":"2023-09-29T23:24:37.286695+0000","last_became_active":"2023-09-29T23:23:45.072973+0000","last_became_peered":"2023-09-29T23:23:45.072973+0000","last_unstale":"2023-09-29T23:24:37.286695+0000","last_undegraded":"2023-09-29T23:24:37.286695+0000","last_fullsized":"2023-09-29T23:24:37.286695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:31.558487+0000","last_change":"2023-09-29T23:29:31.558456+0000","last_active":"2023-09-29T23:29:31.558487+0000","last_peered":"2023-09-29T23:29:31.558487+0000","last_clean":"2023-09-29T23:29:31.558487+0000","last_became_active":"2023-09-29T23:23:45.474318+0000","last_became_peered":"2023-09-29T23:23:45.474318+0000","last_unstale":"2023-09-29T23:29:31.558487+0000","last_undegraded":"2023-09-29T23:29:31.558487+0000","last_fullsized":"2023-09-29T23:29:31.558487+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:31.558347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:31.558347+0000","last_clean_scrub_stamp":"2023-09-29T23:29:31.558347+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:28:18.884148+0000","scrub_duration":0.0014565979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.282064+0000","last_change":"2023-09-29T23:23:41.050883+0000","last_active":"2023-09-29T23:24:37.282064+0000","last_peered":"2023-09-29T23:24:37.282064+0000","last_clean":"2023-09-29T23:24:37.282064+0000","last_became_active":"2023-09-29T23:23:41.050639+0000","last_became_peered":"2023-09-29T23:23:41.050639+0000","last_unstale":"2023-09-29T23:24:37.282064+0000","last_undegraded":"2023-09-29T23:24:37.282064+0000","last_fullsized":"2023-09-29T23:24:37.282064+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281476+0000","last_change":"2023-09-29T23:23:45.077040+0000","last_active":"2023-09-29T23:24:37.281476+0000","last_peered":"2023-09-29T23:24:37.281476+0000","last_clean":"2023-09-29T23:24:37.281476+0000","last_became_active":"2023-09-29T23:23:45.076806+0000","last_became_peered":"2023-09-29T23:23:45.076806+0000","last_unstale":"2023-09-29T23:24:37.281476+0000","last_undegraded":"2023-09-29T23:24:37.281476+0000","last_fullsized":"2023-09-29T23:24:37.281476+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:07.259573+0000","last_change":"2023-09-29T23:29:07.259539+0000","last_active":"2023-09-29T23:29:07.259573+0000","last_peered":"2023-09-29T23:29:07.259573+0000","last_clean":"2023-09-29T23:29:07.259573+0000","last_became_active":"2023-09-29T23:23:45.460913+0000","last_became_peered":"2023-09-29T23:23:45.460913+0000","last_unstale":"2023-09-29T23:29:07.259573+0000","last_undegraded":"2023-09-29T23:29:07.259573+0000","last_fullsized":"2023-09-29T23:29:07.259573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:07.259462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:07.259462+0000","last_clean_scrub_stamp":"2023-09-29T23:29:07.259462+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:35:33.384041+0000","scrub_duration":0.001325735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.282135+0000","last_change":"2023-09-29T23:23:41.050074+0000","last_active":"2023-09-29T23:24:37.282135+0000","last_peered":"2023-09-29T23:24:37.282135+0000","last_clean":"2023-09-29T23:24:37.282135+0000","last_became_active":"2023-09-29T23:23:41.049783+0000","last_became_peered":"2023-09-29T23:23:41.049783+0000","last_unstale":"2023-09-29T23:24:37.282135+0000","last_undegraded":"2023-09-29T23:24:37.282135+0000","last_fullsized":"2023-09-29T23:24:37.282135+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281543+0000","last_change":"2023-09-29T23:23:45.076087+0000","last_active":"2023-09-29T23:24:37.281543+0000","last_peered":"2023-09-29T23:24:37.281543+0000","last_clean":"2023-09-29T23:24:37.281543+0000","last_became_active":"2023-09-29T23:23:45.075273+0000","last_became_peered":"2023-09-29T23:23:45.075273+0000","last_unstale":"2023-09-29T23:24:37.281543+0000","last_undegraded":"2023-09-29T23:24:37.281543+0000","last_fullsized":"2023-09-29T23:24:37.281543+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.284018+0000","last_change":"2023-09-29T23:23:45.459071+0000","last_active":"2023-09-29T23:24:37.284018+0000","last_peered":"2023-09-29T23:24:37.284018+0000","last_clean":"2023-09-29T23:24:37.284018+0000","last_became_active":"2023-09-29T23:23:45.458250+0000","last_became_peered":"2023-09-29T23:23:45.458250+0000","last_unstale":"2023-09-29T23:24:37.284018+0000","last_undegraded":"2023-09-29T23:24:37.284018+0000","last_fullsized":"2023-09-29T23:24:37.284018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"16'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287008+0000","last_change":"2023-09-29T23:23:45.076932+0000","last_active":"2023-09-29T23:24:37.287008+0000","last_peered":"2023-09-29T23:24:37.287008+0000","last_clean":"2023-09-29T23:24:37.287008+0000","last_became_active":"2023-09-29T23:23:45.076638+0000","last_became_peered":"2023-09-29T23:23:45.076638+0000","last_unstale":"2023-09-29T23:24:37.287008+0000","last_undegraded":"2023-09-29T23:24:37.287008+0000","last_fullsized":"2023-09-29T23:24:37.287008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:31.872101+0000","last_change":"2023-09-29T23:29:31.872071+0000","last_active":"2023-09-29T23:29:31.872101+0000","last_peered":"2023-09-29T23:29:31.872101+0000","last_clean":"2023-09-29T23:29:31.872101+0000","last_became_active":"2023-09-29T23:23:45.471013+0000","last_became_peered":"2023-09-29T23:23:45.471013+0000","last_unstale":"2023-09-29T23:29:31.872101+0000","last_undegraded":"2023-09-29T23:29:31.872101+0000","last_fullsized":"2023-09-29T23:29:31.872101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:31.871991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:31.871991+0000","last_clean_scrub_stamp":"2023-09-29T23:29:31.871991+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:32:09.372334+0000","scrub_duration":0.0012566319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"16'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.298264+0000","last_change":"2023-09-29T23:24:37.295660+0000","last_active":"2023-09-29T23:24:37.298264+0000","last_peered":"2023-09-29T23:24:37.298264+0000","last_clean":"2023-09-29T23:24:37.298264+0000","last_became_active":"2023-09-29T23:24:37.292123+0000","last_became_peered":"2023-09-29T23:24:37.292123+0000","last_unstale":"2023-09-29T23:24:37.298264+0000","last_undegraded":"2023-09-29T23:24:37.298264+0000","last_fullsized":"2023-09-29T23:24:37.298264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281244+0000","last_change":"2023-09-29T23:23:45.471929+0000","last_active":"2023-09-29T23:24:37.281244+0000","last_peered":"2023-09-29T23:24:37.281244+0000","last_clean":"2023-09-29T23:24:37.281244+0000","last_became_active":"2023-09-29T23:23:45.471673+0000","last_became_peered":"2023-09-29T23:23:45.471673+0000","last_unstale":"2023-09-29T23:24:37.281244+0000","last_undegraded":"2023-09-29T23:24:37.281244+0000","last_fullsized":"2023-09-29T23:24:37.281244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283998+0000","last_change":"2023-09-29T23:23:45.092434+0000","last_active":"2023-09-29T23:24:37.283998+0000","last_peered":"2023-09-29T23:24:37.283998+0000","last_clean":"2023-09-29T23:24:37.283998+0000","last_became_active":"2023-09-29T23:23:45.092203+0000","last_became_peered":"2023-09-29T23:23:45.092203+0000","last_unstale":"2023-09-29T23:24:37.283998+0000","last_undegraded":"2023-09-29T23:24:37.283998+0000","last_fullsized":"2023-09-29T23:24:37.283998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287347+0000","last_change":"2023-09-29T23:23:45.464734+0000","last_active":"2023-09-29T23:24:37.287347+0000","last_peered":"2023-09-29T23:24:37.287347+0000","last_clean":"2023-09-29T23:24:37.287347+0000","last_became_active":"2023-09-29T23:23:45.464202+0000","last_became_peered":"2023-09-29T23:23:45.464202+0000","last_unstale":"2023-09-29T23:24:37.287347+0000","last_undegraded":"2023-09-29T23:24:37.287347+0000","last_fullsized":"2023-09-29T23:24:37.287347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1f","version":"16'4","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287250+0000","last_change":"2023-09-29T23:23:45.074017+0000","last_active":"2023-09-29T23:24:37.287250+0000","last_peered":"2023-09-29T23:24:37.287250+0000","last_clean":"2023-09-29T23:24:37.287250+0000","last_became_active":"2023-09-29T23:23:45.073772+0000","last_became_peered":"2023-09-29T23:23:45.073772+0000","last_unstale":"2023-09-29T23:24:37.287250+0000","last_undegraded":"2023-09-29T23:24:37.287250+0000","last_fullsized":"2023-09-29T23:24:37.287250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:14.852011+0000","last_change":"2023-09-29T23:29:14.851983+0000","last_active":"2023-09-29T23:29:14.852011+0000","last_peered":"2023-09-29T23:29:14.852011+0000","last_clean":"2023-09-29T23:29:14.852011+0000","last_became_active":"2023-09-29T23:23:45.460548+0000","last_became_peered":"2023-09-29T23:23:45.460548+0000","last_unstale":"2023-09-29T23:29:14.852011+0000","last_undegraded":"2023-09-29T23:29:14.852011+0000","last_fullsized":"2023-09-29T23:29:14.852011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:14.851891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:14.851891+0000","last_clean_scrub_stamp":"2023-09-29T23:29:14.851891+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:08:19.031301+0000","scrub_duration":0.0015205469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:19.888652+0000","last_change":"2023-09-29T23:29:19.888625+0000","last_active":"2023-09-29T23:29:19.888652+0000","last_peered":"2023-09-29T23:29:19.888652+0000","last_clean":"2023-09-29T23:29:19.888652+0000","last_became_active":"2023-09-29T23:23:45.471294+0000","last_became_peered":"2023-09-29T23:23:45.471294+0000","last_unstale":"2023-09-29T23:29:19.888652+0000","last_undegraded":"2023-09-29T23:29:19.888652+0000","last_fullsized":"2023-09-29T23:29:19.888652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:19.888553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:19.888553+0000","last_clean_scrub_stamp":"2023-09-29T23:29:19.888553+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:21:05.111883+0000","scrub_duration":0.0012268019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:16.870489+0000","last_change":"2023-09-29T23:29:16.870462+0000","last_active":"2023-09-29T23:29:16.870489+0000","last_peered":"2023-09-29T23:29:16.870489+0000","last_clean":"2023-09-29T23:29:16.870489+0000","last_became_active":"2023-09-29T23:23:45.461188+0000","last_became_peered":"2023-09-29T23:23:45.461188+0000","last_unstale":"2023-09-29T23:29:16.870489+0000","last_undegraded":"2023-09-29T23:29:16.870489+0000","last_fullsized":"2023-09-29T23:29:16.870489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:16.870393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:16.870393+0000","last_clean_scrub_stamp":"2023-09-29T23:29:16.870393+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:08:57.437070+0000","scrub_duration":0.00131145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286879+0000","last_change":"2023-09-29T23:23:45.473685+0000","last_active":"2023-09-29T23:24:37.286879+0000","last_peered":"2023-09-29T23:24:37.286879+0000","last_clean":"2023-09-29T23:24:37.286879+0000","last_became_active":"2023-09-29T23:23:45.473438+0000","last_became_peered":"2023-09-29T23:23:45.473438+0000","last_unstale":"2023-09-29T23:24:37.286879+0000","last_undegraded":"2023-09-29T23:24:37.286879+0000","last_fullsized":"2023-09-29T23:24:37.286879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:21.580746+0000","last_change":"2023-09-29T23:29:21.580719+0000","last_active":"2023-09-29T23:29:21.580746+0000","last_peered":"2023-09-29T23:29:21.580746+0000","last_clean":"2023-09-29T23:29:21.580746+0000","last_became_active":"2023-09-29T23:23:45.474163+0000","last_became_peered":"2023-09-29T23:23:45.474163+0000","last_unstale":"2023-09-29T23:29:21.580746+0000","last_undegraded":"2023-09-29T23:29:21.580746+0000","last_fullsized":"2023-09-29T23:29:21.580746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:21.580646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:21.580646+0000","last_clean_scrub_stamp":"2023-09-29T23:29:21.580646+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:43:26.283595+0000","scrub_duration":0.001312361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:16.435331+0000","last_change":"2023-09-29T23:29:16.435290+0000","last_active":"2023-09-29T23:29:16.435331+0000","last_peered":"2023-09-29T23:29:16.435331+0000","last_clean":"2023-09-29T23:29:16.435331+0000","last_became_active":"2023-09-29T23:23:45.473063+0000","last_became_peered":"2023-09-29T23:23:45.473063+0000","last_unstale":"2023-09-29T23:29:16.435331+0000","last_undegraded":"2023-09-29T23:29:16.435331+0000","last_fullsized":"2023-09-29T23:29:16.435331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:16.435179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:16.435179+0000","last_clean_scrub_stamp":"2023-09-29T23:29:16.435179+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:31:53.935521+0000","scrub_duration":0.001480377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281861+0000","last_change":"2023-09-29T23:23:45.463712+0000","last_active":"2023-09-29T23:24:37.281861+0000","last_peered":"2023-09-29T23:24:37.281861+0000","last_clean":"2023-09-29T23:24:37.281861+0000","last_became_active":"2023-09-29T23:23:45.463269+0000","last_became_peered":"2023-09-29T23:23:45.463269+0000","last_unstale":"2023-09-29T23:24:37.281861+0000","last_undegraded":"2023-09-29T23:24:37.281861+0000","last_fullsized":"2023-09-29T23:24:37.281861+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705739,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5636,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":104851964,"statfs":{"total":107374182400,"available":107368411136,"internally_reserved":0,"allocated":192512,"data_stored":54287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 29 23:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.28399999999999997,"15min":0.27600000000000002},"min":{"1min":0.191,"5min":0.14499999999999999,"15min":0.14499999999999999},"max":{"1min":0.39800000000000002,"5min":0.435,"15min":0.435},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.29099999999999998,"15min":0.27400000000000002},"min":{"1min":0.20100000000000001,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.42799999999999999,"5min":0.437,"15min":0.437},"last":0.29899999999999999}]},{"osd":2,"last update":"Fri Sep 29 23:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.29599999999999999,"15min":0.27800000000000002},"min":{"1min":0.216,"5min":0.186,"15min":0.186},"max":{"1min":0.42599999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.309,"15min":0.29299999999999998},"min":{"1min":0.20899999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.45100000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.31900000000000001}]}]},{"osd":2,"up_from":8,"seq":34359738443,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5564,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852036,"statfs":{"total":107374182400,"available":107368484864,"internally_reserved":0,"allocated":184320,"data_stored":53655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 29 23:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.28299999999999997,"15min":0.28899999999999998},"min":{"1min":0.19700000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.251},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.29099999999999998,"15min":0.29699999999999999},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.433,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.28899999999999998}]},{"osd":1,"last update":"Fri Sep 29 23:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.21199999999999999,"5min":0.189,"15min":0.189},"max":{"1min":0.46200000000000002,"5min":0.498,"15min":0.498},"last":0.307},{"interface":"front","average":{"1min":0.307,"5min":0.313,"15min":0.317},"min":{"1min":0.23499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.48099999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.32100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5624,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":104851976,"statfs":{"total":107374182400,"available":107368423424,"internally_reserved":0,"allocated":180224,"data_stored":52715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 29 23:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.27800000000000002,"15min":0.28399999999999997},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.39900000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.246},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.28199999999999997,"15min":0.27000000000000002},"min":{"1min":0.221,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.41599999999999998,"5min":0.44,"15min":0.44},"last":0.27000000000000002}]},{"osd":2,"last update":"Fri Sep 29 23:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.28100000000000003,"5min":0.28699999999999998,"15min":0.26900000000000002},"min":{"1min":0.22,"5min":0.191,"15min":0.191},"max":{"1min":0.438,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.311},{"interface":"front","average":{"1min":0.29099999999999998,"5min":0.29799999999999999,"15min":0.28799999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.45300000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-29T23:29:43.570 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.570 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.570 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.570 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.570 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.570 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.570 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.571 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.571 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.571 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.571 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.571 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.571 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.571 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.571 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.572 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.572 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.572 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.572 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.572 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.572 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.572 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.573 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.573 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.573 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.573 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.573 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.573 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.573 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.574 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.574 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.574 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.574 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.574 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.574 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.574 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.574 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.575 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.575 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.575 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.575 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.575 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.575 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.575 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.575 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.575 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.576 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.576 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.576 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.576 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.576 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.576 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.576 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.576 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.577 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.577 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.577 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:29:43.577 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-29T23:30:03.578 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:30:03.704 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.703+0000 7fed54446700 1 Processor -- start 2023-09-29T23:30:03.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.703+0000 7fed54446700 1 -- start start 2023-09-29T23:30:03.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.704+0000 7fed54446700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fed4c12fcb0 0x7fed4c134620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:30:03.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.704+0000 7fed54446700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c0997f0 con 0x7fed4c0a3030 2023-09-29T23:30:03.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.704+0000 7fed54446700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c0a3400 con 0x7fed4c12fcb0 2023-09-29T23:30:03.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.704+0000 7fed519e1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fed4c12fcb0 0x7fed4c134620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:30:03.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.704+0000 7fed521e2700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fed4c0a3030 0x7fed4c12f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:42846/0 (socket says 172.21.15.92:42846) 2023-09-29T23:30:03.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.704+0000 7fed521e2700 1 -- 172.21.15.92:0/3399427878 learned_addr learned my addr 172.21.15.92:0/3399427878 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:30:03.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.704+0000 7fed519e1700 1 -- 172.21.15.92:0/3399427878 >> v1:172.21.15.92:6789/0 conn(0x7fed4c0a3030 legacy=0x7fed4c12f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:30:03.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.704+0000 7fed511e0700 1 -- 172.21.15.92:0/3399427878 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610753747 0 0) 0x7fed4c0997f0 con 0x7fed4c0a3030 2023-09-29T23:30:03.705 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.704+0000 7fed519e1700 1 -- 172.21.15.92:0/3399427878 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c0977a0 con 0x7fed4c12fcb0 2023-09-29T23:30:03.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.704+0000 7fed519e1700 1 --2- 172.21.15.92:0/3399427878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed4c12fcb0 0x7fed4c134620 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fed3c009860 tx=0x7fed3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79fa420e525b1cb server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:30:03.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.704+0000 7fed511e0700 1 -- 172.21.15.92:0/3399427878 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed3c00b710 con 0x7fed4c12fcb0 2023-09-29T23:30:03.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.704+0000 7fed511e0700 1 -- 172.21.15.92:0/3399427878 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c00b870 con 0x7fed4c12fcb0 2023-09-29T23:30:03.706 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.704+0000 7fed511e0700 1 -- 172.21.15.92:0/3399427878 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed3c00ba20 con 0x7fed4c12fcb0 2023-09-29T23:30:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.705+0000 7fed54446700 1 -- 172.21.15.92:0/3399427878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed4c12fcb0 msgr2=0x7fed4c134620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:30:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.705+0000 7fed54446700 1 --2- 172.21.15.92:0/3399427878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed4c12fcb0 0x7fed4c134620 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fed3c009860 tx=0x7fed3c0091a0 comp rx=0 tx=0).stop 2023-09-29T23:30:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.705+0000 7fed54446700 1 -- 172.21.15.92:0/3399427878 shutdown_connections 2023-09-29T23:30:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.705+0000 7fed54446700 1 --2- 172.21.15.92:0/3399427878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed4c12fcb0 0x7fed4c134620 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:30:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.705+0000 7fed54446700 1 -- 172.21.15.92:0/3399427878 >> 172.21.15.92:0/3399427878 conn(0x7fed4c067fc0 msgr2=0x7fed4c0a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:30:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.705+0000 7fed54446700 1 -- 172.21.15.92:0/3399427878 shutdown_connections 2023-09-29T23:30:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.705+0000 7fed54446700 1 -- 172.21.15.92:0/3399427878 wait complete. 2023-09-29T23:30:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.706+0000 7fed54446700 1 Processor -- start 2023-09-29T23:30:03.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.706+0000 7fed54446700 1 -- start start 2023-09-29T23:30:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.707+0000 7fed54446700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed4c0a3030 0x7fed4c12c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:30:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.707+0000 7fed54446700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c11e710 con 0x7fed4c0a3030 2023-09-29T23:30:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.707+0000 7fed521e2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed4c0a3030 0x7fed4c12c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:30:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.707+0000 7fed521e2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed4c0a3030 0x7fed4c12c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45108/0 (socket says 172.21.15.92:45108) 2023-09-29T23:30:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.707+0000 7fed521e2700 1 -- 172.21.15.92:0/3652629754 learned_addr learned my addr 172.21.15.92:0/3652629754 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:30:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.707+0000 7fed521e2700 1 -- 172.21.15.92:0/3652629754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c009420 con 0x7fed4c0a3030 2023-09-29T23:30:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.707+0000 7fed521e2700 1 --2- 172.21.15.92:0/3652629754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed4c0a3030 0x7fed4c12c150 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fed4800cbc0 tx=0x7fed48001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:30:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.707+0000 7fed427fc700 1 -- 172.21.15.92:0/3652629754 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed4800a9d0 con 0x7fed4c0a3030 2023-09-29T23:30:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.707+0000 7fed427fc700 1 -- 172.21.15.92:0/3652629754 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4800ab30 con 0x7fed4c0a3030 2023-09-29T23:30:03.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.707+0000 7fed54446700 1 -- 172.21.15.92:0/3652629754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c11ec50 con 0x7fed4c0a3030 2023-09-29T23:30:03.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.707+0000 7fed427fc700 1 -- 172.21.15.92:0/3652629754 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed4800ade0 con 0x7fed4c0a3030 2023-09-29T23:30:03.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.707+0000 7fed54446700 1 -- 172.21.15.92:0/3652629754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c11e940 con 0x7fed4c0a3030 2023-09-29T23:30:03.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.708+0000 7fed427fc700 1 -- 172.21.15.92:0/3652629754 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7fed480070f0 con 0x7fed4c0a3030 2023-09-29T23:30:03.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.708+0000 7fed427fc700 1 --2- 172.21.15.92:0/3652629754 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fed30035630 0x7fed30037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:30:03.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.708+0000 7fed54446700 1 -- 172.21.15.92:0/3652629754 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c11b490 con 0x7fed4c0a3030 2023-09-29T23:30:03.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.708+0000 7fed427fc700 1 -- 172.21.15.92:0/3652629754 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7fed48047a40 con 0x7fed4c0a3030 2023-09-29T23:30:03.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.708+0000 7fed519e1700 1 --2- 172.21.15.92:0/3652629754 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fed30035630 0x7fed30037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:30:03.711 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.709+0000 7fed519e1700 1 --2- 172.21.15.92:0/3652629754 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fed30035630 0x7fed30037ae0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed3c006eb0 tx=0x7fed3c016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:30:03.713 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.713+0000 7fed427fc700 1 -- 172.21.15.92:0/3652629754 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed480073a0 con 0x7fed4c0a3030 2023-09-29T23:30:03.891 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.891+0000 7fed54446700 1 -- 172.21.15.92:0/3652629754 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed4c096410 con 0x7fed30035630 2023-09-29T23:30:03.898 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.898+0000 7fed427fc700 1 -- 172.21.15.92:0/3652629754 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264725 (secure 0 0 0) 0x7fed4c096410 con 0x7fed30035630 2023-09-29T23:30:03.901 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:30:03.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.901+0000 7fed54446700 1 -- 172.21.15.92:0/3652629754 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fed30035630 msgr2=0x7fed30037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:30:03.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.901+0000 7fed54446700 1 --2- 172.21.15.92:0/3652629754 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fed30035630 0x7fed30037ae0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed3c006eb0 tx=0x7fed3c016000 comp rx=0 tx=0).stop 2023-09-29T23:30:03.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.901+0000 7fed54446700 1 -- 172.21.15.92:0/3652629754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed4c0a3030 msgr2=0x7fed4c12c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:30:03.903 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.901+0000 7fed54446700 1 --2- 172.21.15.92:0/3652629754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed4c0a3030 0x7fed4c12c150 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fed4800cbc0 tx=0x7fed48001a80 comp rx=0 tx=0).stop 2023-09-29T23:30:03.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.901+0000 7fed54446700 1 -- 172.21.15.92:0/3652629754 shutdown_connections 2023-09-29T23:30:03.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.901+0000 7fed54446700 1 --2- 172.21.15.92:0/3652629754 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7fed30035630 0x7fed30037ae0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:30:03.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.901+0000 7fed54446700 1 --2- 172.21.15.92:0/3652629754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed4c0a3030 0x7fed4c12c150 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:30:03.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.901+0000 7fed54446700 1 -- 172.21.15.92:0/3652629754 >> 172.21.15.92:0/3652629754 conn(0x7fed4c067fc0 msgr2=0x7fed4c12d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:30:03.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.901+0000 7fed54446700 1 -- 172.21.15.92:0/3652629754 shutdown_connections 2023-09-29T23:30:03.904 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:03.901+0000 7fed54446700 1 -- 172.21.15.92:0/3652629754 wait complete. 2023-09-29T23:30:03.904 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-09-29T23:30:03.913 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2023-09-29T23:30:02.123942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":208,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":16888,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":16320,"kb_avail":314555912,"statfs":{"total":322122547200,"available":322105253888,"internally_reserved":0,"allocated":557056,"data_stored":160657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16711680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003179"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287388+0000","last_change":"2023-09-29T23:23:45.465624+0000","last_active":"2023-09-29T23:24:37.287388+0000","last_peered":"2023-09-29T23:24:37.287388+0000","last_clean":"2023-09-29T23:24:37.287388+0000","last_became_active":"2023-09-29T23:23:45.464271+0000","last_became_peered":"2023-09-29T23:23:45.464271+0000","last_unstale":"2023-09-29T23:24:37.287388+0000","last_undegraded":"2023-09-29T23:24:37.287388+0000","last_fullsized":"2023-09-29T23:24:37.287388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:03.249509+0000","last_change":"2023-09-29T23:29:03.249480+0000","last_active":"2023-09-29T23:29:03.249509+0000","last_peered":"2023-09-29T23:29:03.249509+0000","last_clean":"2023-09-29T23:29:03.249509+0000","last_became_active":"2023-09-29T23:23:45.466338+0000","last_became_peered":"2023-09-29T23:23:45.466338+0000","last_unstale":"2023-09-29T23:29:03.249509+0000","last_undegraded":"2023-09-29T23:29:03.249509+0000","last_fullsized":"2023-09-29T23:29:03.249509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:03.249418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:03.249418+0000","last_clean_scrub_stamp":"2023-09-29T23:29:03.249418+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:59:00.108261+0000","scrub_duration":0.0011124380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287634+0000","last_change":"2023-09-29T23:23:45.477248+0000","last_active":"2023-09-29T23:24:37.287634+0000","last_peered":"2023-09-29T23:24:37.287634+0000","last_clean":"2023-09-29T23:24:37.287634+0000","last_became_active":"2023-09-29T23:23:45.474129+0000","last_became_peered":"2023-09-29T23:23:45.474129+0000","last_unstale":"2023-09-29T23:24:37.287634+0000","last_undegraded":"2023-09-29T23:24:37.287634+0000","last_fullsized":"2023-09-29T23:24:37.287634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:17.855334+0000","last_change":"2023-09-29T23:29:17.855305+0000","last_active":"2023-09-29T23:29:17.855334+0000","last_peered":"2023-09-29T23:29:17.855334+0000","last_clean":"2023-09-29T23:29:17.855334+0000","last_became_active":"2023-09-29T23:23:45.470971+0000","last_became_peered":"2023-09-29T23:23:45.470971+0000","last_unstale":"2023-09-29T23:29:17.855334+0000","last_undegraded":"2023-09-29T23:29:17.855334+0000","last_fullsized":"2023-09-29T23:29:17.855334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:17.855232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:17.855232+0000","last_clean_scrub_stamp":"2023-09-29T23:29:17.855232+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:07:36.954319+0000","scrub_duration":0.0012669980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286897+0000","last_change":"2023-09-29T23:23:45.473831+0000","last_active":"2023-09-29T23:24:37.286897+0000","last_peered":"2023-09-29T23:24:37.286897+0000","last_clean":"2023-09-29T23:24:37.286897+0000","last_became_active":"2023-09-29T23:23:45.473570+0000","last_became_peered":"2023-09-29T23:23:45.473570+0000","last_unstale":"2023-09-29T23:24:37.286897+0000","last_undegraded":"2023-09-29T23:24:37.286897+0000","last_fullsized":"2023-09-29T23:24:37.286897+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:11.848798+0000","last_change":"2023-09-29T23:29:11.848767+0000","last_active":"2023-09-29T23:29:11.848798+0000","last_peered":"2023-09-29T23:29:11.848798+0000","last_clean":"2023-09-29T23:29:11.848798+0000","last_became_active":"2023-09-29T23:23:45.470349+0000","last_became_peered":"2023-09-29T23:23:45.470349+0000","last_unstale":"2023-09-29T23:29:11.848798+0000","last_undegraded":"2023-09-29T23:29:11.848798+0000","last_fullsized":"2023-09-29T23:29:11.848798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:11.848689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:11.848689+0000","last_clean_scrub_stamp":"2023-09-29T23:29:11.848689+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:18:31.778625+0000","scrub_duration":0.001396563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286523+0000","last_change":"2023-09-29T23:23:45.465376+0000","last_active":"2023-09-29T23:24:37.286523+0000","last_peered":"2023-09-29T23:24:37.286523+0000","last_clean":"2023-09-29T23:24:37.286523+0000","last_became_active":"2023-09-29T23:23:45.464893+0000","last_became_peered":"2023-09-29T23:23:45.464893+0000","last_unstale":"2023-09-29T23:24:37.286523+0000","last_undegraded":"2023-09-29T23:24:37.286523+0000","last_fullsized":"2023-09-29T23:24:37.286523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283288+0000","last_change":"2023-09-29T23:23:45.463286+0000","last_active":"2023-09-29T23:24:37.283288+0000","last_peered":"2023-09-29T23:24:37.283288+0000","last_clean":"2023-09-29T23:24:37.283288+0000","last_became_active":"2023-09-29T23:23:45.462888+0000","last_became_peered":"2023-09-29T23:23:45.462888+0000","last_unstale":"2023-09-29T23:24:37.283288+0000","last_undegraded":"2023-09-29T23:24:37.283288+0000","last_fullsized":"2023-09-29T23:24:37.283288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.282063+0000","last_change":"2023-09-29T23:23:45.468860+0000","last_active":"2023-09-29T23:24:37.282063+0000","last_peered":"2023-09-29T23:24:37.282063+0000","last_clean":"2023-09-29T23:24:37.282063+0000","last_became_active":"2023-09-29T23:23:45.468303+0000","last_became_peered":"2023-09-29T23:23:45.468303+0000","last_unstale":"2023-09-29T23:24:37.282063+0000","last_undegraded":"2023-09-29T23:24:37.282063+0000","last_fullsized":"2023-09-29T23:24:37.282063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.292057+0000","last_change":"2023-09-29T23:24:37.285573+0000","last_active":"2023-09-29T23:24:37.292057+0000","last_peered":"2023-09-29T23:24:37.292057+0000","last_clean":"2023-09-29T23:24:37.292057+0000","last_became_active":"2023-09-29T23:24:37.285339+0000","last_became_peered":"2023-09-29T23:24:37.285339+0000","last_unstale":"2023-09-29T23:24:37.292057+0000","last_undegraded":"2023-09-29T23:24:37.292057+0000","last_fullsized":"2023-09-29T23:24:37.292057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287570+0000","last_change":"2023-09-29T23:23:45.467858+0000","last_active":"2023-09-29T23:24:37.287570+0000","last_peered":"2023-09-29T23:24:37.287570+0000","last_clean":"2023-09-29T23:24:37.287570+0000","last_became_active":"2023-09-29T23:23:45.464083+0000","last_became_peered":"2023-09-29T23:23:45.464083+0000","last_unstale":"2023-09-29T23:24:37.287570+0000","last_undegraded":"2023-09-29T23:24:37.287570+0000","last_fullsized":"2023-09-29T23:24:37.287570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287315+0000","last_change":"2023-09-29T23:23:45.466588+0000","last_active":"2023-09-29T23:24:37.287315+0000","last_peered":"2023-09-29T23:24:37.287315+0000","last_clean":"2023-09-29T23:24:37.287315+0000","last_became_active":"2023-09-29T23:23:45.466161+0000","last_became_peered":"2023-09-29T23:23:45.466161+0000","last_unstale":"2023-09-29T23:24:37.287315+0000","last_undegraded":"2023-09-29T23:24:37.287315+0000","last_fullsized":"2023-09-29T23:24:37.287315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:04.477680+0000","last_change":"2023-09-29T23:29:04.477657+0000","last_active":"2023-09-29T23:29:04.477680+0000","last_peered":"2023-09-29T23:29:04.477680+0000","last_clean":"2023-09-29T23:29:04.477680+0000","last_became_active":"2023-09-29T23:23:45.467178+0000","last_became_peered":"2023-09-29T23:23:45.467178+0000","last_unstale":"2023-09-29T23:29:04.477680+0000","last_undegraded":"2023-09-29T23:29:04.477680+0000","last_fullsized":"2023-09-29T23:29:04.477680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:04.477596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:04.477596+0000","last_clean_scrub_stamp":"2023-09-29T23:29:04.477596+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:49.700926+0000","scrub_duration":0.001119543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:20.545759+0000","last_change":"2023-09-29T23:29:20.545730+0000","last_active":"2023-09-29T23:29:20.545759+0000","last_peered":"2023-09-29T23:29:20.545759+0000","last_clean":"2023-09-29T23:29:20.545759+0000","last_became_active":"2023-09-29T23:23:45.464523+0000","last_became_peered":"2023-09-29T23:23:45.464523+0000","last_unstale":"2023-09-29T23:29:20.545759+0000","last_undegraded":"2023-09-29T23:29:20.545759+0000","last_fullsized":"2023-09-29T23:29:20.545759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:20.545655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:20.545655+0000","last_clean_scrub_stamp":"2023-09-29T23:29:20.545655+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:33:27.694060+0000","scrub_duration":0.0013252279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281097+0000","last_change":"2023-09-29T23:23:45.470349+0000","last_active":"2023-09-29T23:24:37.281097+0000","last_peered":"2023-09-29T23:24:37.281097+0000","last_clean":"2023-09-29T23:24:37.281097+0000","last_became_active":"2023-09-29T23:23:45.467004+0000","last_became_peered":"2023-09-29T23:23:45.467004+0000","last_unstale":"2023-09-29T23:24:37.281097+0000","last_undegraded":"2023-09-29T23:24:37.281097+0000","last_fullsized":"2023-09-29T23:24:37.281097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283339+0000","last_change":"2023-09-29T23:23:45.471536+0000","last_active":"2023-09-29T23:24:37.283339+0000","last_peered":"2023-09-29T23:24:37.283339+0000","last_clean":"2023-09-29T23:24:37.283339+0000","last_became_active":"2023-09-29T23:23:45.471334+0000","last_became_peered":"2023-09-29T23:23:45.471334+0000","last_unstale":"2023-09-29T23:24:37.283339+0000","last_undegraded":"2023-09-29T23:24:37.283339+0000","last_fullsized":"2023-09-29T23:24:37.283339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:43.304266+0000","last_change":"2023-09-29T23:29:43.304234+0000","last_active":"2023-09-29T23:29:43.304266+0000","last_peered":"2023-09-29T23:29:43.304266+0000","last_clean":"2023-09-29T23:29:43.304266+0000","last_became_active":"2023-09-29T23:23:45.468001+0000","last_became_peered":"2023-09-29T23:23:45.468001+0000","last_unstale":"2023-09-29T23:29:43.304266+0000","last_undegraded":"2023-09-29T23:29:43.304266+0000","last_fullsized":"2023-09-29T23:29:43.304266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:43.304142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:43.304142+0000","last_clean_scrub_stamp":"2023-09-29T23:29:43.304142+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:49:10.871636+0000","scrub_duration":0.001341552,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283970+0000","last_change":"2023-09-29T23:23:45.467819+0000","last_active":"2023-09-29T23:24:37.283970+0000","last_peered":"2023-09-29T23:24:37.283970+0000","last_clean":"2023-09-29T23:24:37.283970+0000","last_became_active":"2023-09-29T23:23:45.467434+0000","last_became_peered":"2023-09-29T23:23:45.467434+0000","last_unstale":"2023-09-29T23:24:37.283970+0000","last_undegraded":"2023-09-29T23:24:37.283970+0000","last_fullsized":"2023-09-29T23:24:37.283970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287439+0000","last_change":"2023-09-29T23:23:45.473751+0000","last_active":"2023-09-29T23:24:37.287439+0000","last_peered":"2023-09-29T23:24:37.287439+0000","last_clean":"2023-09-29T23:24:37.287439+0000","last_became_active":"2023-09-29T23:23:45.473326+0000","last_became_peered":"2023-09-29T23:23:45.473326+0000","last_unstale":"2023-09-29T23:24:37.287439+0000","last_undegraded":"2023-09-29T23:24:37.287439+0000","last_fullsized":"2023-09-29T23:24:37.287439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:02.476624+0000","last_change":"2023-09-29T23:29:02.476605+0000","last_active":"2023-09-29T23:29:02.476624+0000","last_peered":"2023-09-29T23:29:02.476624+0000","last_clean":"2023-09-29T23:29:02.476624+0000","last_became_active":"2023-09-29T23:23:45.467494+0000","last_became_peered":"2023-09-29T23:23:45.467494+0000","last_unstale":"2023-09-29T23:29:02.476624+0000","last_undegraded":"2023-09-29T23:29:02.476624+0000","last_fullsized":"2023-09-29T23:29:02.476624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:02.476541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:02.476541+0000","last_clean_scrub_stamp":"2023-09-29T23:29:02.476541+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:07:21.575629+0000","scrub_duration":0.0011731350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:06.426368+0000","last_change":"2023-09-29T23:29:06.426326+0000","last_active":"2023-09-29T23:29:06.426368+0000","last_peered":"2023-09-29T23:29:06.426368+0000","last_clean":"2023-09-29T23:29:06.426368+0000","last_became_active":"2023-09-29T23:23:45.477408+0000","last_became_peered":"2023-09-29T23:23:45.477408+0000","last_unstale":"2023-09-29T23:29:06.426368+0000","last_undegraded":"2023-09-29T23:29:06.426368+0000","last_fullsized":"2023-09-29T23:29:06.426368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:06.426255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:06.426255+0000","last_clean_scrub_stamp":"2023-09-29T23:29:06.426255+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:16:36.592771+0000","scrub_duration":0.001349893,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.280950+0000","last_change":"2023-09-29T23:23:45.471232+0000","last_active":"2023-09-29T23:24:37.280950+0000","last_peered":"2023-09-29T23:24:37.280950+0000","last_clean":"2023-09-29T23:24:37.280950+0000","last_became_active":"2023-09-29T23:23:45.470574+0000","last_became_peered":"2023-09-29T23:23:45.470574+0000","last_unstale":"2023-09-29T23:24:37.280950+0000","last_undegraded":"2023-09-29T23:24:37.280950+0000","last_fullsized":"2023-09-29T23:24:37.280950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:07.470966+0000","last_change":"2023-09-29T23:29:07.470936+0000","last_active":"2023-09-29T23:29:07.470966+0000","last_peered":"2023-09-29T23:29:07.470966+0000","last_clean":"2023-09-29T23:29:07.470966+0000","last_became_active":"2023-09-29T23:23:45.473789+0000","last_became_peered":"2023-09-29T23:23:45.473789+0000","last_unstale":"2023-09-29T23:29:07.470966+0000","last_undegraded":"2023-09-29T23:29:07.470966+0000","last_fullsized":"2023-09-29T23:29:07.470966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:07.470870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:07.470870+0000","last_clean_scrub_stamp":"2023-09-29T23:29:07.470870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:35:33.595449+0000","scrub_duration":0.0012289239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:03.460784+0000","last_change":"2023-09-29T23:29:03.460762+0000","last_active":"2023-09-29T23:29:03.460784+0000","last_peered":"2023-09-29T23:29:03.460784+0000","last_clean":"2023-09-29T23:29:03.460784+0000","last_became_active":"2023-09-29T23:23:45.465443+0000","last_became_peered":"2023-09-29T23:23:45.465443+0000","last_unstale":"2023-09-29T23:29:03.460784+0000","last_undegraded":"2023-09-29T23:29:03.460784+0000","last_fullsized":"2023-09-29T23:29:03.460784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:03.460703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:03.460703+0000","last_clean_scrub_stamp":"2023-09-29T23:29:03.460703+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:59:00.319545+0000","scrub_duration":0.00097215699999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283832+0000","last_change":"2023-09-29T23:23:45.458032+0000","last_active":"2023-09-29T23:24:37.283832+0000","last_peered":"2023-09-29T23:24:37.283832+0000","last_clean":"2023-09-29T23:24:37.283832+0000","last_became_active":"2023-09-29T23:23:45.457799+0000","last_became_peered":"2023-09-29T23:23:45.457799+0000","last_unstale":"2023-09-29T23:24:37.283832+0000","last_undegraded":"2023-09-29T23:24:37.283832+0000","last_fullsized":"2023-09-29T23:24:37.283832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:15.837977+0000","last_change":"2023-09-29T23:29:15.837942+0000","last_active":"2023-09-29T23:29:15.837977+0000","last_peered":"2023-09-29T23:29:15.837977+0000","last_clean":"2023-09-29T23:29:15.837977+0000","last_became_active":"2023-09-29T23:23:45.467730+0000","last_became_peered":"2023-09-29T23:23:45.467730+0000","last_unstale":"2023-09-29T23:29:15.837977+0000","last_undegraded":"2023-09-29T23:29:15.837977+0000","last_fullsized":"2023-09-29T23:29:15.837977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:15.837865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:15.837865+0000","last_clean_scrub_stamp":"2023-09-29T23:29:15.837865+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:04:13.297945+0000","scrub_duration":0.001397206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"16'1","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:06.283311+0000","last_change":"2023-09-29T23:29:06.283268+0000","last_active":"2023-09-29T23:29:06.283311+0000","last_peered":"2023-09-29T23:29:06.283311+0000","last_clean":"2023-09-29T23:29:06.283311+0000","last_became_active":"2023-09-29T23:23:45.075848+0000","last_became_peered":"2023-09-29T23:23:45.075848+0000","last_unstale":"2023-09-29T23:29:06.283311+0000","last_undegraded":"2023-09-29T23:29:06.283311+0000","last_fullsized":"2023-09-29T23:29:06.283311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'1","last_scrub_stamp":"2023-09-29T23:29:06.283188+0000","last_deep_scrub":"16'1","last_deep_scrub_stamp":"2023-09-29T23:29:06.283188+0000","last_clean_scrub_stamp":"2023-09-29T23:29:06.283188+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:16:36.449704+0000","scrub_duration":0.0013356450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:04.277638+0000","last_change":"2023-09-29T23:29:04.277614+0000","last_active":"2023-09-29T23:29:04.277638+0000","last_peered":"2023-09-29T23:29:04.277638+0000","last_clean":"2023-09-29T23:29:04.277638+0000","last_became_active":"2023-09-29T23:23:45.462155+0000","last_became_peered":"2023-09-29T23:23:45.462155+0000","last_unstale":"2023-09-29T23:29:04.277638+0000","last_undegraded":"2023-09-29T23:29:04.277638+0000","last_fullsized":"2023-09-29T23:29:04.277638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:04.277542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:04.277542+0000","last_clean_scrub_stamp":"2023-09-29T23:29:04.277542+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:49.500872+0000","scrub_duration":0.0010848310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:22.883137+0000","last_change":"2023-09-29T23:29:22.883103+0000","last_active":"2023-09-29T23:29:22.883137+0000","last_peered":"2023-09-29T23:29:22.883137+0000","last_clean":"2023-09-29T23:29:22.883137+0000","last_became_active":"2023-09-29T23:23:45.092273+0000","last_became_peered":"2023-09-29T23:23:45.092273+0000","last_unstale":"2023-09-29T23:29:22.883137+0000","last_undegraded":"2023-09-29T23:29:22.883137+0000","last_fullsized":"2023-09-29T23:29:22.883137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'1","last_scrub_stamp":"2023-09-29T23:29:22.883002+0000","last_deep_scrub":"16'1","last_deep_scrub_stamp":"2023-09-29T23:29:22.883002+0000","last_clean_scrub_stamp":"2023-09-29T23:29:22.883002+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:35:49.007581+0000","scrub_duration":0.001353417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:37.545175+0000","last_change":"2023-09-29T23:29:37.545146+0000","last_active":"2023-09-29T23:29:37.545175+0000","last_peered":"2023-09-29T23:29:37.545175+0000","last_clean":"2023-09-29T23:29:37.545175+0000","last_became_active":"2023-09-29T23:23:45.464027+0000","last_became_peered":"2023-09-29T23:23:45.464027+0000","last_unstale":"2023-09-29T23:29:37.545175+0000","last_undegraded":"2023-09-29T23:29:37.545175+0000","last_fullsized":"2023-09-29T23:29:37.545175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:37.545065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:37.545065+0000","last_clean_scrub_stamp":"2023-09-29T23:29:37.545065+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:31:27.151684+0000","scrub_duration":0.001339413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:42.453564+0000","last_change":"2023-09-29T23:29:42.453521+0000","last_active":"2023-09-29T23:29:42.453564+0000","last_peered":"2023-09-29T23:29:42.453564+0000","last_clean":"2023-09-29T23:29:42.453564+0000","last_became_active":"2023-09-29T23:23:45.088405+0000","last_became_peered":"2023-09-29T23:23:45.088405+0000","last_unstale":"2023-09-29T23:29:42.453564+0000","last_undegraded":"2023-09-29T23:29:42.453564+0000","last_fullsized":"2023-09-29T23:29:42.453564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:42.453441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:42.453441+0000","last_clean_scrub_stamp":"2023-09-29T23:29:42.453441+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:49:10.020935+0000","scrub_duration":0.001281113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:18.842822+0000","last_change":"2023-09-29T23:29:18.842794+0000","last_active":"2023-09-29T23:29:18.842822+0000","last_peered":"2023-09-29T23:29:18.842822+0000","last_clean":"2023-09-29T23:29:18.842822+0000","last_became_active":"2023-09-29T23:23:45.470917+0000","last_became_peered":"2023-09-29T23:23:45.470917+0000","last_unstale":"2023-09-29T23:29:18.842822+0000","last_undegraded":"2023-09-29T23:29:18.842822+0000","last_fullsized":"2023-09-29T23:29:18.842822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:18.842718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:18.842718+0000","last_clean_scrub_stamp":"2023-09-29T23:29:18.842718+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:59:15.701560+0000","scrub_duration":0.0012829569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:54.488388+0000","last_change":"2023-09-29T23:29:54.488362+0000","last_active":"2023-09-29T23:29:54.488388+0000","last_peered":"2023-09-29T23:29:54.488388+0000","last_clean":"2023-09-29T23:29:54.488388+0000","last_became_active":"2023-09-29T23:23:45.070610+0000","last_became_peered":"2023-09-29T23:23:45.070610+0000","last_unstale":"2023-09-29T23:29:54.488388+0000","last_undegraded":"2023-09-29T23:29:54.488388+0000","last_fullsized":"2023-09-29T23:29:54.488388+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:54.488296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:54.488296+0000","last_clean_scrub_stamp":"2023-09-29T23:29:54.488296+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:49:46.294564+0000","scrub_duration":0.0011955780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:32.058629+0000","last_change":"2023-09-29T23:29:32.058597+0000","last_active":"2023-09-29T23:29:32.058629+0000","last_peered":"2023-09-29T23:29:32.058629+0000","last_clean":"2023-09-29T23:29:32.058629+0000","last_became_active":"2023-09-29T23:23:45.475634+0000","last_became_peered":"2023-09-29T23:23:45.475634+0000","last_unstale":"2023-09-29T23:29:32.058629+0000","last_undegraded":"2023-09-29T23:29:32.058629+0000","last_fullsized":"2023-09-29T23:29:32.058629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:32.058524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:32.058524+0000","last_clean_scrub_stamp":"2023-09-29T23:29:32.058524+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:28:19.384325+0000","scrub_duration":0.0012732959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:16.093276+0000","last_change":"2023-09-29T23:29:16.093250+0000","last_active":"2023-09-29T23:29:16.093276+0000","last_peered":"2023-09-29T23:29:16.093276+0000","last_clean":"2023-09-29T23:29:16.093276+0000","last_became_active":"2023-09-29T23:23:45.091317+0000","last_became_peered":"2023-09-29T23:23:45.091317+0000","last_unstale":"2023-09-29T23:29:16.093276+0000","last_undegraded":"2023-09-29T23:29:16.093276+0000","last_fullsized":"2023-09-29T23:29:16.093276+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:16.093182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:16.093182+0000","last_clean_scrub_stamp":"2023-09-29T23:29:16.093182+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:31:53.593525+0000","scrub_duration":0.001347411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:36.981638+0000","last_change":"2023-09-29T23:29:36.981613+0000","last_active":"2023-09-29T23:29:36.981638+0000","last_peered":"2023-09-29T23:29:36.981638+0000","last_clean":"2023-09-29T23:29:36.981638+0000","last_became_active":"2023-09-29T23:23:45.458585+0000","last_became_peered":"2023-09-29T23:23:45.458585+0000","last_unstale":"2023-09-29T23:29:36.981638+0000","last_undegraded":"2023-09-29T23:29:36.981638+0000","last_fullsized":"2023-09-29T23:29:36.981638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:36.981533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:36.981533+0000","last_clean_scrub_stamp":"2023-09-29T23:29:36.981533+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:12:03.229046+0000","scrub_duration":0.001333363,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287376+0000","last_change":"2023-09-29T23:23:45.071269+0000","last_active":"2023-09-29T23:24:37.287376+0000","last_peered":"2023-09-29T23:24:37.287376+0000","last_clean":"2023-09-29T23:24:37.287376+0000","last_became_active":"2023-09-29T23:23:45.070986+0000","last_became_peered":"2023-09-29T23:23:45.070986+0000","last_unstale":"2023-09-29T23:24:37.287376+0000","last_undegraded":"2023-09-29T23:24:37.287376+0000","last_fullsized":"2023-09-29T23:24:37.287376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:51.461303+0000","last_change":"2023-09-29T23:29:51.461276+0000","last_active":"2023-09-29T23:29:51.461303+0000","last_peered":"2023-09-29T23:29:51.461303+0000","last_clean":"2023-09-29T23:29:51.461303+0000","last_became_active":"2023-09-29T23:23:45.464510+0000","last_became_peered":"2023-09-29T23:23:45.464510+0000","last_unstale":"2023-09-29T23:29:51.461303+0000","last_undegraded":"2023-09-29T23:29:51.461303+0000","last_fullsized":"2023-09-29T23:29:51.461303+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:51.461193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:51.461193+0000","last_clean_scrub_stamp":"2023-09-29T23:29:51.461193+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:18:41.728129+0000","scrub_duration":0.0013191209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'5","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:20.978198+0000","last_change":"2023-09-29T23:29:20.978161+0000","last_active":"2023-09-29T23:29:20.978198+0000","last_peered":"2023-09-29T23:29:20.978198+0000","last_clean":"2023-09-29T23:29:20.978198+0000","last_became_active":"2023-09-29T23:23:45.076856+0000","last_became_peered":"2023-09-29T23:23:45.076856+0000","last_unstale":"2023-09-29T23:29:20.978198+0000","last_undegraded":"2023-09-29T23:29:20.978198+0000","last_fullsized":"2023-09-29T23:29:20.978198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2023-09-29T23:29:20.978063+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2023-09-29T23:29:20.978063+0000","last_clean_scrub_stamp":"2023-09-29T23:29:20.978063+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:43:25.681012+0000","scrub_duration":0.002692945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:22.024275+0000","last_change":"2023-09-29T23:29:22.024242+0000","last_active":"2023-09-29T23:29:22.024275+0000","last_peered":"2023-09-29T23:29:22.024275+0000","last_clean":"2023-09-29T23:29:22.024275+0000","last_became_active":"2023-09-29T23:23:45.461199+0000","last_became_peered":"2023-09-29T23:23:45.461199+0000","last_unstale":"2023-09-29T23:29:22.024275+0000","last_undegraded":"2023-09-29T23:29:22.024275+0000","last_fullsized":"2023-09-29T23:29:22.024275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:22.024151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:22.024151+0000","last_clean_scrub_stamp":"2023-09-29T23:29:22.024151+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:13:23.585922+0000","scrub_duration":0.001280705,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"19'10","reported_seq":33,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:35.954350+0000","last_change":"2023-09-29T23:29:35.954319+0000","last_active":"2023-09-29T23:29:35.954350+0000","last_peered":"2023-09-29T23:29:35.954350+0000","last_clean":"2023-09-29T23:29:35.954350+0000","last_became_active":"2023-09-29T23:23:45.093487+0000","last_became_peered":"2023-09-29T23:23:45.093487+0000","last_unstale":"2023-09-29T23:29:35.954350+0000","last_undegraded":"2023-09-29T23:29:35.954350+0000","last_fullsized":"2023-09-29T23:29:35.954350+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'10","last_scrub_stamp":"2023-09-29T23:29:35.954248+0000","last_deep_scrub":"19'10","last_deep_scrub_stamp":"2023-09-29T23:29:35.954248+0000","last_clean_scrub_stamp":"2023-09-29T23:29:35.954248+0000","objects_scrubbed":4,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:33:43.102652+0000","scrub_duration":0.0072578629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:32.588353+0000","last_change":"2023-09-29T23:29:32.588319+0000","last_active":"2023-09-29T23:29:32.588353+0000","last_peered":"2023-09-29T23:29:32.588353+0000","last_clean":"2023-09-29T23:29:32.588353+0000","last_became_active":"2023-09-29T23:23:45.466667+0000","last_became_peered":"2023-09-29T23:23:45.466667+0000","last_unstale":"2023-09-29T23:29:32.588353+0000","last_undegraded":"2023-09-29T23:29:32.588353+0000","last_fullsized":"2023-09-29T23:29:32.588353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:32.588241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:32.588241+0000","last_clean_scrub_stamp":"2023-09-29T23:29:32.588241+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:40:31.970519+0000","scrub_duration":0.001381953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287078+0000","last_change":"2023-09-29T23:23:45.089727+0000","last_active":"2023-09-29T23:24:37.287078+0000","last_peered":"2023-09-29T23:24:37.287078+0000","last_clean":"2023-09-29T23:24:37.287078+0000","last_became_active":"2023-09-29T23:23:45.089450+0000","last_became_peered":"2023-09-29T23:23:45.089450+0000","last_unstale":"2023-09-29T23:24:37.287078+0000","last_undegraded":"2023-09-29T23:24:37.287078+0000","last_fullsized":"2023-09-29T23:24:37.287078+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:43.493923+0000","last_change":"2023-09-29T23:29:43.493902+0000","last_active":"2023-09-29T23:29:43.493923+0000","last_peered":"2023-09-29T23:29:43.493923+0000","last_clean":"2023-09-29T23:29:43.493923+0000","last_became_active":"2023-09-29T23:23:45.464801+0000","last_became_peered":"2023-09-29T23:23:45.464801+0000","last_unstale":"2023-09-29T23:29:43.493923+0000","last_undegraded":"2023-09-29T23:29:43.493923+0000","last_fullsized":"2023-09-29T23:29:43.493923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:43.493841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:43.493841+0000","last_clean_scrub_stamp":"2023-09-29T23:29:43.493841+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:38:16.507037+0000","scrub_duration":0.0010336309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:37.951615+0000","last_change":"2023-09-29T23:29:37.951590+0000","last_active":"2023-09-29T23:29:37.951615+0000","last_peered":"2023-09-29T23:29:37.951615+0000","last_clean":"2023-09-29T23:29:37.951615+0000","last_became_active":"2023-09-29T23:23:45.092902+0000","last_became_peered":"2023-09-29T23:23:45.092902+0000","last_unstale":"2023-09-29T23:29:37.951615+0000","last_undegraded":"2023-09-29T23:29:37.951615+0000","last_fullsized":"2023-09-29T23:29:37.951615+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:37.951522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:37.951522+0000","last_clean_scrub_stamp":"2023-09-29T23:29:37.951522+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:13:39.513294+0000","scrub_duration":0.0012267249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:30.055361+0000","last_change":"2023-09-29T23:29:30.055315+0000","last_active":"2023-09-29T23:29:30.055361+0000","last_peered":"2023-09-29T23:29:30.055361+0000","last_clean":"2023-09-29T23:29:30.055361+0000","last_became_active":"2023-09-29T23:23:45.465743+0000","last_became_peered":"2023-09-29T23:23:45.465743+0000","last_unstale":"2023-09-29T23:29:30.055361+0000","last_undegraded":"2023-09-29T23:29:30.055361+0000","last_fullsized":"2023-09-29T23:29:30.055361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:30.055241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:30.055241+0000","last_clean_scrub_stamp":"2023-09-29T23:29:30.055241+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:37:44.486033+0000","scrub_duration":0.001322852,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286677+0000","last_change":"2023-09-29T23:23:45.072234+0000","last_active":"2023-09-29T23:24:37.286677+0000","last_peered":"2023-09-29T23:24:37.286677+0000","last_clean":"2023-09-29T23:24:37.286677+0000","last_became_active":"2023-09-29T23:23:45.072009+0000","last_became_peered":"2023-09-29T23:23:45.072009+0000","last_unstale":"2023-09-29T23:24:37.286677+0000","last_undegraded":"2023-09-29T23:24:37.286677+0000","last_fullsized":"2023-09-29T23:24:37.286677+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:36.169278+0000","last_change":"2023-09-29T23:29:36.169248+0000","last_active":"2023-09-29T23:29:36.169278+0000","last_peered":"2023-09-29T23:29:36.169278+0000","last_clean":"2023-09-29T23:29:36.169278+0000","last_became_active":"2023-09-29T23:23:45.466169+0000","last_became_peered":"2023-09-29T23:23:45.466169+0000","last_unstale":"2023-09-29T23:29:36.169278+0000","last_undegraded":"2023-09-29T23:29:36.169278+0000","last_fullsized":"2023-09-29T23:29:36.169278+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:36.169178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:36.169178+0000","last_clean_scrub_stamp":"2023-09-29T23:29:36.169178+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:19:28.821242+0000","scrub_duration":0.001334238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'12","reported_seq":35,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:53.088645+0000","last_change":"2023-09-29T23:29:53.088595+0000","last_active":"2023-09-29T23:29:53.088645+0000","last_peered":"2023-09-29T23:29:53.088645+0000","last_clean":"2023-09-29T23:29:53.088645+0000","last_became_active":"2023-09-29T23:23:45.091386+0000","last_became_peered":"2023-09-29T23:23:45.091386+0000","last_unstale":"2023-09-29T23:29:53.088645+0000","last_undegraded":"2023-09-29T23:29:53.088645+0000","last_fullsized":"2023-09-29T23:29:53.088645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'12","last_scrub_stamp":"2023-09-29T23:29:53.088511+0000","last_deep_scrub":"19'12","last_deep_scrub_stamp":"2023-09-29T23:29:53.088511+0000","last_clean_scrub_stamp":"2023-09-29T23:29:53.088511+0000","objects_scrubbed":4,"log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:23:52.888979+0000","scrub_duration":0.0038113370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:05.861334+0000","last_change":"2023-09-29T23:29:05.861311+0000","last_active":"2023-09-29T23:29:05.861334+0000","last_peered":"2023-09-29T23:29:05.861334+0000","last_clean":"2023-09-29T23:29:05.861334+0000","last_became_active":"2023-09-29T23:23:45.460643+0000","last_became_peered":"2023-09-29T23:23:45.460643+0000","last_unstale":"2023-09-29T23:29:05.861334+0000","last_undegraded":"2023-09-29T23:29:05.861334+0000","last_fullsized":"2023-09-29T23:29:05.861334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:05.861236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:05.861236+0000","last_clean_scrub_stamp":"2023-09-29T23:29:05.861236+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:01:12.962284+0000","scrub_duration":0.0013132969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"19'2","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:49.521484+0000","last_change":"2023-09-29T23:29:49.521453+0000","last_active":"2023-09-29T23:29:49.521484+0000","last_peered":"2023-09-29T23:29:49.521484+0000","last_clean":"2023-09-29T23:29:49.521484+0000","last_became_active":"2023-09-29T23:23:45.077734+0000","last_became_peered":"2023-09-29T23:23:45.077734+0000","last_unstale":"2023-09-29T23:29:49.521484+0000","last_undegraded":"2023-09-29T23:29:49.521484+0000","last_fullsized":"2023-09-29T23:29:49.521484+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2023-09-29T23:29:49.521380+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2023-09-29T23:29:49.521380+0000","last_clean_scrub_stamp":"2023-09-29T23:29:49.521380+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:55:51.218343+0000","scrub_duration":0.0024495670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:21.923919+0000","last_change":"2023-09-29T23:29:21.923888+0000","last_active":"2023-09-29T23:29:21.923919+0000","last_peered":"2023-09-29T23:29:21.923919+0000","last_clean":"2023-09-29T23:29:21.923919+0000","last_became_active":"2023-09-29T23:23:45.467555+0000","last_became_peered":"2023-09-29T23:23:45.467555+0000","last_unstale":"2023-09-29T23:29:21.923919+0000","last_undegraded":"2023-09-29T23:29:21.923919+0000","last_fullsized":"2023-09-29T23:29:21.923919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:21.923791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:21.923791+0000","last_clean_scrub_stamp":"2023-09-29T23:29:21.923791+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:16:52.090307+0000","scrub_duration":0.0011468419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'3","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:48.985616+0000","last_change":"2023-09-29T23:29:48.985585+0000","last_active":"2023-09-29T23:29:48.985616+0000","last_peered":"2023-09-29T23:29:48.985616+0000","last_clean":"2023-09-29T23:29:48.985616+0000","last_became_active":"2023-09-29T23:23:45.092185+0000","last_became_peered":"2023-09-29T23:23:45.092185+0000","last_unstale":"2023-09-29T23:29:48.985616+0000","last_undegraded":"2023-09-29T23:29:48.985616+0000","last_fullsized":"2023-09-29T23:29:48.985616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2023-09-29T23:29:48.985514+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2023-09-29T23:29:48.985514+0000","last_clean_scrub_stamp":"2023-09-29T23:29:48.985514+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:40:48.367793+0000","scrub_duration":0.0024199220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:30.603213+0000","last_change":"2023-09-29T23:29:30.603186+0000","last_active":"2023-09-29T23:29:30.603213+0000","last_peered":"2023-09-29T23:29:30.603213+0000","last_clean":"2023-09-29T23:29:30.603213+0000","last_became_active":"2023-09-29T23:23:45.463806+0000","last_became_peered":"2023-09-29T23:23:45.463806+0000","last_unstale":"2023-09-29T23:29:30.603213+0000","last_undegraded":"2023-09-29T23:29:30.603213+0000","last_fullsized":"2023-09-29T23:29:30.603213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:30.603106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:30.603106+0000","last_clean_scrub_stamp":"2023-09-29T23:29:30.603106+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:58:06.609302+0000","scrub_duration":0.001486621,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'2","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:25.020656+0000","last_change":"2023-09-29T23:29:25.020628+0000","last_active":"2023-09-29T23:29:25.020656+0000","last_peered":"2023-09-29T23:29:25.020656+0000","last_clean":"2023-09-29T23:29:25.020656+0000","last_became_active":"2023-09-29T23:23:45.088535+0000","last_became_peered":"2023-09-29T23:23:45.088535+0000","last_unstale":"2023-09-29T23:29:25.020656+0000","last_undegraded":"2023-09-29T23:29:25.020656+0000","last_fullsized":"2023-09-29T23:29:25.020656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2023-09-29T23:29:25.020562+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2023-09-29T23:29:25.020562+0000","last_clean_scrub_stamp":"2023-09-29T23:29:25.020562+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:48:08.201258+0000","scrub_duration":0.0023368690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:22.533037+0000","last_change":"2023-09-29T23:29:22.533013+0000","last_active":"2023-09-29T23:29:22.533037+0000","last_peered":"2023-09-29T23:29:22.533037+0000","last_clean":"2023-09-29T23:29:22.533037+0000","last_became_active":"2023-09-29T23:23:45.465855+0000","last_became_peered":"2023-09-29T23:23:45.465855+0000","last_unstale":"2023-09-29T23:29:22.533037+0000","last_undegraded":"2023-09-29T23:29:22.533037+0000","last_fullsized":"2023-09-29T23:29:22.533037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:22.532933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:22.532933+0000","last_clean_scrub_stamp":"2023-09-29T23:29:22.532933+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:13:24.094704+0000","scrub_duration":0.001327693,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:49.992317+0000","last_change":"2023-09-29T23:29:49.992287+0000","last_active":"2023-09-29T23:29:49.992317+0000","last_peered":"2023-09-29T23:29:49.992317+0000","last_clean":"2023-09-29T23:29:49.992317+0000","last_became_active":"2023-09-29T23:23:45.092476+0000","last_became_peered":"2023-09-29T23:23:45.092476+0000","last_unstale":"2023-09-29T23:29:49.992317+0000","last_undegraded":"2023-09-29T23:29:49.992317+0000","last_fullsized":"2023-09-29T23:29:49.992317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:49.992215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:49.992215+0000","last_clean_scrub_stamp":"2023-09-29T23:29:49.992215+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:55:16.062531+0000","scrub_duration":0.0012909480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281635+0000","last_change":"2023-09-29T23:23:45.467010+0000","last_active":"2023-09-29T23:24:37.281635+0000","last_peered":"2023-09-29T23:24:37.281635+0000","last_clean":"2023-09-29T23:24:37.281635+0000","last_became_active":"2023-09-29T23:23:45.466694+0000","last_became_peered":"2023-09-29T23:23:45.466694+0000","last_unstale":"2023-09-29T23:24:37.281635+0000","last_undegraded":"2023-09-29T23:24:37.281635+0000","last_fullsized":"2023-09-29T23:24:37.281635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"16'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287019+0000","last_change":"2023-09-29T23:23:45.089622+0000","last_active":"2023-09-29T23:24:37.287019+0000","last_peered":"2023-09-29T23:24:37.287019+0000","last_clean":"2023-09-29T23:24:37.287019+0000","last_became_active":"2023-09-29T23:23:45.089176+0000","last_became_peered":"2023-09-29T23:23:45.089176+0000","last_unstale":"2023-09-29T23:24:37.287019+0000","last_undegraded":"2023-09-29T23:24:37.287019+0000","last_fullsized":"2023-09-29T23:24:37.287019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:27.538075+0000","last_change":"2023-09-29T23:29:27.538029+0000","last_active":"2023-09-29T23:29:27.538075+0000","last_peered":"2023-09-29T23:29:27.538075+0000","last_clean":"2023-09-29T23:29:27.538075+0000","last_became_active":"2023-09-29T23:23:45.465127+0000","last_became_peered":"2023-09-29T23:23:45.465127+0000","last_unstale":"2023-09-29T23:29:27.538075+0000","last_undegraded":"2023-09-29T23:29:27.538075+0000","last_fullsized":"2023-09-29T23:29:27.538075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:27.537939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:27.537939+0000","last_clean_scrub_stamp":"2023-09-29T23:29:27.537939+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:00:35.594777+0000","scrub_duration":0.00147858,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:31.072328+0000","last_change":"2023-09-29T23:29:31.072300+0000","last_active":"2023-09-29T23:29:31.072328+0000","last_peered":"2023-09-29T23:29:31.072328+0000","last_clean":"2023-09-29T23:29:31.072328+0000","last_became_active":"2023-09-29T23:23:45.075313+0000","last_became_peered":"2023-09-29T23:23:45.075313+0000","last_unstale":"2023-09-29T23:29:31.072328+0000","last_undegraded":"2023-09-29T23:29:31.072328+0000","last_fullsized":"2023-09-29T23:29:31.072328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:31.072231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:31.072231+0000","last_clean_scrub_stamp":"2023-09-29T23:29:31.072231+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:58:07.078428+0000","scrub_duration":0.001297475,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:20.010506+0000","last_change":"2023-09-29T23:29:20.010458+0000","last_active":"2023-09-29T23:29:20.010506+0000","last_peered":"2023-09-29T23:29:20.010506+0000","last_clean":"2023-09-29T23:29:20.010506+0000","last_became_active":"2023-09-29T23:24:37.288220+0000","last_became_peered":"2023-09-29T23:24:37.288220+0000","last_unstale":"2023-09-29T23:29:20.010506+0000","last_undegraded":"2023-09-29T23:29:20.010506+0000","last_fullsized":"2023-09-29T23:29:20.010506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:20.010379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:20.010379+0000","last_clean_scrub_stamp":"2023-09-29T23:29:20.010379+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:33:27.158783+0000","scrub_duration":0.0012507110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:34.135079+0000","last_change":"2023-09-29T23:29:34.135052+0000","last_active":"2023-09-29T23:29:34.135079+0000","last_peered":"2023-09-29T23:29:34.135079+0000","last_clean":"2023-09-29T23:29:34.135079+0000","last_became_active":"2023-09-29T23:23:45.075772+0000","last_became_peered":"2023-09-29T23:23:45.075772+0000","last_unstale":"2023-09-29T23:29:34.135079+0000","last_undegraded":"2023-09-29T23:29:34.135079+0000","last_fullsized":"2023-09-29T23:29:34.135079+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:34.134977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:34.134977+0000","last_clean_scrub_stamp":"2023-09-29T23:29:34.134977+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:55:00.205293+0000","scrub_duration":0.0011951520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.283383+0000","last_change":"2023-09-29T23:23:45.463124+0000","last_active":"2023-09-29T23:24:37.283383+0000","last_peered":"2023-09-29T23:24:37.283383+0000","last_clean":"2023-09-29T23:24:37.283383+0000","last_became_active":"2023-09-29T23:23:45.462583+0000","last_became_peered":"2023-09-29T23:23:45.462583+0000","last_unstale":"2023-09-29T23:24:37.283383+0000","last_undegraded":"2023-09-29T23:24:37.283383+0000","last_fullsized":"2023-09-29T23:24:37.283383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286442+0000","last_change":"2023-09-29T23:23:45.088750+0000","last_active":"2023-09-29T23:24:37.286442+0000","last_peered":"2023-09-29T23:24:37.286442+0000","last_clean":"2023-09-29T23:24:37.286442+0000","last_became_active":"2023-09-29T23:23:45.088506+0000","last_became_peered":"2023-09-29T23:23:45.088506+0000","last_unstale":"2023-09-29T23:24:37.286442+0000","last_undegraded":"2023-09-29T23:24:37.286442+0000","last_fullsized":"2023-09-29T23:24:37.286442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:25.556018+0000","last_change":"2023-09-29T23:29:25.555980+0000","last_active":"2023-09-29T23:29:25.556018+0000","last_peered":"2023-09-29T23:29:25.556018+0000","last_clean":"2023-09-29T23:29:25.556018+0000","last_became_active":"2023-09-29T23:23:45.477335+0000","last_became_peered":"2023-09-29T23:23:45.477335+0000","last_unstale":"2023-09-29T23:29:25.556018+0000","last_undegraded":"2023-09-29T23:29:25.556018+0000","last_fullsized":"2023-09-29T23:29:25.556018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:25.555859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:25.555859+0000","last_clean_scrub_stamp":"2023-09-29T23:29:25.555859+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:48:08.736556+0000","scrub_duration":0.001410761,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:44.036092+0000","last_change":"2023-09-29T23:29:44.036057+0000","last_active":"2023-09-29T23:29:44.036092+0000","last_peered":"2023-09-29T23:29:44.036092+0000","last_clean":"2023-09-29T23:29:44.036092+0000","last_became_active":"2023-09-29T23:23:41.047701+0000","last_became_peered":"2023-09-29T23:23:41.047701+0000","last_unstale":"2023-09-29T23:29:44.036092+0000","last_undegraded":"2023-09-29T23:29:44.036092+0000","last_fullsized":"2023-09-29T23:29:44.036092+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:44.035955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:44.035955+0000","last_clean_scrub_stamp":"2023-09-29T23:29:44.035955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:00:52.092793+0000","scrub_duration":0.0012373569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"19'2","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:38.169235+0000","last_change":"2023-09-29T23:29:38.169200+0000","last_active":"2023-09-29T23:29:38.169235+0000","last_peered":"2023-09-29T23:29:38.169235+0000","last_clean":"2023-09-29T23:29:38.169235+0000","last_became_active":"2023-09-29T23:23:45.075249+0000","last_became_peered":"2023-09-29T23:23:45.075249+0000","last_unstale":"2023-09-29T23:29:38.169235+0000","last_undegraded":"2023-09-29T23:29:38.169235+0000","last_fullsized":"2023-09-29T23:29:38.169235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2023-09-29T23:29:38.169127+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2023-09-29T23:29:38.169127+0000","last_clean_scrub_stamp":"2023-09-29T23:29:38.169127+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:31:27.775746+0000","scrub_duration":0.0022639449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:57.160844+0000","last_change":"2023-09-29T23:29:57.160818+0000","last_active":"2023-09-29T23:29:57.160844+0000","last_peered":"2023-09-29T23:29:57.160844+0000","last_clean":"2023-09-29T23:29:57.160844+0000","last_became_active":"2023-09-29T23:23:45.459933+0000","last_became_peered":"2023-09-29T23:23:45.459933+0000","last_unstale":"2023-09-29T23:29:57.160844+0000","last_undegraded":"2023-09-29T23:29:57.160844+0000","last_fullsized":"2023-09-29T23:29:57.160844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:57.160742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:57.160742+0000","last_clean_scrub_stamp":"2023-09-29T23:29:57.160742+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:49:24.728236+0000","scrub_duration":0.00150358,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281338+0000","last_change":"2023-09-29T23:23:41.051640+0000","last_active":"2023-09-29T23:24:37.281338+0000","last_peered":"2023-09-29T23:24:37.281338+0000","last_clean":"2023-09-29T23:24:37.281338+0000","last_became_active":"2023-09-29T23:23:41.051398+0000","last_became_peered":"2023-09-29T23:23:41.051398+0000","last_unstale":"2023-09-29T23:24:37.281338+0000","last_undegraded":"2023-09-29T23:24:37.281338+0000","last_fullsized":"2023-09-29T23:24:37.281338+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"19'3","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:44.269068+0000","last_change":"2023-09-29T23:29:44.269039+0000","last_active":"2023-09-29T23:29:44.269068+0000","last_peered":"2023-09-29T23:29:44.269068+0000","last_clean":"2023-09-29T23:29:44.269068+0000","last_became_active":"2023-09-29T23:23:45.076293+0000","last_became_peered":"2023-09-29T23:23:45.076293+0000","last_unstale":"2023-09-29T23:29:44.269068+0000","last_undegraded":"2023-09-29T23:29:44.269068+0000","last_fullsized":"2023-09-29T23:29:44.269068+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2023-09-29T23:29:44.268975+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2023-09-29T23:29:44.268975+0000","last_clean_scrub_stamp":"2023-09-29T23:29:44.268975+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:38:17.282170+0000","scrub_duration":0.001934049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:29.587702+0000","last_change":"2023-09-29T23:29:29.587659+0000","last_active":"2023-09-29T23:29:29.587702+0000","last_peered":"2023-09-29T23:29:29.587702+0000","last_clean":"2023-09-29T23:29:29.587702+0000","last_became_active":"2023-09-29T23:23:45.466115+0000","last_became_peered":"2023-09-29T23:23:45.466115+0000","last_unstale":"2023-09-29T23:29:29.587702+0000","last_undegraded":"2023-09-29T23:29:29.587702+0000","last_fullsized":"2023-09-29T23:29:29.587702+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:29.587583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:29.587583+0000","last_clean_scrub_stamp":"2023-09-29T23:29:29.587583+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:37:44.018376+0000","scrub_duration":0.001426788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:52.216025+0000","last_change":"2023-09-29T23:29:52.216000+0000","last_active":"2023-09-29T23:29:52.216025+0000","last_peered":"2023-09-29T23:29:52.216025+0000","last_clean":"2023-09-29T23:29:52.216025+0000","last_became_active":"2023-09-29T23:23:41.049786+0000","last_became_peered":"2023-09-29T23:23:41.049786+0000","last_unstale":"2023-09-29T23:29:52.216025+0000","last_undegraded":"2023-09-29T23:29:52.216025+0000","last_fullsized":"2023-09-29T23:29:52.216025+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:52.215917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:52.215917+0000","last_clean_scrub_stamp":"2023-09-29T23:29:52.215917+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:18:42.482853+0000","scrub_duration":0.001382861,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:47.017087+0000","last_change":"2023-09-29T23:29:47.017056+0000","last_active":"2023-09-29T23:29:47.017087+0000","last_peered":"2023-09-29T23:29:47.017087+0000","last_clean":"2023-09-29T23:29:47.017087+0000","last_became_active":"2023-09-29T23:23:45.091162+0000","last_became_peered":"2023-09-29T23:23:45.091162+0000","last_unstale":"2023-09-29T23:29:47.017087+0000","last_undegraded":"2023-09-29T23:29:47.017087+0000","last_fullsized":"2023-09-29T23:29:47.017087+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:47.016976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:47.016976+0000","last_clean_scrub_stamp":"2023-09-29T23:29:47.016976+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:58:23.023172+0000","scrub_duration":0.0015069770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:35.597361+0000","last_change":"2023-09-29T23:29:35.597332+0000","last_active":"2023-09-29T23:29:35.597361+0000","last_peered":"2023-09-29T23:29:35.597361+0000","last_clean":"2023-09-29T23:29:35.597361+0000","last_became_active":"2023-09-29T23:23:45.473861+0000","last_became_peered":"2023-09-29T23:23:45.473861+0000","last_unstale":"2023-09-29T23:29:35.597361+0000","last_undegraded":"2023-09-29T23:29:35.597361+0000","last_fullsized":"2023-09-29T23:29:35.597361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:35.597256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:35.597256+0000","last_clean_scrub_stamp":"2023-09-29T23:29:35.597256+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:19:28.249320+0000","scrub_duration":0.001352902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286677+0000","last_change":"2023-09-29T23:23:41.049685+0000","last_active":"2023-09-29T23:24:37.286677+0000","last_peered":"2023-09-29T23:24:37.286677+0000","last_clean":"2023-09-29T23:24:37.286677+0000","last_became_active":"2023-09-29T23:23:41.049442+0000","last_became_peered":"2023-09-29T23:23:41.049442+0000","last_unstale":"2023-09-29T23:24:37.286677+0000","last_undegraded":"2023-09-29T23:24:37.286677+0000","last_fullsized":"2023-09-29T23:24:37.286677+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:48.013392+0000","last_change":"2023-09-29T23:29:48.013344+0000","last_active":"2023-09-29T23:29:48.013392+0000","last_peered":"2023-09-29T23:29:48.013392+0000","last_clean":"2023-09-29T23:29:48.013392+0000","last_became_active":"2023-09-29T23:23:45.092042+0000","last_became_peered":"2023-09-29T23:23:45.092042+0000","last_unstale":"2023-09-29T23:29:48.013392+0000","last_undegraded":"2023-09-29T23:29:48.013392+0000","last_fullsized":"2023-09-29T23:29:48.013392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:48.013267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:48.013267+0000","last_clean_scrub_stamp":"2023-09-29T23:29:48.013267+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:28:35.339069+0000","scrub_duration":0.0013823450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.280857+0000","last_change":"2023-09-29T23:23:45.461917+0000","last_active":"2023-09-29T23:24:37.280857+0000","last_peered":"2023-09-29T23:24:37.280857+0000","last_clean":"2023-09-29T23:24:37.280857+0000","last_became_active":"2023-09-29T23:23:45.461228+0000","last_became_peered":"2023-09-29T23:23:45.461228+0000","last_unstale":"2023-09-29T23:24:37.280857+0000","last_undegraded":"2023-09-29T23:24:37.280857+0000","last_fullsized":"2023-09-29T23:24:37.280857+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:50.258815+0000","last_change":"2023-09-29T23:29:50.258790+0000","last_active":"2023-09-29T23:29:50.258815+0000","last_peered":"2023-09-29T23:29:50.258815+0000","last_clean":"2023-09-29T23:29:50.258815+0000","last_became_active":"2023-09-29T23:23:41.050731+0000","last_became_peered":"2023-09-29T23:23:41.050731+0000","last_unstale":"2023-09-29T23:29:50.258815+0000","last_undegraded":"2023-09-29T23:29:50.258815+0000","last_fullsized":"2023-09-29T23:29:50.258815+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:50.258719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:50.258719+0000","last_clean_scrub_stamp":"2023-09-29T23:29:50.258719+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:55:51.955682+0000","scrub_duration":0.0012560539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.280998+0000","last_change":"2023-09-29T23:23:45.088759+0000","last_active":"2023-09-29T23:24:37.280998+0000","last_peered":"2023-09-29T23:24:37.280998+0000","last_clean":"2023-09-29T23:24:37.280998+0000","last_became_active":"2023-09-29T23:23:45.088510+0000","last_became_peered":"2023-09-29T23:23:45.088510+0000","last_unstale":"2023-09-29T23:24:37.280998+0000","last_undegraded":"2023-09-29T23:24:37.280998+0000","last_fullsized":"2023-09-29T23:24:37.280998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:02.256509+0000","last_change":"2023-09-29T23:29:02.256478+0000","last_active":"2023-09-29T23:29:02.256509+0000","last_peered":"2023-09-29T23:29:02.256509+0000","last_clean":"2023-09-29T23:29:02.256509+0000","last_became_active":"2023-09-29T23:23:45.461672+0000","last_became_peered":"2023-09-29T23:23:45.461672+0000","last_unstale":"2023-09-29T23:29:02.256509+0000","last_undegraded":"2023-09-29T23:29:02.256509+0000","last_fullsized":"2023-09-29T23:29:02.256509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:02.256385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:02.256385+0000","last_clean_scrub_stamp":"2023-09-29T23:29:02.256385+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:07:21.355472+0000","scrub_duration":0.0012288970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:40.998542+0000","last_change":"2023-09-29T23:29:40.998515+0000","last_active":"2023-09-29T23:29:40.998542+0000","last_peered":"2023-09-29T23:29:40.998542+0000","last_clean":"2023-09-29T23:29:40.998542+0000","last_became_active":"2023-09-29T23:23:41.046803+0000","last_became_peered":"2023-09-29T23:23:41.046803+0000","last_unstale":"2023-09-29T23:29:40.998542+0000","last_undegraded":"2023-09-29T23:29:40.998542+0000","last_fullsized":"2023-09-29T23:29:40.998542+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:40.998440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:40.998440+0000","last_clean_scrub_stamp":"2023-09-29T23:29:40.998440+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:39:47.280530+0000","scrub_duration":0.0015252709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286695+0000","last_change":"2023-09-29T23:23:45.073226+0000","last_active":"2023-09-29T23:24:37.286695+0000","last_peered":"2023-09-29T23:24:37.286695+0000","last_clean":"2023-09-29T23:24:37.286695+0000","last_became_active":"2023-09-29T23:23:45.072973+0000","last_became_peered":"2023-09-29T23:23:45.072973+0000","last_unstale":"2023-09-29T23:24:37.286695+0000","last_undegraded":"2023-09-29T23:24:37.286695+0000","last_fullsized":"2023-09-29T23:24:37.286695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:31.558487+0000","last_change":"2023-09-29T23:29:31.558456+0000","last_active":"2023-09-29T23:29:31.558487+0000","last_peered":"2023-09-29T23:29:31.558487+0000","last_clean":"2023-09-29T23:29:31.558487+0000","last_became_active":"2023-09-29T23:23:45.474318+0000","last_became_peered":"2023-09-29T23:23:45.474318+0000","last_unstale":"2023-09-29T23:29:31.558487+0000","last_undegraded":"2023-09-29T23:29:31.558487+0000","last_fullsized":"2023-09-29T23:29:31.558487+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:31.558347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:31.558347+0000","last_clean_scrub_stamp":"2023-09-29T23:29:31.558347+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:28:18.884148+0000","scrub_duration":0.0014565979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:55.181446+0000","last_change":"2023-09-29T23:29:55.181415+0000","last_active":"2023-09-29T23:29:55.181446+0000","last_peered":"2023-09-29T23:29:55.181446+0000","last_clean":"2023-09-29T23:29:55.181446+0000","last_became_active":"2023-09-29T23:23:41.050639+0000","last_became_peered":"2023-09-29T23:23:41.050639+0000","last_unstale":"2023-09-29T23:29:55.181446+0000","last_undegraded":"2023-09-29T23:29:55.181446+0000","last_fullsized":"2023-09-29T23:29:55.181446+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:55.181345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:55.181345+0000","last_clean_scrub_stamp":"2023-09-29T23:29:55.181345+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:49:46.987614+0000","scrub_duration":0.0012601999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281476+0000","last_change":"2023-09-29T23:23:45.077040+0000","last_active":"2023-09-29T23:24:37.281476+0000","last_peered":"2023-09-29T23:24:37.281476+0000","last_clean":"2023-09-29T23:24:37.281476+0000","last_became_active":"2023-09-29T23:23:45.076806+0000","last_became_peered":"2023-09-29T23:23:45.076806+0000","last_unstale":"2023-09-29T23:24:37.281476+0000","last_undegraded":"2023-09-29T23:24:37.281476+0000","last_fullsized":"2023-09-29T23:24:37.281476+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:07.259573+0000","last_change":"2023-09-29T23:29:07.259539+0000","last_active":"2023-09-29T23:29:07.259573+0000","last_peered":"2023-09-29T23:29:07.259573+0000","last_clean":"2023-09-29T23:29:07.259573+0000","last_became_active":"2023-09-29T23:23:45.460913+0000","last_became_peered":"2023-09-29T23:23:45.460913+0000","last_unstale":"2023-09-29T23:29:07.259573+0000","last_undegraded":"2023-09-29T23:29:07.259573+0000","last_fullsized":"2023-09-29T23:29:07.259573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:07.259462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:07.259462+0000","last_clean_scrub_stamp":"2023-09-29T23:29:07.259462+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:35:33.384041+0000","scrub_duration":0.001325735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.282135+0000","last_change":"2023-09-29T23:23:41.050074+0000","last_active":"2023-09-29T23:24:37.282135+0000","last_peered":"2023-09-29T23:24:37.282135+0000","last_clean":"2023-09-29T23:24:37.282135+0000","last_became_active":"2023-09-29T23:23:41.049783+0000","last_became_peered":"2023-09-29T23:23:41.049783+0000","last_unstale":"2023-09-29T23:24:37.282135+0000","last_undegraded":"2023-09-29T23:24:37.282135+0000","last_fullsized":"2023-09-29T23:24:37.282135+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:40.034870+0000","last_clean_scrub_stamp":"2023-09-29T23:23:40.034870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281543+0000","last_change":"2023-09-29T23:23:45.076087+0000","last_active":"2023-09-29T23:24:37.281543+0000","last_peered":"2023-09-29T23:24:37.281543+0000","last_clean":"2023-09-29T23:24:37.281543+0000","last_became_active":"2023-09-29T23:23:45.075273+0000","last_became_peered":"2023-09-29T23:23:45.075273+0000","last_unstale":"2023-09-29T23:24:37.281543+0000","last_undegraded":"2023-09-29T23:24:37.281543+0000","last_fullsized":"2023-09-29T23:24:37.281543+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:56.134483+0000","last_change":"2023-09-29T23:29:56.134457+0000","last_active":"2023-09-29T23:29:56.134483+0000","last_peered":"2023-09-29T23:29:56.134483+0000","last_clean":"2023-09-29T23:29:56.134483+0000","last_became_active":"2023-09-29T23:23:45.458250+0000","last_became_peered":"2023-09-29T23:23:45.458250+0000","last_unstale":"2023-09-29T23:29:56.134483+0000","last_undegraded":"2023-09-29T23:29:56.134483+0000","last_fullsized":"2023-09-29T23:29:56.134483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:56.134376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:56.134376+0000","last_clean_scrub_stamp":"2023-09-29T23:29:56.134376+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:37:36.784301+0000","scrub_duration":0.0013877640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"16'2","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287008+0000","last_change":"2023-09-29T23:23:45.076932+0000","last_active":"2023-09-29T23:24:37.287008+0000","last_peered":"2023-09-29T23:24:37.287008+0000","last_clean":"2023-09-29T23:24:37.287008+0000","last_became_active":"2023-09-29T23:23:45.076638+0000","last_became_peered":"2023-09-29T23:23:45.076638+0000","last_unstale":"2023-09-29T23:24:37.287008+0000","last_undegraded":"2023-09-29T23:24:37.287008+0000","last_fullsized":"2023-09-29T23:24:37.287008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:31.872101+0000","last_change":"2023-09-29T23:29:31.872071+0000","last_active":"2023-09-29T23:29:31.872101+0000","last_peered":"2023-09-29T23:29:31.872101+0000","last_clean":"2023-09-29T23:29:31.872101+0000","last_became_active":"2023-09-29T23:23:45.471013+0000","last_became_peered":"2023-09-29T23:23:45.471013+0000","last_unstale":"2023-09-29T23:29:31.872101+0000","last_undegraded":"2023-09-29T23:29:31.872101+0000","last_fullsized":"2023-09-29T23:29:31.872101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:31.871991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:31.871991+0000","last_clean_scrub_stamp":"2023-09-29T23:29:31.871991+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:32:09.372334+0000","scrub_duration":0.0012566319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"16'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.298264+0000","last_change":"2023-09-29T23:24:37.295660+0000","last_active":"2023-09-29T23:24:37.298264+0000","last_peered":"2023-09-29T23:24:37.298264+0000","last_clean":"2023-09-29T23:24:37.298264+0000","last_became_active":"2023-09-29T23:24:37.292123+0000","last_became_peered":"2023-09-29T23:24:37.292123+0000","last_unstale":"2023-09-29T23:24:37.298264+0000","last_undegraded":"2023-09-29T23:24:37.298264+0000","last_fullsized":"2023-09-29T23:24:37.298264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281244+0000","last_change":"2023-09-29T23:23:45.471929+0000","last_active":"2023-09-29T23:24:37.281244+0000","last_peered":"2023-09-29T23:24:37.281244+0000","last_clean":"2023-09-29T23:24:37.281244+0000","last_became_active":"2023-09-29T23:23:45.471673+0000","last_became_peered":"2023-09-29T23:23:45.471673+0000","last_unstale":"2023-09-29T23:24:37.281244+0000","last_undegraded":"2023-09-29T23:24:37.281244+0000","last_fullsized":"2023-09-29T23:24:37.281244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:54.125173+0000","last_change":"2023-09-29T23:29:54.125148+0000","last_active":"2023-09-29T23:29:54.125173+0000","last_peered":"2023-09-29T23:29:54.125173+0000","last_clean":"2023-09-29T23:29:54.125173+0000","last_became_active":"2023-09-29T23:23:45.092203+0000","last_became_peered":"2023-09-29T23:23:45.092203+0000","last_unstale":"2023-09-29T23:29:54.125173+0000","last_undegraded":"2023-09-29T23:29:54.125173+0000","last_fullsized":"2023-09-29T23:29:54.125173+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'1","last_scrub_stamp":"2023-09-29T23:29:54.125069+0000","last_deep_scrub":"16'1","last_deep_scrub_stamp":"2023-09-29T23:29:54.125069+0000","last_clean_scrub_stamp":"2023-09-29T23:29:54.125069+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:41:19.507992+0000","scrub_duration":0.0014059070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:57.528090+0000","last_change":"2023-09-29T23:29:57.528059+0000","last_active":"2023-09-29T23:29:57.528090+0000","last_peered":"2023-09-29T23:29:57.528090+0000","last_clean":"2023-09-29T23:29:57.528090+0000","last_became_active":"2023-09-29T23:23:45.464202+0000","last_became_peered":"2023-09-29T23:23:45.464202+0000","last_unstale":"2023-09-29T23:29:57.528090+0000","last_undegraded":"2023-09-29T23:29:57.528090+0000","last_fullsized":"2023-09-29T23:29:57.528090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:57.527982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:57.527982+0000","last_clean_scrub_stamp":"2023-09-29T23:29:57.527982+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:09:06.682144+0000","scrub_duration":0.0013085379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1f","version":"16'4","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287250+0000","last_change":"2023-09-29T23:23:45.074017+0000","last_active":"2023-09-29T23:24:37.287250+0000","last_peered":"2023-09-29T23:24:37.287250+0000","last_clean":"2023-09-29T23:24:37.287250+0000","last_became_active":"2023-09-29T23:23:45.073772+0000","last_became_peered":"2023-09-29T23:23:45.073772+0000","last_unstale":"2023-09-29T23:24:37.287250+0000","last_undegraded":"2023-09-29T23:24:37.287250+0000","last_fullsized":"2023-09-29T23:24:37.287250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:44.046567+0000","last_clean_scrub_stamp":"2023-09-29T23:23:44.046567+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:14.852011+0000","last_change":"2023-09-29T23:29:14.851983+0000","last_active":"2023-09-29T23:29:14.852011+0000","last_peered":"2023-09-29T23:29:14.852011+0000","last_clean":"2023-09-29T23:29:14.852011+0000","last_became_active":"2023-09-29T23:23:45.460548+0000","last_became_peered":"2023-09-29T23:23:45.460548+0000","last_unstale":"2023-09-29T23:29:14.852011+0000","last_undegraded":"2023-09-29T23:29:14.852011+0000","last_fullsized":"2023-09-29T23:29:14.852011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:14.851891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:14.851891+0000","last_clean_scrub_stamp":"2023-09-29T23:29:14.851891+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:08:19.031301+0000","scrub_duration":0.0015205469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:19.888652+0000","last_change":"2023-09-29T23:29:19.888625+0000","last_active":"2023-09-29T23:29:19.888652+0000","last_peered":"2023-09-29T23:29:19.888652+0000","last_clean":"2023-09-29T23:29:19.888652+0000","last_became_active":"2023-09-29T23:23:45.471294+0000","last_became_peered":"2023-09-29T23:23:45.471294+0000","last_unstale":"2023-09-29T23:29:19.888652+0000","last_undegraded":"2023-09-29T23:29:19.888652+0000","last_fullsized":"2023-09-29T23:29:19.888652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:19.888553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:19.888553+0000","last_clean_scrub_stamp":"2023-09-29T23:29:19.888553+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:21:05.111883+0000","scrub_duration":0.0012268019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:16.870489+0000","last_change":"2023-09-29T23:29:16.870462+0000","last_active":"2023-09-29T23:29:16.870489+0000","last_peered":"2023-09-29T23:29:16.870489+0000","last_clean":"2023-09-29T23:29:16.870489+0000","last_became_active":"2023-09-29T23:23:45.461188+0000","last_became_peered":"2023-09-29T23:23:45.461188+0000","last_unstale":"2023-09-29T23:29:16.870489+0000","last_undegraded":"2023-09-29T23:29:16.870489+0000","last_fullsized":"2023-09-29T23:29:16.870489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:16.870393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:16.870393+0000","last_clean_scrub_stamp":"2023-09-29T23:29:16.870393+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:08:57.437070+0000","scrub_duration":0.00131145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286879+0000","last_change":"2023-09-29T23:23:45.473685+0000","last_active":"2023-09-29T23:24:37.286879+0000","last_peered":"2023-09-29T23:24:37.286879+0000","last_clean":"2023-09-29T23:24:37.286879+0000","last_became_active":"2023-09-29T23:23:45.473438+0000","last_became_peered":"2023-09-29T23:23:45.473438+0000","last_unstale":"2023-09-29T23:24:37.286879+0000","last_undegraded":"2023-09-29T23:24:37.286879+0000","last_fullsized":"2023-09-29T23:24:37.286879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:21.580746+0000","last_change":"2023-09-29T23:29:21.580719+0000","last_active":"2023-09-29T23:29:21.580746+0000","last_peered":"2023-09-29T23:29:21.580746+0000","last_clean":"2023-09-29T23:29:21.580746+0000","last_became_active":"2023-09-29T23:23:45.474163+0000","last_became_peered":"2023-09-29T23:23:45.474163+0000","last_unstale":"2023-09-29T23:29:21.580746+0000","last_undegraded":"2023-09-29T23:29:21.580746+0000","last_fullsized":"2023-09-29T23:29:21.580746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:21.580646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:21.580646+0000","last_clean_scrub_stamp":"2023-09-29T23:29:21.580646+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:43:26.283595+0000","scrub_duration":0.001312361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:16.435331+0000","last_change":"2023-09-29T23:29:16.435290+0000","last_active":"2023-09-29T23:29:16.435331+0000","last_peered":"2023-09-29T23:29:16.435331+0000","last_clean":"2023-09-29T23:29:16.435331+0000","last_became_active":"2023-09-29T23:23:45.473063+0000","last_became_peered":"2023-09-29T23:23:45.473063+0000","last_unstale":"2023-09-29T23:29:16.435331+0000","last_undegraded":"2023-09-29T23:29:16.435331+0000","last_fullsized":"2023-09-29T23:29:16.435331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:16.435179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:16.435179+0000","last_clean_scrub_stamp":"2023-09-29T23:29:16.435179+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:31:53.935521+0000","scrub_duration":0.001480377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.281861+0000","last_change":"2023-09-29T23:23:45.463712+0000","last_active":"2023-09-29T23:24:37.281861+0000","last_peered":"2023-09-29T23:24:37.281861+0000","last_clean":"2023-09-29T23:24:37.281861+0000","last_became_active":"2023-09-29T23:23:45.463269+0000","last_became_peered":"2023-09-29T23:23:45.463269+0000","last_unstale":"2023-09-29T23:24:37.281861+0000","last_undegraded":"2023-09-29T23:24:37.281861+0000","last_fullsized":"2023-09-29T23:24:37.281861+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":64,"acting":64,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705743,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5636,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":104851964,"statfs":{"total":107374182400,"available":107368411136,"internally_reserved":0,"allocated":192512,"data_stored":54287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 29 23:29:54 2023","interfaces":[{"interface":"back","average":{"1min":0.27900000000000003,"5min":0.28599999999999998,"15min":0.27600000000000002},"min":{"1min":0.22800000000000001,"5min":0.14499999999999999,"15min":0.14499999999999999},"max":{"1min":0.377,"5min":0.435,"15min":0.435},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.27600000000000002},"min":{"1min":0.22900000000000001,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.40300000000000002,"5min":0.437,"15min":0.437},"last":0.307}]},{"osd":2,"last update":"Fri Sep 29 23:29:54 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.30099999999999999,"15min":0.27900000000000003},"min":{"1min":0.214,"5min":0.20699999999999999,"15min":0.186},"max":{"1min":0.42499999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.318,"5min":0.316,"15min":0.29599999999999999},"min":{"1min":0.26900000000000002,"5min":0.191,"15min":0.191},"max":{"1min":0.437,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.35299999999999998}]}]},{"osd":2,"up_from":8,"seq":34359738447,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5564,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852036,"statfs":{"total":107374182400,"available":107368484864,"internally_reserved":0,"allocated":184320,"data_stored":53655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 29 23:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.28199999999999997,"15min":0.28799999999999998},"min":{"1min":0.21099999999999999,"5min":0.184,"15min":0.17699999999999999},"max":{"1min":0.40400000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.311},{"interface":"front","average":{"1min":0.311,"5min":0.29299999999999998,"15min":0.29799999999999999},"min":{"1min":0.222,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.41899999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.33200000000000002}]},{"osd":1,"last update":"Fri Sep 29 23:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.30199999999999999,"15min":0.30099999999999999},"min":{"1min":0.224,"5min":0.20399999999999999,"15min":0.189},"max":{"1min":0.44400000000000001,"5min":0.498,"15min":0.498},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.314,"15min":0.318},"min":{"1min":0.23799999999999999,"5min":0.21199999999999999,"15min":0.20499999999999999},"max":{"1min":0.45700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.35099999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705742,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5688,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":104851912,"statfs":{"total":107374182400,"available":107368357888,"internally_reserved":0,"allocated":180224,"data_stored":52715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 29 23:29:48 2023","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.27800000000000002,"15min":0.28399999999999997},"min":{"1min":0.21099999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.29499999999999998,"5min":0.28799999999999998,"15min":0.27200000000000002},"min":{"1min":0.23100000000000001,"5min":0.187,"15min":0.17799999999999999},"max":{"1min":0.41699999999999998,"5min":0.44,"15min":0.44},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Sep 29 23:29:48 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.29599999999999999,"15min":0.27200000000000002},"min":{"1min":0.24099999999999999,"5min":0.19900000000000001,"15min":0.191},"max":{"1min":0.42999999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.438},{"interface":"front","average":{"1min":0.312,"5min":0.30399999999999999,"15min":0.28999999999999998},"min":{"1min":0.245,"5min":0.215,"15min":0.215},"max":{"1min":0.441,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.47199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-29T23:30:03.919 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.919 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.919 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.920 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.920 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.920 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.920 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.920 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.920 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.920 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.920 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.921 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.921 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.921 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.921 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.921 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.921 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.922 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.922 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.922 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.922 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.922 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.923 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.923 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.923 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.923 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.923 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.923 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.924 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-09-29T23:23:40.034870+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=40, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.924 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.924 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.924 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.924 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.924 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-09-29T23:23:44.046567+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=44, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.924 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.925 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:03.925 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-29T23:30:23.926 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:30:24.062 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.062+0000 7f758bfff700 1 Processor -- start 2023-09-29T23:30:24.063 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.062+0000 7f758bfff700 1 -- start start 2023-09-29T23:30:24.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.062+0000 7f758bfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f758c097fb0 0x7f758c095900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:30:24.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.062+0000 7f758bfff700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f758c096b40 con 0x7f758c09ec90 2023-09-29T23:30:24.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.062+0000 7f758bfff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f758c098380 con 0x7f758c097fb0 2023-09-29T23:30:24.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.062+0000 7f758affd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f758c097fb0 0x7f758c095900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:30:24.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.062+0000 7f75827fc700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f758c09ec90 0x7f758c095e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:51246/0 (socket says 172.21.15.92:51246) 2023-09-29T23:30:24.064 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.062+0000 7f75827fc700 1 -- 172.21.15.92:0/2449167694 learned_addr learned my addr 172.21.15.92:0/2449167694 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:30:24.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.063+0000 7f758affd700 1 -- 172.21.15.92:0/2449167694 >> v1:172.21.15.92:6789/0 conn(0x7f758c09ec90 legacy=0x7f758c095e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:30:24.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.063+0000 7f758affd700 1 -- 172.21.15.92:0/2449167694 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c0977d0 con 0x7f758c097fb0 2023-09-29T23:30:24.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.063+0000 7f758affd700 1 --2- 172.21.15.92:0/2449167694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f758c097fb0 0x7f758c095900 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f757c00a9f0 tx=0x7f757c00a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa7994337e2a4aa server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:30:24.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.063+0000 7f758a7fc700 1 -- 172.21.15.92:0/2449167694 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f757c005c10 con 0x7f758c097fb0 2023-09-29T23:30:24.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.063+0000 7f758a7fc700 1 -- 172.21.15.92:0/2449167694 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c005d70 con 0x7f758c097fb0 2023-09-29T23:30:24.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.063+0000 7f758a7fc700 1 -- 172.21.15.92:0/2449167694 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f757c00c930 con 0x7f758c097fb0 2023-09-29T23:30:24.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.064+0000 7f758bfff700 1 -- 172.21.15.92:0/2449167694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f758c097fb0 msgr2=0x7f758c095900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:30:24.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.064+0000 7f758bfff700 1 --2- 172.21.15.92:0/2449167694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f758c097fb0 0x7f758c095900 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f757c00a9f0 tx=0x7f757c00a2e0 comp rx=0 tx=0).stop 2023-09-29T23:30:24.067 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.064+0000 7f758bfff700 1 -- 172.21.15.92:0/2449167694 shutdown_connections 2023-09-29T23:30:24.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.064+0000 7f758bfff700 1 --2- 172.21.15.92:0/2449167694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f758c097fb0 0x7f758c095900 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:30:24.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.064+0000 7f758bfff700 1 -- 172.21.15.92:0/2449167694 >> 172.21.15.92:0/2449167694 conn(0x7f758c06b270 msgr2=0x7f758c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:30:24.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.064+0000 7f758bfff700 1 -- 172.21.15.92:0/2449167694 shutdown_connections 2023-09-29T23:30:24.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.064+0000 7f758bfff700 1 -- 172.21.15.92:0/2449167694 wait complete. 2023-09-29T23:30:24.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.065+0000 7f758bfff700 1 Processor -- start 2023-09-29T23:30:24.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.065+0000 7f758bfff700 1 -- start start 2023-09-29T23:30:24.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.066+0000 7f758bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f758c097fb0 0x7f758c123370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:30:24.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.066+0000 7f758bfff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c124ec0 con 0x7f758c097fb0 2023-09-29T23:30:24.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.066+0000 7f758affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f758c097fb0 0x7f758c123370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:30:24.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.066+0000 7f758affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f758c097fb0 0x7f758c123370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53338/0 (socket says 172.21.15.92:53338) 2023-09-29T23:30:24.068 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.066+0000 7f758affd700 1 -- 172.21.15.92:0/1942653 learned_addr learned my addr 172.21.15.92:0/1942653 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:30:24.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.066+0000 7f758affd700 1 -- 172.21.15.92:0/1942653 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c00a560 con 0x7f758c097fb0 2023-09-29T23:30:24.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.066+0000 7f758affd700 1 --2- 172.21.15.92:0/1942653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f758c097fb0 0x7f758c123370 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f757c00a530 tx=0x7f757c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:30:24.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.066+0000 7f75837fe700 1 -- 172.21.15.92:0/1942653 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f757c01e070 con 0x7f758c097fb0 2023-09-29T23:30:24.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.067+0000 7f75837fe700 1 -- 172.21.15.92:0/1942653 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c006870 con 0x7f758c097fb0 2023-09-29T23:30:24.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.067+0000 7f758bfff700 1 -- 172.21.15.92:0/1942653 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758c126240 con 0x7f758c097fb0 2023-09-29T23:30:24.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.067+0000 7f75837fe700 1 -- 172.21.15.92:0/1942653 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f757c022550 con 0x7f758c097fb0 2023-09-29T23:30:24.069 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.067+0000 7f758bfff700 1 -- 172.21.15.92:0/1942653 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758c1250f0 con 0x7f758c097fb0 2023-09-29T23:30:24.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.068+0000 7f75837fe700 1 -- 172.21.15.92:0/1942653 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f757c02b450 con 0x7f758c097fb0 2023-09-29T23:30:24.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.068+0000 7f75837fe700 1 --2- 172.21.15.92:0/1942653 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f756c035640 0x7f756c037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:30:24.070 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.068+0000 7f758bfff700 1 -- 172.21.15.92:0/1942653 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f758c125340 con 0x7f758c097fb0 2023-09-29T23:30:24.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.068+0000 7f75837fe700 1 -- 172.21.15.92:0/1942653 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f757c0485c0 con 0x7f758c097fb0 2023-09-29T23:30:24.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.068+0000 7f75827fc700 1 --2- 172.21.15.92:0/1942653 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f756c035640 0x7f756c037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:30:24.071 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.068+0000 7f75827fc700 1 --2- 172.21.15.92:0/1942653 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f756c035640 0x7f756c037af0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f75740016c0 tx=0x7f7574007b50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:30:24.073 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.073+0000 7f75837fe700 1 -- 172.21.15.92:0/1942653 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f758c125340 con 0x7f758c097fb0 2023-09-29T23:30:24.259 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.259+0000 7f758bfff700 1 -- 172.21.15.92:0/1942653 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f758c125340 con 0x7f756c035640 2023-09-29T23:30:24.266 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.266+0000 7f75837fe700 1 -- 172.21.15.92:0/1942653 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+266116 (secure 0 0 0) 0x7f758c125340 con 0x7f756c035640 2023-09-29T23:30:24.269 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:30:24.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.269+0000 7f758bfff700 1 -- 172.21.15.92:0/1942653 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f756c035640 msgr2=0x7f756c037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:30:24.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.269+0000 7f758bfff700 1 --2- 172.21.15.92:0/1942653 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f756c035640 0x7f756c037af0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f75740016c0 tx=0x7f7574007b50 comp rx=0 tx=0).stop 2023-09-29T23:30:24.271 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.269+0000 7f758bfff700 1 -- 172.21.15.92:0/1942653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f758c097fb0 msgr2=0x7f758c123370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:30:24.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.269+0000 7f758bfff700 1 --2- 172.21.15.92:0/1942653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f758c097fb0 0x7f758c123370 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f757c00a530 tx=0x7f757c018000 comp rx=0 tx=0).stop 2023-09-29T23:30:24.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.269+0000 7f758bfff700 1 -- 172.21.15.92:0/1942653 shutdown_connections 2023-09-29T23:30:24.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.269+0000 7f758bfff700 1 --2- 172.21.15.92:0/1942653 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f756c035640 0x7f756c037af0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:30:24.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.269+0000 7f758bfff700 1 --2- 172.21.15.92:0/1942653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f758c097fb0 0x7f758c123370 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:30:24.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.269+0000 7f758bfff700 1 -- 172.21.15.92:0/1942653 >> 172.21.15.92:0/1942653 conn(0x7f758c06b270 msgr2=0x7f758c12f810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:30:24.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.269+0000 7f758bfff700 1 -- 172.21.15.92:0/1942653 shutdown_connections 2023-09-29T23:30:24.272 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:24.269+0000 7f758bfff700 1 -- 172.21.15.92:0/1942653 wait complete. 2023-09-29T23:30:24.272 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-09-29T23:30:24.280 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2023-09-29T23:30:24.129204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":208,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":16952,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":16384,"kb_avail":314555848,"statfs":{"total":322122547200,"available":322105188352,"internally_reserved":0,"allocated":557056,"data_stored":160657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16777216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002864"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287388+0000","last_change":"2023-09-29T23:23:45.465624+0000","last_active":"2023-09-29T23:24:37.287388+0000","last_peered":"2023-09-29T23:24:37.287388+0000","last_clean":"2023-09-29T23:24:37.287388+0000","last_became_active":"2023-09-29T23:23:45.464271+0000","last_became_peered":"2023-09-29T23:23:45.464271+0000","last_unstale":"2023-09-29T23:24:37.287388+0000","last_undegraded":"2023-09-29T23:24:37.287388+0000","last_fullsized":"2023-09-29T23:24:37.287388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:03.249509+0000","last_change":"2023-09-29T23:29:03.249480+0000","last_active":"2023-09-29T23:29:03.249509+0000","last_peered":"2023-09-29T23:29:03.249509+0000","last_clean":"2023-09-29T23:29:03.249509+0000","last_became_active":"2023-09-29T23:23:45.466338+0000","last_became_peered":"2023-09-29T23:23:45.466338+0000","last_unstale":"2023-09-29T23:29:03.249509+0000","last_undegraded":"2023-09-29T23:29:03.249509+0000","last_fullsized":"2023-09-29T23:29:03.249509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:03.249418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:03.249418+0000","last_clean_scrub_stamp":"2023-09-29T23:29:03.249418+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:59:00.108261+0000","scrub_duration":0.0011124380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287634+0000","last_change":"2023-09-29T23:23:45.477248+0000","last_active":"2023-09-29T23:24:37.287634+0000","last_peered":"2023-09-29T23:24:37.287634+0000","last_clean":"2023-09-29T23:24:37.287634+0000","last_became_active":"2023-09-29T23:23:45.474129+0000","last_became_peered":"2023-09-29T23:23:45.474129+0000","last_unstale":"2023-09-29T23:24:37.287634+0000","last_undegraded":"2023-09-29T23:24:37.287634+0000","last_fullsized":"2023-09-29T23:24:37.287634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:17.855334+0000","last_change":"2023-09-29T23:29:17.855305+0000","last_active":"2023-09-29T23:29:17.855334+0000","last_peered":"2023-09-29T23:29:17.855334+0000","last_clean":"2023-09-29T23:29:17.855334+0000","last_became_active":"2023-09-29T23:23:45.470971+0000","last_became_peered":"2023-09-29T23:23:45.470971+0000","last_unstale":"2023-09-29T23:29:17.855334+0000","last_undegraded":"2023-09-29T23:29:17.855334+0000","last_fullsized":"2023-09-29T23:29:17.855334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:17.855232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:17.855232+0000","last_clean_scrub_stamp":"2023-09-29T23:29:17.855232+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:07:36.954319+0000","scrub_duration":0.0012669980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286897+0000","last_change":"2023-09-29T23:23:45.473831+0000","last_active":"2023-09-29T23:24:37.286897+0000","last_peered":"2023-09-29T23:24:37.286897+0000","last_clean":"2023-09-29T23:24:37.286897+0000","last_became_active":"2023-09-29T23:23:45.473570+0000","last_became_peered":"2023-09-29T23:23:45.473570+0000","last_unstale":"2023-09-29T23:24:37.286897+0000","last_undegraded":"2023-09-29T23:24:37.286897+0000","last_fullsized":"2023-09-29T23:24:37.286897+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:11.848798+0000","last_change":"2023-09-29T23:29:11.848767+0000","last_active":"2023-09-29T23:29:11.848798+0000","last_peered":"2023-09-29T23:29:11.848798+0000","last_clean":"2023-09-29T23:29:11.848798+0000","last_became_active":"2023-09-29T23:23:45.470349+0000","last_became_peered":"2023-09-29T23:23:45.470349+0000","last_unstale":"2023-09-29T23:29:11.848798+0000","last_undegraded":"2023-09-29T23:29:11.848798+0000","last_fullsized":"2023-09-29T23:29:11.848798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:11.848689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:11.848689+0000","last_clean_scrub_stamp":"2023-09-29T23:29:11.848689+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:18:31.778625+0000","scrub_duration":0.001396563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.286523+0000","last_change":"2023-09-29T23:23:45.465376+0000","last_active":"2023-09-29T23:24:37.286523+0000","last_peered":"2023-09-29T23:24:37.286523+0000","last_clean":"2023-09-29T23:24:37.286523+0000","last_became_active":"2023-09-29T23:23:45.464893+0000","last_became_peered":"2023-09-29T23:23:45.464893+0000","last_unstale":"2023-09-29T23:24:37.286523+0000","last_undegraded":"2023-09-29T23:24:37.286523+0000","last_fullsized":"2023-09-29T23:24:37.286523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:14.185817+0000","last_change":"2023-09-29T23:30:14.185777+0000","last_active":"2023-09-29T23:30:14.185817+0000","last_peered":"2023-09-29T23:30:14.185817+0000","last_clean":"2023-09-29T23:30:14.185817+0000","last_became_active":"2023-09-29T23:23:45.462888+0000","last_became_peered":"2023-09-29T23:23:45.462888+0000","last_unstale":"2023-09-29T23:30:14.185817+0000","last_undegraded":"2023-09-29T23:30:14.185817+0000","last_fullsized":"2023-09-29T23:30:14.185817+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:14.185703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:14.185703+0000","last_clean_scrub_stamp":"2023-09-29T23:30:14.185703+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:12:29.673373+0000","scrub_duration":0.0012095039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.282063+0000","last_change":"2023-09-29T23:23:45.468860+0000","last_active":"2023-09-29T23:24:37.282063+0000","last_peered":"2023-09-29T23:24:37.282063+0000","last_clean":"2023-09-29T23:24:37.282063+0000","last_became_active":"2023-09-29T23:23:45.468303+0000","last_became_peered":"2023-09-29T23:23:45.468303+0000","last_unstale":"2023-09-29T23:24:37.282063+0000","last_undegraded":"2023-09-29T23:24:37.282063+0000","last_fullsized":"2023-09-29T23:24:37.282063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.292057+0000","last_change":"2023-09-29T23:24:37.285573+0000","last_active":"2023-09-29T23:24:37.292057+0000","last_peered":"2023-09-29T23:24:37.292057+0000","last_clean":"2023-09-29T23:24:37.292057+0000","last_became_active":"2023-09-29T23:24:37.285339+0000","last_became_peered":"2023-09-29T23:24:37.285339+0000","last_unstale":"2023-09-29T23:24:37.292057+0000","last_undegraded":"2023-09-29T23:24:37.292057+0000","last_fullsized":"2023-09-29T23:24:37.292057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287570+0000","last_change":"2023-09-29T23:23:45.467858+0000","last_active":"2023-09-29T23:24:37.287570+0000","last_peered":"2023-09-29T23:24:37.287570+0000","last_clean":"2023-09-29T23:24:37.287570+0000","last_became_active":"2023-09-29T23:23:45.464083+0000","last_became_peered":"2023-09-29T23:23:45.464083+0000","last_unstale":"2023-09-29T23:24:37.287570+0000","last_undegraded":"2023-09-29T23:24:37.287570+0000","last_fullsized":"2023-09-29T23:24:37.287570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287315+0000","last_change":"2023-09-29T23:23:45.466588+0000","last_active":"2023-09-29T23:24:37.287315+0000","last_peered":"2023-09-29T23:24:37.287315+0000","last_clean":"2023-09-29T23:24:37.287315+0000","last_became_active":"2023-09-29T23:23:45.466161+0000","last_became_peered":"2023-09-29T23:23:45.466161+0000","last_unstale":"2023-09-29T23:24:37.287315+0000","last_undegraded":"2023-09-29T23:24:37.287315+0000","last_fullsized":"2023-09-29T23:24:37.287315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:04.477680+0000","last_change":"2023-09-29T23:29:04.477657+0000","last_active":"2023-09-29T23:29:04.477680+0000","last_peered":"2023-09-29T23:29:04.477680+0000","last_clean":"2023-09-29T23:29:04.477680+0000","last_became_active":"2023-09-29T23:23:45.467178+0000","last_became_peered":"2023-09-29T23:23:45.467178+0000","last_unstale":"2023-09-29T23:29:04.477680+0000","last_undegraded":"2023-09-29T23:29:04.477680+0000","last_fullsized":"2023-09-29T23:29:04.477680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:04.477596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:04.477596+0000","last_clean_scrub_stamp":"2023-09-29T23:29:04.477596+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:49.700926+0000","scrub_duration":0.001119543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:20.545759+0000","last_change":"2023-09-29T23:29:20.545730+0000","last_active":"2023-09-29T23:29:20.545759+0000","last_peered":"2023-09-29T23:29:20.545759+0000","last_clean":"2023-09-29T23:29:20.545759+0000","last_became_active":"2023-09-29T23:23:45.464523+0000","last_became_peered":"2023-09-29T23:23:45.464523+0000","last_unstale":"2023-09-29T23:29:20.545759+0000","last_undegraded":"2023-09-29T23:29:20.545759+0000","last_fullsized":"2023-09-29T23:29:20.545759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:20.545655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:20.545655+0000","last_clean_scrub_stamp":"2023-09-29T23:29:20.545655+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:33:27.694060+0000","scrub_duration":0.0013252279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:17.406630+0000","last_change":"2023-09-29T23:30:17.406596+0000","last_active":"2023-09-29T23:30:17.406630+0000","last_peered":"2023-09-29T23:30:17.406630+0000","last_clean":"2023-09-29T23:30:17.406630+0000","last_became_active":"2023-09-29T23:23:45.467004+0000","last_became_peered":"2023-09-29T23:23:45.467004+0000","last_unstale":"2023-09-29T23:30:17.406630+0000","last_undegraded":"2023-09-29T23:30:17.406630+0000","last_fullsized":"2023-09-29T23:30:17.406630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:17.406496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:17.406496+0000","last_clean_scrub_stamp":"2023-09-29T23:30:17.406496+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:14:55.441418+0000","scrub_duration":0.001404878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:11.232745+0000","last_change":"2023-09-29T23:30:11.232717+0000","last_active":"2023-09-29T23:30:11.232745+0000","last_peered":"2023-09-29T23:30:11.232745+0000","last_clean":"2023-09-29T23:30:11.232745+0000","last_became_active":"2023-09-29T23:23:45.471334+0000","last_became_peered":"2023-09-29T23:23:45.471334+0000","last_unstale":"2023-09-29T23:30:11.232745+0000","last_undegraded":"2023-09-29T23:30:11.232745+0000","last_fullsized":"2023-09-29T23:30:11.232745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:11.232638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:11.232638+0000","last_clean_scrub_stamp":"2023-09-29T23:30:11.232638+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:09:20.386800+0000","scrub_duration":0.001353686,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:43.304266+0000","last_change":"2023-09-29T23:29:43.304234+0000","last_active":"2023-09-29T23:29:43.304266+0000","last_peered":"2023-09-29T23:29:43.304266+0000","last_clean":"2023-09-29T23:29:43.304266+0000","last_became_active":"2023-09-29T23:23:45.468001+0000","last_became_peered":"2023-09-29T23:23:45.468001+0000","last_unstale":"2023-09-29T23:29:43.304266+0000","last_undegraded":"2023-09-29T23:29:43.304266+0000","last_fullsized":"2023-09-29T23:29:43.304266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:43.304142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:43.304142+0000","last_clean_scrub_stamp":"2023-09-29T23:29:43.304142+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:49:10.871636+0000","scrub_duration":0.001341552,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:08.209770+0000","last_change":"2023-09-29T23:30:08.209743+0000","last_active":"2023-09-29T23:30:08.209770+0000","last_peered":"2023-09-29T23:30:08.209770+0000","last_clean":"2023-09-29T23:30:08.209770+0000","last_became_active":"2023-09-29T23:23:45.467434+0000","last_became_peered":"2023-09-29T23:23:45.467434+0000","last_unstale":"2023-09-29T23:30:08.209770+0000","last_undegraded":"2023-09-29T23:30:08.209770+0000","last_fullsized":"2023-09-29T23:30:08.209770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:08.209667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:08.209667+0000","last_clean_scrub_stamp":"2023-09-29T23:30:08.209667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:44:24.546919+0000","scrub_duration":0.001348896,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.287439+0000","last_change":"2023-09-29T23:23:45.473751+0000","last_active":"2023-09-29T23:24:37.287439+0000","last_peered":"2023-09-29T23:24:37.287439+0000","last_clean":"2023-09-29T23:24:37.287439+0000","last_became_active":"2023-09-29T23:23:45.473326+0000","last_became_peered":"2023-09-29T23:23:45.473326+0000","last_unstale":"2023-09-29T23:24:37.287439+0000","last_undegraded":"2023-09-29T23:24:37.287439+0000","last_fullsized":"2023-09-29T23:24:37.287439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:02.476624+0000","last_change":"2023-09-29T23:29:02.476605+0000","last_active":"2023-09-29T23:29:02.476624+0000","last_peered":"2023-09-29T23:29:02.476624+0000","last_clean":"2023-09-29T23:29:02.476624+0000","last_became_active":"2023-09-29T23:23:45.467494+0000","last_became_peered":"2023-09-29T23:23:45.467494+0000","last_unstale":"2023-09-29T23:29:02.476624+0000","last_undegraded":"2023-09-29T23:29:02.476624+0000","last_fullsized":"2023-09-29T23:29:02.476624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:02.476541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:02.476541+0000","last_clean_scrub_stamp":"2023-09-29T23:29:02.476541+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:07:21.575629+0000","scrub_duration":0.0011731350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:06.426368+0000","last_change":"2023-09-29T23:29:06.426326+0000","last_active":"2023-09-29T23:29:06.426368+0000","last_peered":"2023-09-29T23:29:06.426368+0000","last_clean":"2023-09-29T23:29:06.426368+0000","last_became_active":"2023-09-29T23:23:45.477408+0000","last_became_peered":"2023-09-29T23:23:45.477408+0000","last_unstale":"2023-09-29T23:29:06.426368+0000","last_undegraded":"2023-09-29T23:29:06.426368+0000","last_fullsized":"2023-09-29T23:29:06.426368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:06.426255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:06.426255+0000","last_clean_scrub_stamp":"2023-09-29T23:29:06.426255+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:16:36.592771+0000","scrub_duration":0.001349893,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:24:37.280950+0000","last_change":"2023-09-29T23:23:45.471232+0000","last_active":"2023-09-29T23:24:37.280950+0000","last_peered":"2023-09-29T23:24:37.280950+0000","last_clean":"2023-09-29T23:24:37.280950+0000","last_became_active":"2023-09-29T23:23:45.470574+0000","last_became_peered":"2023-09-29T23:23:45.470574+0000","last_unstale":"2023-09-29T23:24:37.280950+0000","last_undegraded":"2023-09-29T23:24:37.280950+0000","last_fullsized":"2023-09-29T23:24:37.280950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:23:45.052710+0000","last_clean_scrub_stamp":"2023-09-29T23:23:45.052710+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:07.470966+0000","last_change":"2023-09-29T23:29:07.470936+0000","last_active":"2023-09-29T23:29:07.470966+0000","last_peered":"2023-09-29T23:29:07.470966+0000","last_clean":"2023-09-29T23:29:07.470966+0000","last_became_active":"2023-09-29T23:23:45.473789+0000","last_became_peered":"2023-09-29T23:23:45.473789+0000","last_unstale":"2023-09-29T23:29:07.470966+0000","last_undegraded":"2023-09-29T23:29:07.470966+0000","last_fullsized":"2023-09-29T23:29:07.470966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:07.470870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:07.470870+0000","last_clean_scrub_stamp":"2023-09-29T23:29:07.470870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:35:33.595449+0000","scrub_duration":0.0012289239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:03.460784+0000","last_change":"2023-09-29T23:29:03.460762+0000","last_active":"2023-09-29T23:29:03.460784+0000","last_peered":"2023-09-29T23:29:03.460784+0000","last_clean":"2023-09-29T23:29:03.460784+0000","last_became_active":"2023-09-29T23:23:45.465443+0000","last_became_peered":"2023-09-29T23:23:45.465443+0000","last_unstale":"2023-09-29T23:29:03.460784+0000","last_undegraded":"2023-09-29T23:29:03.460784+0000","last_fullsized":"2023-09-29T23:29:03.460784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:03.460703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:03.460703+0000","last_clean_scrub_stamp":"2023-09-29T23:29:03.460703+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:59:00.319545+0000","scrub_duration":0.00097215699999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:09.204485+0000","last_change":"2023-09-29T23:30:09.204454+0000","last_active":"2023-09-29T23:30:09.204485+0000","last_peered":"2023-09-29T23:30:09.204485+0000","last_clean":"2023-09-29T23:30:09.204485+0000","last_became_active":"2023-09-29T23:23:45.457799+0000","last_became_peered":"2023-09-29T23:23:45.457799+0000","last_unstale":"2023-09-29T23:30:09.204485+0000","last_undegraded":"2023-09-29T23:30:09.204485+0000","last_fullsized":"2023-09-29T23:30:09.204485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:09.204359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:09.204359+0000","last_clean_scrub_stamp":"2023-09-29T23:30:09.204359+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:50:01.010628+0000","scrub_duration":0.0012939049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:15.837977+0000","last_change":"2023-09-29T23:29:15.837942+0000","last_active":"2023-09-29T23:29:15.837977+0000","last_peered":"2023-09-29T23:29:15.837977+0000","last_clean":"2023-09-29T23:29:15.837977+0000","last_became_active":"2023-09-29T23:23:45.467730+0000","last_became_peered":"2023-09-29T23:23:45.467730+0000","last_unstale":"2023-09-29T23:29:15.837977+0000","last_undegraded":"2023-09-29T23:29:15.837977+0000","last_fullsized":"2023-09-29T23:29:15.837977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:15.837865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:15.837865+0000","last_clean_scrub_stamp":"2023-09-29T23:29:15.837865+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:04:13.297945+0000","scrub_duration":0.001397206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"16'1","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:06.283311+0000","last_change":"2023-09-29T23:29:06.283268+0000","last_active":"2023-09-29T23:29:06.283311+0000","last_peered":"2023-09-29T23:29:06.283311+0000","last_clean":"2023-09-29T23:29:06.283311+0000","last_became_active":"2023-09-29T23:23:45.075848+0000","last_became_peered":"2023-09-29T23:23:45.075848+0000","last_unstale":"2023-09-29T23:29:06.283311+0000","last_undegraded":"2023-09-29T23:29:06.283311+0000","last_fullsized":"2023-09-29T23:29:06.283311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'1","last_scrub_stamp":"2023-09-29T23:29:06.283188+0000","last_deep_scrub":"16'1","last_deep_scrub_stamp":"2023-09-29T23:29:06.283188+0000","last_clean_scrub_stamp":"2023-09-29T23:29:06.283188+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:16:36.449704+0000","scrub_duration":0.0013356450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:04.277638+0000","last_change":"2023-09-29T23:29:04.277614+0000","last_active":"2023-09-29T23:29:04.277638+0000","last_peered":"2023-09-29T23:29:04.277638+0000","last_clean":"2023-09-29T23:29:04.277638+0000","last_became_active":"2023-09-29T23:23:45.462155+0000","last_became_peered":"2023-09-29T23:23:45.462155+0000","last_unstale":"2023-09-29T23:29:04.277638+0000","last_undegraded":"2023-09-29T23:29:04.277638+0000","last_fullsized":"2023-09-29T23:29:04.277638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:04.277542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:04.277542+0000","last_clean_scrub_stamp":"2023-09-29T23:29:04.277542+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:49.500872+0000","scrub_duration":0.0010848310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:22.883137+0000","last_change":"2023-09-29T23:29:22.883103+0000","last_active":"2023-09-29T23:29:22.883137+0000","last_peered":"2023-09-29T23:29:22.883137+0000","last_clean":"2023-09-29T23:29:22.883137+0000","last_became_active":"2023-09-29T23:23:45.092273+0000","last_became_peered":"2023-09-29T23:23:45.092273+0000","last_unstale":"2023-09-29T23:29:22.883137+0000","last_undegraded":"2023-09-29T23:29:22.883137+0000","last_fullsized":"2023-09-29T23:29:22.883137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'1","last_scrub_stamp":"2023-09-29T23:29:22.883002+0000","last_deep_scrub":"16'1","last_deep_scrub_stamp":"2023-09-29T23:29:22.883002+0000","last_clean_scrub_stamp":"2023-09-29T23:29:22.883002+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:35:49.007581+0000","scrub_duration":0.001353417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:37.545175+0000","last_change":"2023-09-29T23:29:37.545146+0000","last_active":"2023-09-29T23:29:37.545175+0000","last_peered":"2023-09-29T23:29:37.545175+0000","last_clean":"2023-09-29T23:29:37.545175+0000","last_became_active":"2023-09-29T23:23:45.464027+0000","last_became_peered":"2023-09-29T23:23:45.464027+0000","last_unstale":"2023-09-29T23:29:37.545175+0000","last_undegraded":"2023-09-29T23:29:37.545175+0000","last_fullsized":"2023-09-29T23:29:37.545175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:37.545065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:37.545065+0000","last_clean_scrub_stamp":"2023-09-29T23:29:37.545065+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:31:27.151684+0000","scrub_duration":0.001339413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:42.453564+0000","last_change":"2023-09-29T23:29:42.453521+0000","last_active":"2023-09-29T23:29:42.453564+0000","last_peered":"2023-09-29T23:29:42.453564+0000","last_clean":"2023-09-29T23:29:42.453564+0000","last_became_active":"2023-09-29T23:23:45.088405+0000","last_became_peered":"2023-09-29T23:23:45.088405+0000","last_unstale":"2023-09-29T23:29:42.453564+0000","last_undegraded":"2023-09-29T23:29:42.453564+0000","last_fullsized":"2023-09-29T23:29:42.453564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:42.453441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:42.453441+0000","last_clean_scrub_stamp":"2023-09-29T23:29:42.453441+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:49:10.020935+0000","scrub_duration":0.001281113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:18.842822+0000","last_change":"2023-09-29T23:29:18.842794+0000","last_active":"2023-09-29T23:29:18.842822+0000","last_peered":"2023-09-29T23:29:18.842822+0000","last_clean":"2023-09-29T23:29:18.842822+0000","last_became_active":"2023-09-29T23:23:45.470917+0000","last_became_peered":"2023-09-29T23:23:45.470917+0000","last_unstale":"2023-09-29T23:29:18.842822+0000","last_undegraded":"2023-09-29T23:29:18.842822+0000","last_fullsized":"2023-09-29T23:29:18.842822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:18.842718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:18.842718+0000","last_clean_scrub_stamp":"2023-09-29T23:29:18.842718+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:59:15.701560+0000","scrub_duration":0.0012829569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:54.488388+0000","last_change":"2023-09-29T23:29:54.488362+0000","last_active":"2023-09-29T23:29:54.488388+0000","last_peered":"2023-09-29T23:29:54.488388+0000","last_clean":"2023-09-29T23:29:54.488388+0000","last_became_active":"2023-09-29T23:23:45.070610+0000","last_became_peered":"2023-09-29T23:23:45.070610+0000","last_unstale":"2023-09-29T23:29:54.488388+0000","last_undegraded":"2023-09-29T23:29:54.488388+0000","last_fullsized":"2023-09-29T23:29:54.488388+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:54.488296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:54.488296+0000","last_clean_scrub_stamp":"2023-09-29T23:29:54.488296+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:49:46.294564+0000","scrub_duration":0.0011955780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:32.058629+0000","last_change":"2023-09-29T23:29:32.058597+0000","last_active":"2023-09-29T23:29:32.058629+0000","last_peered":"2023-09-29T23:29:32.058629+0000","last_clean":"2023-09-29T23:29:32.058629+0000","last_became_active":"2023-09-29T23:23:45.475634+0000","last_became_peered":"2023-09-29T23:23:45.475634+0000","last_unstale":"2023-09-29T23:29:32.058629+0000","last_undegraded":"2023-09-29T23:29:32.058629+0000","last_fullsized":"2023-09-29T23:29:32.058629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:32.058524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:32.058524+0000","last_clean_scrub_stamp":"2023-09-29T23:29:32.058524+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:28:19.384325+0000","scrub_duration":0.0012732959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:16.093276+0000","last_change":"2023-09-29T23:29:16.093250+0000","last_active":"2023-09-29T23:29:16.093276+0000","last_peered":"2023-09-29T23:29:16.093276+0000","last_clean":"2023-09-29T23:29:16.093276+0000","last_became_active":"2023-09-29T23:23:45.091317+0000","last_became_peered":"2023-09-29T23:23:45.091317+0000","last_unstale":"2023-09-29T23:29:16.093276+0000","last_undegraded":"2023-09-29T23:29:16.093276+0000","last_fullsized":"2023-09-29T23:29:16.093276+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:16.093182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:16.093182+0000","last_clean_scrub_stamp":"2023-09-29T23:29:16.093182+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:31:53.593525+0000","scrub_duration":0.001347411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:36.981638+0000","last_change":"2023-09-29T23:29:36.981613+0000","last_active":"2023-09-29T23:29:36.981638+0000","last_peered":"2023-09-29T23:29:36.981638+0000","last_clean":"2023-09-29T23:29:36.981638+0000","last_became_active":"2023-09-29T23:23:45.458585+0000","last_became_peered":"2023-09-29T23:23:45.458585+0000","last_unstale":"2023-09-29T23:29:36.981638+0000","last_undegraded":"2023-09-29T23:29:36.981638+0000","last_fullsized":"2023-09-29T23:29:36.981638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:36.981533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:36.981533+0000","last_clean_scrub_stamp":"2023-09-29T23:29:36.981533+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:12:03.229046+0000","scrub_duration":0.001333363,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:09.628659+0000","last_change":"2023-09-29T23:30:09.628630+0000","last_active":"2023-09-29T23:30:09.628659+0000","last_peered":"2023-09-29T23:30:09.628659+0000","last_clean":"2023-09-29T23:30:09.628659+0000","last_became_active":"2023-09-29T23:23:45.070986+0000","last_became_peered":"2023-09-29T23:23:45.070986+0000","last_unstale":"2023-09-29T23:30:09.628659+0000","last_undegraded":"2023-09-29T23:30:09.628659+0000","last_fullsized":"2023-09-29T23:30:09.628659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:09.628551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:09.628551+0000","last_clean_scrub_stamp":"2023-09-29T23:30:09.628551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:45:41.129348+0000","scrub_duration":0.0012872210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:51.461303+0000","last_change":"2023-09-29T23:29:51.461276+0000","last_active":"2023-09-29T23:29:51.461303+0000","last_peered":"2023-09-29T23:29:51.461303+0000","last_clean":"2023-09-29T23:29:51.461303+0000","last_became_active":"2023-09-29T23:23:45.464510+0000","last_became_peered":"2023-09-29T23:23:45.464510+0000","last_unstale":"2023-09-29T23:29:51.461303+0000","last_undegraded":"2023-09-29T23:29:51.461303+0000","last_fullsized":"2023-09-29T23:29:51.461303+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:51.461193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:51.461193+0000","last_clean_scrub_stamp":"2023-09-29T23:29:51.461193+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:18:41.728129+0000","scrub_duration":0.0013191209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'5","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:20.978198+0000","last_change":"2023-09-29T23:29:20.978161+0000","last_active":"2023-09-29T23:29:20.978198+0000","last_peered":"2023-09-29T23:29:20.978198+0000","last_clean":"2023-09-29T23:29:20.978198+0000","last_became_active":"2023-09-29T23:23:45.076856+0000","last_became_peered":"2023-09-29T23:23:45.076856+0000","last_unstale":"2023-09-29T23:29:20.978198+0000","last_undegraded":"2023-09-29T23:29:20.978198+0000","last_fullsized":"2023-09-29T23:29:20.978198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2023-09-29T23:29:20.978063+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2023-09-29T23:29:20.978063+0000","last_clean_scrub_stamp":"2023-09-29T23:29:20.978063+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:43:25.681012+0000","scrub_duration":0.002692945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:22.024275+0000","last_change":"2023-09-29T23:29:22.024242+0000","last_active":"2023-09-29T23:29:22.024275+0000","last_peered":"2023-09-29T23:29:22.024275+0000","last_clean":"2023-09-29T23:29:22.024275+0000","last_became_active":"2023-09-29T23:23:45.461199+0000","last_became_peered":"2023-09-29T23:23:45.461199+0000","last_unstale":"2023-09-29T23:29:22.024275+0000","last_undegraded":"2023-09-29T23:29:22.024275+0000","last_fullsized":"2023-09-29T23:29:22.024275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:22.024151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:22.024151+0000","last_clean_scrub_stamp":"2023-09-29T23:29:22.024151+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:13:23.585922+0000","scrub_duration":0.001280705,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"19'10","reported_seq":33,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:35.954350+0000","last_change":"2023-09-29T23:29:35.954319+0000","last_active":"2023-09-29T23:29:35.954350+0000","last_peered":"2023-09-29T23:29:35.954350+0000","last_clean":"2023-09-29T23:29:35.954350+0000","last_became_active":"2023-09-29T23:23:45.093487+0000","last_became_peered":"2023-09-29T23:23:45.093487+0000","last_unstale":"2023-09-29T23:29:35.954350+0000","last_undegraded":"2023-09-29T23:29:35.954350+0000","last_fullsized":"2023-09-29T23:29:35.954350+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'10","last_scrub_stamp":"2023-09-29T23:29:35.954248+0000","last_deep_scrub":"19'10","last_deep_scrub_stamp":"2023-09-29T23:29:35.954248+0000","last_clean_scrub_stamp":"2023-09-29T23:29:35.954248+0000","objects_scrubbed":4,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:33:43.102652+0000","scrub_duration":0.0072578629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:32.588353+0000","last_change":"2023-09-29T23:29:32.588319+0000","last_active":"2023-09-29T23:29:32.588353+0000","last_peered":"2023-09-29T23:29:32.588353+0000","last_clean":"2023-09-29T23:29:32.588353+0000","last_became_active":"2023-09-29T23:23:45.466667+0000","last_became_peered":"2023-09-29T23:23:45.466667+0000","last_unstale":"2023-09-29T23:29:32.588353+0000","last_undegraded":"2023-09-29T23:29:32.588353+0000","last_fullsized":"2023-09-29T23:29:32.588353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:32.588241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:32.588241+0000","last_clean_scrub_stamp":"2023-09-29T23:29:32.588241+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:40:31.970519+0000","scrub_duration":0.001381953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'4","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:12.643299+0000","last_change":"2023-09-29T23:30:12.643251+0000","last_active":"2023-09-29T23:30:12.643299+0000","last_peered":"2023-09-29T23:30:12.643299+0000","last_clean":"2023-09-29T23:30:12.643299+0000","last_became_active":"2023-09-29T23:23:45.089450+0000","last_became_peered":"2023-09-29T23:23:45.089450+0000","last_unstale":"2023-09-29T23:30:12.643299+0000","last_undegraded":"2023-09-29T23:30:12.643299+0000","last_fullsized":"2023-09-29T23:30:12.643299+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4","last_scrub_stamp":"2023-09-29T23:30:12.643173+0000","last_deep_scrub":"19'4","last_deep_scrub_stamp":"2023-09-29T23:30:12.643173+0000","last_clean_scrub_stamp":"2023-09-29T23:30:12.643173+0000","objects_scrubbed":2,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:32:21.187703+0000","scrub_duration":0.00355631,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:43.493923+0000","last_change":"2023-09-29T23:29:43.493902+0000","last_active":"2023-09-29T23:29:43.493923+0000","last_peered":"2023-09-29T23:29:43.493923+0000","last_clean":"2023-09-29T23:29:43.493923+0000","last_became_active":"2023-09-29T23:23:45.464801+0000","last_became_peered":"2023-09-29T23:23:45.464801+0000","last_unstale":"2023-09-29T23:29:43.493923+0000","last_undegraded":"2023-09-29T23:29:43.493923+0000","last_fullsized":"2023-09-29T23:29:43.493923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:43.493841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:43.493841+0000","last_clean_scrub_stamp":"2023-09-29T23:29:43.493841+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:38:16.507037+0000","scrub_duration":0.0010336309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:37.951615+0000","last_change":"2023-09-29T23:29:37.951590+0000","last_active":"2023-09-29T23:29:37.951615+0000","last_peered":"2023-09-29T23:29:37.951615+0000","last_clean":"2023-09-29T23:29:37.951615+0000","last_became_active":"2023-09-29T23:23:45.092902+0000","last_became_peered":"2023-09-29T23:23:45.092902+0000","last_unstale":"2023-09-29T23:29:37.951615+0000","last_undegraded":"2023-09-29T23:29:37.951615+0000","last_fullsized":"2023-09-29T23:29:37.951615+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:37.951522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:37.951522+0000","last_clean_scrub_stamp":"2023-09-29T23:29:37.951522+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:13:39.513294+0000","scrub_duration":0.0012267249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:30.055361+0000","last_change":"2023-09-29T23:29:30.055315+0000","last_active":"2023-09-29T23:29:30.055361+0000","last_peered":"2023-09-29T23:29:30.055361+0000","last_clean":"2023-09-29T23:29:30.055361+0000","last_became_active":"2023-09-29T23:23:45.465743+0000","last_became_peered":"2023-09-29T23:23:45.465743+0000","last_unstale":"2023-09-29T23:29:30.055361+0000","last_undegraded":"2023-09-29T23:29:30.055361+0000","last_fullsized":"2023-09-29T23:29:30.055361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:30.055241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:30.055241+0000","last_clean_scrub_stamp":"2023-09-29T23:29:30.055241+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:37:44.486033+0000","scrub_duration":0.001322852,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:14.693189+0000","last_change":"2023-09-29T23:30:14.693163+0000","last_active":"2023-09-29T23:30:14.693189+0000","last_peered":"2023-09-29T23:30:14.693189+0000","last_clean":"2023-09-29T23:30:14.693189+0000","last_became_active":"2023-09-29T23:23:45.072009+0000","last_became_peered":"2023-09-29T23:23:45.072009+0000","last_unstale":"2023-09-29T23:30:14.693189+0000","last_undegraded":"2023-09-29T23:30:14.693189+0000","last_fullsized":"2023-09-29T23:30:14.693189+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:14.693093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:14.693093+0000","last_clean_scrub_stamp":"2023-09-29T23:30:14.693093+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:09:42.785167+0000","scrub_duration":0.0012283400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:36.169278+0000","last_change":"2023-09-29T23:29:36.169248+0000","last_active":"2023-09-29T23:29:36.169278+0000","last_peered":"2023-09-29T23:29:36.169278+0000","last_clean":"2023-09-29T23:29:36.169278+0000","last_became_active":"2023-09-29T23:23:45.466169+0000","last_became_peered":"2023-09-29T23:23:45.466169+0000","last_unstale":"2023-09-29T23:29:36.169278+0000","last_undegraded":"2023-09-29T23:29:36.169278+0000","last_fullsized":"2023-09-29T23:29:36.169278+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:36.169178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:36.169178+0000","last_clean_scrub_stamp":"2023-09-29T23:29:36.169178+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:19:28.821242+0000","scrub_duration":0.001334238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'12","reported_seq":35,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:53.088645+0000","last_change":"2023-09-29T23:29:53.088595+0000","last_active":"2023-09-29T23:29:53.088645+0000","last_peered":"2023-09-29T23:29:53.088645+0000","last_clean":"2023-09-29T23:29:53.088645+0000","last_became_active":"2023-09-29T23:23:45.091386+0000","last_became_peered":"2023-09-29T23:23:45.091386+0000","last_unstale":"2023-09-29T23:29:53.088645+0000","last_undegraded":"2023-09-29T23:29:53.088645+0000","last_fullsized":"2023-09-29T23:29:53.088645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'12","last_scrub_stamp":"2023-09-29T23:29:53.088511+0000","last_deep_scrub":"19'12","last_deep_scrub_stamp":"2023-09-29T23:29:53.088511+0000","last_clean_scrub_stamp":"2023-09-29T23:29:53.088511+0000","objects_scrubbed":4,"log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:23:52.888979+0000","scrub_duration":0.0038113370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:05.861334+0000","last_change":"2023-09-29T23:29:05.861311+0000","last_active":"2023-09-29T23:29:05.861334+0000","last_peered":"2023-09-29T23:29:05.861334+0000","last_clean":"2023-09-29T23:29:05.861334+0000","last_became_active":"2023-09-29T23:23:45.460643+0000","last_became_peered":"2023-09-29T23:23:45.460643+0000","last_unstale":"2023-09-29T23:29:05.861334+0000","last_undegraded":"2023-09-29T23:29:05.861334+0000","last_fullsized":"2023-09-29T23:29:05.861334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:05.861236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:05.861236+0000","last_clean_scrub_stamp":"2023-09-29T23:29:05.861236+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:01:12.962284+0000","scrub_duration":0.0013132969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"19'2","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:49.521484+0000","last_change":"2023-09-29T23:29:49.521453+0000","last_active":"2023-09-29T23:29:49.521484+0000","last_peered":"2023-09-29T23:29:49.521484+0000","last_clean":"2023-09-29T23:29:49.521484+0000","last_became_active":"2023-09-29T23:23:45.077734+0000","last_became_peered":"2023-09-29T23:23:45.077734+0000","last_unstale":"2023-09-29T23:29:49.521484+0000","last_undegraded":"2023-09-29T23:29:49.521484+0000","last_fullsized":"2023-09-29T23:29:49.521484+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2023-09-29T23:29:49.521380+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2023-09-29T23:29:49.521380+0000","last_clean_scrub_stamp":"2023-09-29T23:29:49.521380+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:55:51.218343+0000","scrub_duration":0.0024495670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:21.923919+0000","last_change":"2023-09-29T23:29:21.923888+0000","last_active":"2023-09-29T23:29:21.923919+0000","last_peered":"2023-09-29T23:29:21.923919+0000","last_clean":"2023-09-29T23:29:21.923919+0000","last_became_active":"2023-09-29T23:23:45.467555+0000","last_became_peered":"2023-09-29T23:23:45.467555+0000","last_unstale":"2023-09-29T23:29:21.923919+0000","last_undegraded":"2023-09-29T23:29:21.923919+0000","last_fullsized":"2023-09-29T23:29:21.923919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:21.923791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:21.923791+0000","last_clean_scrub_stamp":"2023-09-29T23:29:21.923791+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:16:52.090307+0000","scrub_duration":0.0011468419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'3","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:48.985616+0000","last_change":"2023-09-29T23:29:48.985585+0000","last_active":"2023-09-29T23:29:48.985616+0000","last_peered":"2023-09-29T23:29:48.985616+0000","last_clean":"2023-09-29T23:29:48.985616+0000","last_became_active":"2023-09-29T23:23:45.092185+0000","last_became_peered":"2023-09-29T23:23:45.092185+0000","last_unstale":"2023-09-29T23:29:48.985616+0000","last_undegraded":"2023-09-29T23:29:48.985616+0000","last_fullsized":"2023-09-29T23:29:48.985616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2023-09-29T23:29:48.985514+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2023-09-29T23:29:48.985514+0000","last_clean_scrub_stamp":"2023-09-29T23:29:48.985514+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:40:48.367793+0000","scrub_duration":0.0024199220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:30.603213+0000","last_change":"2023-09-29T23:29:30.603186+0000","last_active":"2023-09-29T23:29:30.603213+0000","last_peered":"2023-09-29T23:29:30.603213+0000","last_clean":"2023-09-29T23:29:30.603213+0000","last_became_active":"2023-09-29T23:23:45.463806+0000","last_became_peered":"2023-09-29T23:23:45.463806+0000","last_unstale":"2023-09-29T23:29:30.603213+0000","last_undegraded":"2023-09-29T23:29:30.603213+0000","last_fullsized":"2023-09-29T23:29:30.603213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:30.603106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:30.603106+0000","last_clean_scrub_stamp":"2023-09-29T23:29:30.603106+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:58:06.609302+0000","scrub_duration":0.001486621,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'2","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:25.020656+0000","last_change":"2023-09-29T23:29:25.020628+0000","last_active":"2023-09-29T23:29:25.020656+0000","last_peered":"2023-09-29T23:29:25.020656+0000","last_clean":"2023-09-29T23:29:25.020656+0000","last_became_active":"2023-09-29T23:23:45.088535+0000","last_became_peered":"2023-09-29T23:23:45.088535+0000","last_unstale":"2023-09-29T23:29:25.020656+0000","last_undegraded":"2023-09-29T23:29:25.020656+0000","last_fullsized":"2023-09-29T23:29:25.020656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2023-09-29T23:29:25.020562+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2023-09-29T23:29:25.020562+0000","last_clean_scrub_stamp":"2023-09-29T23:29:25.020562+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:48:08.201258+0000","scrub_duration":0.0023368690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:22.533037+0000","last_change":"2023-09-29T23:29:22.533013+0000","last_active":"2023-09-29T23:29:22.533037+0000","last_peered":"2023-09-29T23:29:22.533037+0000","last_clean":"2023-09-29T23:29:22.533037+0000","last_became_active":"2023-09-29T23:23:45.465855+0000","last_became_peered":"2023-09-29T23:23:45.465855+0000","last_unstale":"2023-09-29T23:29:22.533037+0000","last_undegraded":"2023-09-29T23:29:22.533037+0000","last_fullsized":"2023-09-29T23:29:22.533037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:22.532933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:22.532933+0000","last_clean_scrub_stamp":"2023-09-29T23:29:22.532933+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:13:24.094704+0000","scrub_duration":0.001327693,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:49.992317+0000","last_change":"2023-09-29T23:29:49.992287+0000","last_active":"2023-09-29T23:29:49.992317+0000","last_peered":"2023-09-29T23:29:49.992317+0000","last_clean":"2023-09-29T23:29:49.992317+0000","last_became_active":"2023-09-29T23:23:45.092476+0000","last_became_peered":"2023-09-29T23:23:45.092476+0000","last_unstale":"2023-09-29T23:29:49.992317+0000","last_undegraded":"2023-09-29T23:29:49.992317+0000","last_fullsized":"2023-09-29T23:29:49.992317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:49.992215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:49.992215+0000","last_clean_scrub_stamp":"2023-09-29T23:29:49.992215+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:55:16.062531+0000","scrub_duration":0.0012909480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:22.330820+0000","last_change":"2023-09-29T23:30:22.330792+0000","last_active":"2023-09-29T23:30:22.330820+0000","last_peered":"2023-09-29T23:30:22.330820+0000","last_clean":"2023-09-29T23:30:22.330820+0000","last_became_active":"2023-09-29T23:23:45.466694+0000","last_became_peered":"2023-09-29T23:23:45.466694+0000","last_unstale":"2023-09-29T23:30:22.330820+0000","last_undegraded":"2023-09-29T23:30:22.330820+0000","last_fullsized":"2023-09-29T23:30:22.330820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:22.330723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:22.330723+0000","last_clean_scrub_stamp":"2023-09-29T23:30:22.330723+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:04:31.041259+0000","scrub_duration":0.0012801990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"19'3","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:16.689060+0000","last_change":"2023-09-29T23:30:16.689030+0000","last_active":"2023-09-29T23:30:16.689060+0000","last_peered":"2023-09-29T23:30:16.689060+0000","last_clean":"2023-09-29T23:30:16.689060+0000","last_became_active":"2023-09-29T23:23:45.089176+0000","last_became_peered":"2023-09-29T23:23:45.089176+0000","last_unstale":"2023-09-29T23:30:16.689060+0000","last_undegraded":"2023-09-29T23:30:16.689060+0000","last_fullsized":"2023-09-29T23:30:16.689060+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2023-09-29T23:30:16.688946+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2023-09-29T23:30:16.688946+0000","last_clean_scrub_stamp":"2023-09-29T23:30:16.688946+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:14:54.723869+0000","scrub_duration":0.0024773629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:27.538075+0000","last_change":"2023-09-29T23:29:27.538029+0000","last_active":"2023-09-29T23:29:27.538075+0000","last_peered":"2023-09-29T23:29:27.538075+0000","last_clean":"2023-09-29T23:29:27.538075+0000","last_became_active":"2023-09-29T23:23:45.465127+0000","last_became_peered":"2023-09-29T23:23:45.465127+0000","last_unstale":"2023-09-29T23:29:27.538075+0000","last_undegraded":"2023-09-29T23:29:27.538075+0000","last_fullsized":"2023-09-29T23:29:27.538075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:27.537939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:27.537939+0000","last_clean_scrub_stamp":"2023-09-29T23:29:27.537939+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:00:35.594777+0000","scrub_duration":0.00147858,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:31.072328+0000","last_change":"2023-09-29T23:29:31.072300+0000","last_active":"2023-09-29T23:29:31.072328+0000","last_peered":"2023-09-29T23:29:31.072328+0000","last_clean":"2023-09-29T23:29:31.072328+0000","last_became_active":"2023-09-29T23:23:45.075313+0000","last_became_peered":"2023-09-29T23:23:45.075313+0000","last_unstale":"2023-09-29T23:29:31.072328+0000","last_undegraded":"2023-09-29T23:29:31.072328+0000","last_fullsized":"2023-09-29T23:29:31.072328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:31.072231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:31.072231+0000","last_clean_scrub_stamp":"2023-09-29T23:29:31.072231+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:58:07.078428+0000","scrub_duration":0.001297475,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:20.010506+0000","last_change":"2023-09-29T23:29:20.010458+0000","last_active":"2023-09-29T23:29:20.010506+0000","last_peered":"2023-09-29T23:29:20.010506+0000","last_clean":"2023-09-29T23:29:20.010506+0000","last_became_active":"2023-09-29T23:24:37.288220+0000","last_became_peered":"2023-09-29T23:24:37.288220+0000","last_unstale":"2023-09-29T23:29:20.010506+0000","last_undegraded":"2023-09-29T23:29:20.010506+0000","last_fullsized":"2023-09-29T23:29:20.010506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:20.010379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:20.010379+0000","last_clean_scrub_stamp":"2023-09-29T23:29:20.010379+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:33:27.158783+0000","scrub_duration":0.0012507110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:34.135079+0000","last_change":"2023-09-29T23:29:34.135052+0000","last_active":"2023-09-29T23:29:34.135079+0000","last_peered":"2023-09-29T23:29:34.135079+0000","last_clean":"2023-09-29T23:29:34.135079+0000","last_became_active":"2023-09-29T23:23:45.075772+0000","last_became_peered":"2023-09-29T23:23:45.075772+0000","last_unstale":"2023-09-29T23:29:34.135079+0000","last_undegraded":"2023-09-29T23:29:34.135079+0000","last_fullsized":"2023-09-29T23:29:34.135079+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:34.134977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:34.134977+0000","last_clean_scrub_stamp":"2023-09-29T23:29:34.134977+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:55:00.205293+0000","scrub_duration":0.0011951520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:10.225499+0000","last_change":"2023-09-29T23:30:10.225458+0000","last_active":"2023-09-29T23:30:10.225499+0000","last_peered":"2023-09-29T23:30:10.225499+0000","last_clean":"2023-09-29T23:30:10.225499+0000","last_became_active":"2023-09-29T23:23:45.462583+0000","last_became_peered":"2023-09-29T23:23:45.462583+0000","last_unstale":"2023-09-29T23:30:10.225499+0000","last_undegraded":"2023-09-29T23:30:10.225499+0000","last_fullsized":"2023-09-29T23:30:10.225499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:10.225384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:10.225384+0000","last_clean_scrub_stamp":"2023-09-29T23:30:10.225384+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:47:22.711647+0000","scrub_duration":0.0012512929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:06.538053+0000","last_change":"2023-09-29T23:30:06.538019+0000","last_active":"2023-09-29T23:30:06.538053+0000","last_peered":"2023-09-29T23:30:06.538053+0000","last_clean":"2023-09-29T23:30:06.538053+0000","last_became_active":"2023-09-29T23:23:45.088506+0000","last_became_peered":"2023-09-29T23:23:45.088506+0000","last_unstale":"2023-09-29T23:30:06.538053+0000","last_undegraded":"2023-09-29T23:30:06.538053+0000","last_fullsized":"2023-09-29T23:30:06.538053+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:06.537917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:06.537917+0000","last_clean_scrub_stamp":"2023-09-29T23:30:06.537917+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:08:43.654885+0000","scrub_duration":0.001427242,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:25.556018+0000","last_change":"2023-09-29T23:29:25.555980+0000","last_active":"2023-09-29T23:29:25.556018+0000","last_peered":"2023-09-29T23:29:25.556018+0000","last_clean":"2023-09-29T23:29:25.556018+0000","last_became_active":"2023-09-29T23:23:45.477335+0000","last_became_peered":"2023-09-29T23:23:45.477335+0000","last_unstale":"2023-09-29T23:29:25.556018+0000","last_undegraded":"2023-09-29T23:29:25.556018+0000","last_fullsized":"2023-09-29T23:29:25.556018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:25.555859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:25.555859+0000","last_clean_scrub_stamp":"2023-09-29T23:29:25.555859+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:48:08.736556+0000","scrub_duration":0.001410761,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:44.036092+0000","last_change":"2023-09-29T23:29:44.036057+0000","last_active":"2023-09-29T23:29:44.036092+0000","last_peered":"2023-09-29T23:29:44.036092+0000","last_clean":"2023-09-29T23:29:44.036092+0000","last_became_active":"2023-09-29T23:23:41.047701+0000","last_became_peered":"2023-09-29T23:23:41.047701+0000","last_unstale":"2023-09-29T23:29:44.036092+0000","last_undegraded":"2023-09-29T23:29:44.036092+0000","last_fullsized":"2023-09-29T23:29:44.036092+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:44.035955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:44.035955+0000","last_clean_scrub_stamp":"2023-09-29T23:29:44.035955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:00:52.092793+0000","scrub_duration":0.0012373569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"19'2","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:38.169235+0000","last_change":"2023-09-29T23:29:38.169200+0000","last_active":"2023-09-29T23:29:38.169235+0000","last_peered":"2023-09-29T23:29:38.169235+0000","last_clean":"2023-09-29T23:29:38.169235+0000","last_became_active":"2023-09-29T23:23:45.075249+0000","last_became_peered":"2023-09-29T23:23:45.075249+0000","last_unstale":"2023-09-29T23:29:38.169235+0000","last_undegraded":"2023-09-29T23:29:38.169235+0000","last_fullsized":"2023-09-29T23:29:38.169235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2023-09-29T23:29:38.169127+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2023-09-29T23:29:38.169127+0000","last_clean_scrub_stamp":"2023-09-29T23:29:38.169127+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:31:27.775746+0000","scrub_duration":0.0022639449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:57.160844+0000","last_change":"2023-09-29T23:29:57.160818+0000","last_active":"2023-09-29T23:29:57.160844+0000","last_peered":"2023-09-29T23:29:57.160844+0000","last_clean":"2023-09-29T23:29:57.160844+0000","last_became_active":"2023-09-29T23:23:45.459933+0000","last_became_peered":"2023-09-29T23:23:45.459933+0000","last_unstale":"2023-09-29T23:29:57.160844+0000","last_undegraded":"2023-09-29T23:29:57.160844+0000","last_fullsized":"2023-09-29T23:29:57.160844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:57.160742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:57.160742+0000","last_clean_scrub_stamp":"2023-09-29T23:29:57.160742+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:49:24.728236+0000","scrub_duration":0.00150358,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:58.280783+0000","last_change":"2023-09-29T23:29:58.280753+0000","last_active":"2023-09-29T23:29:58.280783+0000","last_peered":"2023-09-29T23:29:58.280783+0000","last_clean":"2023-09-29T23:29:58.280783+0000","last_became_active":"2023-09-29T23:23:41.051398+0000","last_became_peered":"2023-09-29T23:23:41.051398+0000","last_unstale":"2023-09-29T23:29:58.280783+0000","last_undegraded":"2023-09-29T23:29:58.280783+0000","last_fullsized":"2023-09-29T23:29:58.280783+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:58.280681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:58.280681+0000","last_clean_scrub_stamp":"2023-09-29T23:29:58.280681+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:09:07.434844+0000","scrub_duration":0.0012573930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"19'3","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:44.269068+0000","last_change":"2023-09-29T23:29:44.269039+0000","last_active":"2023-09-29T23:29:44.269068+0000","last_peered":"2023-09-29T23:29:44.269068+0000","last_clean":"2023-09-29T23:29:44.269068+0000","last_became_active":"2023-09-29T23:23:45.076293+0000","last_became_peered":"2023-09-29T23:23:45.076293+0000","last_unstale":"2023-09-29T23:29:44.269068+0000","last_undegraded":"2023-09-29T23:29:44.269068+0000","last_fullsized":"2023-09-29T23:29:44.269068+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2023-09-29T23:29:44.268975+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2023-09-29T23:29:44.268975+0000","last_clean_scrub_stamp":"2023-09-29T23:29:44.268975+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:38:17.282170+0000","scrub_duration":0.001934049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:29.587702+0000","last_change":"2023-09-29T23:29:29.587659+0000","last_active":"2023-09-29T23:29:29.587702+0000","last_peered":"2023-09-29T23:29:29.587702+0000","last_clean":"2023-09-29T23:29:29.587702+0000","last_became_active":"2023-09-29T23:23:45.466115+0000","last_became_peered":"2023-09-29T23:23:45.466115+0000","last_unstale":"2023-09-29T23:29:29.587702+0000","last_undegraded":"2023-09-29T23:29:29.587702+0000","last_fullsized":"2023-09-29T23:29:29.587702+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:29.587583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:29.587583+0000","last_clean_scrub_stamp":"2023-09-29T23:29:29.587583+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:37:44.018376+0000","scrub_duration":0.001426788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:52.216025+0000","last_change":"2023-09-29T23:29:52.216000+0000","last_active":"2023-09-29T23:29:52.216025+0000","last_peered":"2023-09-29T23:29:52.216025+0000","last_clean":"2023-09-29T23:29:52.216025+0000","last_became_active":"2023-09-29T23:23:41.049786+0000","last_became_peered":"2023-09-29T23:23:41.049786+0000","last_unstale":"2023-09-29T23:29:52.216025+0000","last_undegraded":"2023-09-29T23:29:52.216025+0000","last_fullsized":"2023-09-29T23:29:52.216025+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:52.215917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:52.215917+0000","last_clean_scrub_stamp":"2023-09-29T23:29:52.215917+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:18:42.482853+0000","scrub_duration":0.001382861,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:47.017087+0000","last_change":"2023-09-29T23:29:47.017056+0000","last_active":"2023-09-29T23:29:47.017087+0000","last_peered":"2023-09-29T23:29:47.017087+0000","last_clean":"2023-09-29T23:29:47.017087+0000","last_became_active":"2023-09-29T23:23:45.091162+0000","last_became_peered":"2023-09-29T23:23:45.091162+0000","last_unstale":"2023-09-29T23:29:47.017087+0000","last_undegraded":"2023-09-29T23:29:47.017087+0000","last_fullsized":"2023-09-29T23:29:47.017087+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:47.016976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:47.016976+0000","last_clean_scrub_stamp":"2023-09-29T23:29:47.016976+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:58:23.023172+0000","scrub_duration":0.0015069770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:35.597361+0000","last_change":"2023-09-29T23:29:35.597332+0000","last_active":"2023-09-29T23:29:35.597361+0000","last_peered":"2023-09-29T23:29:35.597361+0000","last_clean":"2023-09-29T23:29:35.597361+0000","last_became_active":"2023-09-29T23:23:45.473861+0000","last_became_peered":"2023-09-29T23:23:45.473861+0000","last_unstale":"2023-09-29T23:29:35.597361+0000","last_undegraded":"2023-09-29T23:29:35.597361+0000","last_fullsized":"2023-09-29T23:29:35.597361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:35.597256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:35.597256+0000","last_clean_scrub_stamp":"2023-09-29T23:29:35.597256+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:19:28.249320+0000","scrub_duration":0.001352902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:04.499106+0000","last_change":"2023-09-29T23:30:04.499084+0000","last_active":"2023-09-29T23:30:04.499106+0000","last_peered":"2023-09-29T23:30:04.499106+0000","last_clean":"2023-09-29T23:30:04.499106+0000","last_became_active":"2023-09-29T23:23:41.049442+0000","last_became_peered":"2023-09-29T23:23:41.049442+0000","last_unstale":"2023-09-29T23:30:04.499106+0000","last_undegraded":"2023-09-29T23:30:04.499106+0000","last_fullsized":"2023-09-29T23:30:04.499106+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:04.499020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:04.499020+0000","last_clean_scrub_stamp":"2023-09-29T23:30:04.499020+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:44:35.237185+0000","scrub_duration":0.001192598,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:48.013392+0000","last_change":"2023-09-29T23:29:48.013344+0000","last_active":"2023-09-29T23:29:48.013392+0000","last_peered":"2023-09-29T23:29:48.013392+0000","last_clean":"2023-09-29T23:29:48.013392+0000","last_became_active":"2023-09-29T23:23:45.092042+0000","last_became_peered":"2023-09-29T23:23:45.092042+0000","last_unstale":"2023-09-29T23:29:48.013392+0000","last_undegraded":"2023-09-29T23:29:48.013392+0000","last_fullsized":"2023-09-29T23:29:48.013392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:48.013267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:48.013267+0000","last_clean_scrub_stamp":"2023-09-29T23:29:48.013267+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:28:35.339069+0000","scrub_duration":0.0013823450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:16.358044+0000","last_change":"2023-09-29T23:30:16.358001+0000","last_active":"2023-09-29T23:30:16.358044+0000","last_peered":"2023-09-29T23:30:16.358044+0000","last_clean":"2023-09-29T23:30:16.358044+0000","last_became_active":"2023-09-29T23:23:45.461228+0000","last_became_peered":"2023-09-29T23:23:45.461228+0000","last_unstale":"2023-09-29T23:30:16.358044+0000","last_undegraded":"2023-09-29T23:30:16.358044+0000","last_fullsized":"2023-09-29T23:30:16.358044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:16.357918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:16.357918+0000","last_clean_scrub_stamp":"2023-09-29T23:30:16.357918+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:48:53.604154+0000","scrub_duration":0.001175169,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:50.258815+0000","last_change":"2023-09-29T23:29:50.258790+0000","last_active":"2023-09-29T23:29:50.258815+0000","last_peered":"2023-09-29T23:29:50.258815+0000","last_clean":"2023-09-29T23:29:50.258815+0000","last_became_active":"2023-09-29T23:23:41.050731+0000","last_became_peered":"2023-09-29T23:23:41.050731+0000","last_unstale":"2023-09-29T23:29:50.258815+0000","last_undegraded":"2023-09-29T23:29:50.258815+0000","last_fullsized":"2023-09-29T23:29:50.258815+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:50.258719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:50.258719+0000","last_clean_scrub_stamp":"2023-09-29T23:29:50.258719+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:55:51.955682+0000","scrub_duration":0.0012560539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:06.378016+0000","last_change":"2023-09-29T23:30:06.377990+0000","last_active":"2023-09-29T23:30:06.378016+0000","last_peered":"2023-09-29T23:30:06.378016+0000","last_clean":"2023-09-29T23:30:06.378016+0000","last_became_active":"2023-09-29T23:23:45.088510+0000","last_became_peered":"2023-09-29T23:23:45.088510+0000","last_unstale":"2023-09-29T23:30:06.378016+0000","last_undegraded":"2023-09-29T23:30:06.378016+0000","last_fullsized":"2023-09-29T23:30:06.378016+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:06.377904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:06.377904+0000","last_clean_scrub_stamp":"2023-09-29T23:30:06.377904+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:11:17.804105+0000","scrub_duration":0.0014090369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:02.256509+0000","last_change":"2023-09-29T23:29:02.256478+0000","last_active":"2023-09-29T23:29:02.256509+0000","last_peered":"2023-09-29T23:29:02.256509+0000","last_clean":"2023-09-29T23:29:02.256509+0000","last_became_active":"2023-09-29T23:23:45.461672+0000","last_became_peered":"2023-09-29T23:23:45.461672+0000","last_unstale":"2023-09-29T23:29:02.256509+0000","last_undegraded":"2023-09-29T23:29:02.256509+0000","last_fullsized":"2023-09-29T23:29:02.256509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:02.256385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:02.256385+0000","last_clean_scrub_stamp":"2023-09-29T23:29:02.256385+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:07:21.355472+0000","scrub_duration":0.0012288970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:40.998542+0000","last_change":"2023-09-29T23:29:40.998515+0000","last_active":"2023-09-29T23:29:40.998542+0000","last_peered":"2023-09-29T23:29:40.998542+0000","last_clean":"2023-09-29T23:29:40.998542+0000","last_became_active":"2023-09-29T23:23:41.046803+0000","last_became_peered":"2023-09-29T23:23:41.046803+0000","last_unstale":"2023-09-29T23:29:40.998542+0000","last_undegraded":"2023-09-29T23:29:40.998542+0000","last_fullsized":"2023-09-29T23:29:40.998542+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:40.998440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:40.998440+0000","last_clean_scrub_stamp":"2023-09-29T23:29:40.998440+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:39:47.280530+0000","scrub_duration":0.0015252709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:08.596401+0000","last_change":"2023-09-29T23:30:08.596357+0000","last_active":"2023-09-29T23:30:08.596401+0000","last_peered":"2023-09-29T23:30:08.596401+0000","last_clean":"2023-09-29T23:30:08.596401+0000","last_became_active":"2023-09-29T23:23:45.072973+0000","last_became_peered":"2023-09-29T23:23:45.072973+0000","last_unstale":"2023-09-29T23:30:08.596401+0000","last_undegraded":"2023-09-29T23:30:08.596401+0000","last_fullsized":"2023-09-29T23:30:08.596401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:08.596275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:08.596275+0000","last_clean_scrub_stamp":"2023-09-29T23:30:08.596275+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:47.410206+0000","scrub_duration":0.001392052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:31.558487+0000","last_change":"2023-09-29T23:29:31.558456+0000","last_active":"2023-09-29T23:29:31.558487+0000","last_peered":"2023-09-29T23:29:31.558487+0000","last_clean":"2023-09-29T23:29:31.558487+0000","last_became_active":"2023-09-29T23:23:45.474318+0000","last_became_peered":"2023-09-29T23:23:45.474318+0000","last_unstale":"2023-09-29T23:29:31.558487+0000","last_undegraded":"2023-09-29T23:29:31.558487+0000","last_fullsized":"2023-09-29T23:29:31.558487+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:31.558347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:31.558347+0000","last_clean_scrub_stamp":"2023-09-29T23:29:31.558347+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:28:18.884148+0000","scrub_duration":0.0014565979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:55.181446+0000","last_change":"2023-09-29T23:29:55.181415+0000","last_active":"2023-09-29T23:29:55.181446+0000","last_peered":"2023-09-29T23:29:55.181446+0000","last_clean":"2023-09-29T23:29:55.181446+0000","last_became_active":"2023-09-29T23:23:41.050639+0000","last_became_peered":"2023-09-29T23:23:41.050639+0000","last_unstale":"2023-09-29T23:29:55.181446+0000","last_undegraded":"2023-09-29T23:29:55.181446+0000","last_fullsized":"2023-09-29T23:29:55.181446+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:55.181345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:55.181345+0000","last_clean_scrub_stamp":"2023-09-29T23:29:55.181345+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:49:46.987614+0000","scrub_duration":0.0012601999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:08.359118+0000","last_change":"2023-09-29T23:30:08.359083+0000","last_active":"2023-09-29T23:30:08.359118+0000","last_peered":"2023-09-29T23:30:08.359118+0000","last_clean":"2023-09-29T23:30:08.359118+0000","last_became_active":"2023-09-29T23:23:45.076806+0000","last_became_peered":"2023-09-29T23:23:45.076806+0000","last_unstale":"2023-09-29T23:30:08.359118+0000","last_undegraded":"2023-09-29T23:30:08.359118+0000","last_fullsized":"2023-09-29T23:30:08.359118+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:08.358980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:08.358980+0000","last_clean_scrub_stamp":"2023-09-29T23:30:08.358980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:57:06.355192+0000","scrub_duration":0.0013920250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:07.259573+0000","last_change":"2023-09-29T23:29:07.259539+0000","last_active":"2023-09-29T23:29:07.259573+0000","last_peered":"2023-09-29T23:29:07.259573+0000","last_clean":"2023-09-29T23:29:07.259573+0000","last_became_active":"2023-09-29T23:23:45.460913+0000","last_became_peered":"2023-09-29T23:23:45.460913+0000","last_unstale":"2023-09-29T23:29:07.259573+0000","last_undegraded":"2023-09-29T23:29:07.259573+0000","last_fullsized":"2023-09-29T23:29:07.259573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:07.259462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:07.259462+0000","last_clean_scrub_stamp":"2023-09-29T23:29:07.259462+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:35:33.384041+0000","scrub_duration":0.001325735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:05.367173+0000","last_change":"2023-09-29T23:30:05.367130+0000","last_active":"2023-09-29T23:30:05.367173+0000","last_peered":"2023-09-29T23:30:05.367173+0000","last_clean":"2023-09-29T23:30:05.367173+0000","last_became_active":"2023-09-29T23:23:41.049783+0000","last_became_peered":"2023-09-29T23:23:41.049783+0000","last_unstale":"2023-09-29T23:30:05.367173+0000","last_undegraded":"2023-09-29T23:30:05.367173+0000","last_fullsized":"2023-09-29T23:30:05.367173+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:05.367055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:05.367055+0000","last_clean_scrub_stamp":"2023-09-29T23:30:05.367055+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:44:36.105220+0000","scrub_duration":0.001402354,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:10.361725+0000","last_change":"2023-09-29T23:30:10.361697+0000","last_active":"2023-09-29T23:30:10.361725+0000","last_peered":"2023-09-29T23:30:10.361725+0000","last_clean":"2023-09-29T23:30:10.361725+0000","last_became_active":"2023-09-29T23:23:45.075273+0000","last_became_peered":"2023-09-29T23:23:45.075273+0000","last_unstale":"2023-09-29T23:30:10.361725+0000","last_undegraded":"2023-09-29T23:30:10.361725+0000","last_fullsized":"2023-09-29T23:30:10.361725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:10.361623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:10.361623+0000","last_clean_scrub_stamp":"2023-09-29T23:30:10.361623+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:45:41.862419+0000","scrub_duration":0.001344767,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:56.134483+0000","last_change":"2023-09-29T23:29:56.134457+0000","last_active":"2023-09-29T23:29:56.134483+0000","last_peered":"2023-09-29T23:29:56.134483+0000","last_clean":"2023-09-29T23:29:56.134483+0000","last_became_active":"2023-09-29T23:23:45.458250+0000","last_became_peered":"2023-09-29T23:23:45.458250+0000","last_unstale":"2023-09-29T23:29:56.134483+0000","last_undegraded":"2023-09-29T23:29:56.134483+0000","last_fullsized":"2023-09-29T23:29:56.134483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:56.134376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:56.134376+0000","last_clean_scrub_stamp":"2023-09-29T23:29:56.134376+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:37:36.784301+0000","scrub_duration":0.0013877640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"19'3","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:01.470635+0000","last_change":"2023-09-29T23:30:01.470603+0000","last_active":"2023-09-29T23:30:01.470635+0000","last_peered":"2023-09-29T23:30:01.470635+0000","last_clean":"2023-09-29T23:30:01.470635+0000","last_became_active":"2023-09-29T23:23:45.076638+0000","last_became_peered":"2023-09-29T23:23:45.076638+0000","last_unstale":"2023-09-29T23:30:01.470635+0000","last_undegraded":"2023-09-29T23:30:01.470635+0000","last_fullsized":"2023-09-29T23:30:01.470635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2023-09-29T23:30:01.470532+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2023-09-29T23:30:01.470532+0000","last_clean_scrub_stamp":"2023-09-29T23:30:01.470532+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:12:16.958202+0000","scrub_duration":0.002617299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:31.872101+0000","last_change":"2023-09-29T23:29:31.872071+0000","last_active":"2023-09-29T23:29:31.872101+0000","last_peered":"2023-09-29T23:29:31.872101+0000","last_clean":"2023-09-29T23:29:31.872101+0000","last_became_active":"2023-09-29T23:23:45.471013+0000","last_became_peered":"2023-09-29T23:23:45.471013+0000","last_unstale":"2023-09-29T23:29:31.872101+0000","last_undegraded":"2023-09-29T23:29:31.872101+0000","last_fullsized":"2023-09-29T23:29:31.872101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:31.871991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:31.871991+0000","last_clean_scrub_stamp":"2023-09-29T23:29:31.871991+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:32:09.372334+0000","scrub_duration":0.0012566319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"19'3","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:17.257604+0000","last_change":"2023-09-29T23:30:17.257555+0000","last_active":"2023-09-29T23:30:17.257604+0000","last_peered":"2023-09-29T23:30:17.257604+0000","last_clean":"2023-09-29T23:30:17.257604+0000","last_became_active":"2023-09-29T23:24:37.292123+0000","last_became_peered":"2023-09-29T23:24:37.292123+0000","last_unstale":"2023-09-29T23:30:17.257604+0000","last_undegraded":"2023-09-29T23:30:17.257604+0000","last_fullsized":"2023-09-29T23:30:17.257604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2023-09-29T23:30:17.257479+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2023-09-29T23:30:17.257479+0000","last_clean_scrub_stamp":"2023-09-29T23:30:17.257479+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:44:47.995644+0000","scrub_duration":0.0023675160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:15.390901+0000","last_change":"2023-09-29T23:30:15.390875+0000","last_active":"2023-09-29T23:30:15.390901+0000","last_peered":"2023-09-29T23:30:15.390901+0000","last_clean":"2023-09-29T23:30:15.390901+0000","last_became_active":"2023-09-29T23:23:45.471673+0000","last_became_peered":"2023-09-29T23:23:45.471673+0000","last_unstale":"2023-09-29T23:30:15.390901+0000","last_undegraded":"2023-09-29T23:30:15.390901+0000","last_fullsized":"2023-09-29T23:30:15.390901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:15.390806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:15.390806+0000","last_clean_scrub_stamp":"2023-09-29T23:30:15.390806+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:09:43.482879+0000","scrub_duration":0.0012633570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:54.125173+0000","last_change":"2023-09-29T23:29:54.125148+0000","last_active":"2023-09-29T23:29:54.125173+0000","last_peered":"2023-09-29T23:29:54.125173+0000","last_clean":"2023-09-29T23:29:54.125173+0000","last_became_active":"2023-09-29T23:23:45.092203+0000","last_became_peered":"2023-09-29T23:23:45.092203+0000","last_unstale":"2023-09-29T23:29:54.125173+0000","last_undegraded":"2023-09-29T23:29:54.125173+0000","last_fullsized":"2023-09-29T23:29:54.125173+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'1","last_scrub_stamp":"2023-09-29T23:29:54.125069+0000","last_deep_scrub":"16'1","last_deep_scrub_stamp":"2023-09-29T23:29:54.125069+0000","last_clean_scrub_stamp":"2023-09-29T23:29:54.125069+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:41:19.507992+0000","scrub_duration":0.0014059070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:57.528090+0000","last_change":"2023-09-29T23:29:57.528059+0000","last_active":"2023-09-29T23:29:57.528090+0000","last_peered":"2023-09-29T23:29:57.528090+0000","last_clean":"2023-09-29T23:29:57.528090+0000","last_became_active":"2023-09-29T23:23:45.464202+0000","last_became_peered":"2023-09-29T23:23:45.464202+0000","last_unstale":"2023-09-29T23:29:57.528090+0000","last_undegraded":"2023-09-29T23:29:57.528090+0000","last_fullsized":"2023-09-29T23:29:57.528090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:57.527982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:57.527982+0000","last_clean_scrub_stamp":"2023-09-29T23:29:57.527982+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:09:06.682144+0000","scrub_duration":0.0013085379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1f","version":"19'6","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:15.702253+0000","last_change":"2023-09-29T23:30:15.702222+0000","last_active":"2023-09-29T23:30:15.702253+0000","last_peered":"2023-09-29T23:30:15.702253+0000","last_clean":"2023-09-29T23:30:15.702253+0000","last_became_active":"2023-09-29T23:23:45.073772+0000","last_became_peered":"2023-09-29T23:23:45.073772+0000","last_unstale":"2023-09-29T23:30:15.702253+0000","last_undegraded":"2023-09-29T23:30:15.702253+0000","last_fullsized":"2023-09-29T23:30:15.702253+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2023-09-29T23:30:15.702153+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2023-09-29T23:30:15.702153+0000","last_clean_scrub_stamp":"2023-09-29T23:30:15.702153+0000","objects_scrubbed":2,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:48:52.948388+0000","scrub_duration":0.0032293310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:14.852011+0000","last_change":"2023-09-29T23:29:14.851983+0000","last_active":"2023-09-29T23:29:14.852011+0000","last_peered":"2023-09-29T23:29:14.852011+0000","last_clean":"2023-09-29T23:29:14.852011+0000","last_became_active":"2023-09-29T23:23:45.460548+0000","last_became_peered":"2023-09-29T23:23:45.460548+0000","last_unstale":"2023-09-29T23:29:14.852011+0000","last_undegraded":"2023-09-29T23:29:14.852011+0000","last_fullsized":"2023-09-29T23:29:14.852011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:14.851891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:14.851891+0000","last_clean_scrub_stamp":"2023-09-29T23:29:14.851891+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:08:19.031301+0000","scrub_duration":0.0015205469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:19.888652+0000","last_change":"2023-09-29T23:29:19.888625+0000","last_active":"2023-09-29T23:29:19.888652+0000","last_peered":"2023-09-29T23:29:19.888652+0000","last_clean":"2023-09-29T23:29:19.888652+0000","last_became_active":"2023-09-29T23:23:45.471294+0000","last_became_peered":"2023-09-29T23:23:45.471294+0000","last_unstale":"2023-09-29T23:29:19.888652+0000","last_undegraded":"2023-09-29T23:29:19.888652+0000","last_fullsized":"2023-09-29T23:29:19.888652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:19.888553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:19.888553+0000","last_clean_scrub_stamp":"2023-09-29T23:29:19.888553+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:21:05.111883+0000","scrub_duration":0.0012268019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:16.870489+0000","last_change":"2023-09-29T23:29:16.870462+0000","last_active":"2023-09-29T23:29:16.870489+0000","last_peered":"2023-09-29T23:29:16.870489+0000","last_clean":"2023-09-29T23:29:16.870489+0000","last_became_active":"2023-09-29T23:23:45.461188+0000","last_became_peered":"2023-09-29T23:23:45.461188+0000","last_unstale":"2023-09-29T23:29:16.870489+0000","last_undegraded":"2023-09-29T23:29:16.870489+0000","last_fullsized":"2023-09-29T23:29:16.870489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:16.870393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:16.870393+0000","last_clean_scrub_stamp":"2023-09-29T23:29:16.870393+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:08:57.437070+0000","scrub_duration":0.00131145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:21.651991+0000","last_change":"2023-09-29T23:30:21.651954+0000","last_active":"2023-09-29T23:30:21.651991+0000","last_peered":"2023-09-29T23:30:21.651991+0000","last_clean":"2023-09-29T23:30:21.651991+0000","last_became_active":"2023-09-29T23:23:45.473438+0000","last_became_peered":"2023-09-29T23:23:45.473438+0000","last_unstale":"2023-09-29T23:30:21.651991+0000","last_undegraded":"2023-09-29T23:30:21.651991+0000","last_fullsized":"2023-09-29T23:30:21.651991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:21.651881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:21.651881+0000","last_clean_scrub_stamp":"2023-09-29T23:30:21.651881+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:04:30.362417+0000","scrub_duration":0.001315739,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:21.580746+0000","last_change":"2023-09-29T23:29:21.580719+0000","last_active":"2023-09-29T23:29:21.580746+0000","last_peered":"2023-09-29T23:29:21.580746+0000","last_clean":"2023-09-29T23:29:21.580746+0000","last_became_active":"2023-09-29T23:23:45.474163+0000","last_became_peered":"2023-09-29T23:23:45.474163+0000","last_unstale":"2023-09-29T23:29:21.580746+0000","last_undegraded":"2023-09-29T23:29:21.580746+0000","last_fullsized":"2023-09-29T23:29:21.580746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:21.580646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:21.580646+0000","last_clean_scrub_stamp":"2023-09-29T23:29:21.580646+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:43:26.283595+0000","scrub_duration":0.001312361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:16.435331+0000","last_change":"2023-09-29T23:29:16.435290+0000","last_active":"2023-09-29T23:29:16.435331+0000","last_peered":"2023-09-29T23:29:16.435331+0000","last_clean":"2023-09-29T23:29:16.435331+0000","last_became_active":"2023-09-29T23:23:45.473063+0000","last_became_peered":"2023-09-29T23:23:45.473063+0000","last_unstale":"2023-09-29T23:29:16.435331+0000","last_undegraded":"2023-09-29T23:29:16.435331+0000","last_fullsized":"2023-09-29T23:29:16.435331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:16.435179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:16.435179+0000","last_clean_scrub_stamp":"2023-09-29T23:29:16.435179+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:31:53.935521+0000","scrub_duration":0.001480377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:13.403881+0000","last_change":"2023-09-29T23:30:13.403854+0000","last_active":"2023-09-29T23:30:13.403881+0000","last_peered":"2023-09-29T23:30:13.403881+0000","last_clean":"2023-09-29T23:30:13.403881+0000","last_became_active":"2023-09-29T23:23:45.463269+0000","last_became_peered":"2023-09-29T23:23:45.463269+0000","last_unstale":"2023-09-29T23:30:13.403881+0000","last_undegraded":"2023-09-29T23:30:13.403881+0000","last_fullsized":"2023-09-29T23:30:13.403881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:13.403784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:13.403784+0000","last_clean_scrub_stamp":"2023-09-29T23:30:13.403784+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:32:21.948314+0000","scrub_duration":0.001227697,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705748,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5700,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":104851900,"statfs":{"total":107374182400,"available":107368345600,"internally_reserved":0,"allocated":192512,"data_stored":54287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 29 23:29:54 2023","interfaces":[{"interface":"back","average":{"1min":0.27900000000000003,"5min":0.28599999999999998,"15min":0.27600000000000002},"min":{"1min":0.22800000000000001,"5min":0.14499999999999999,"15min":0.14499999999999999},"max":{"1min":0.377,"5min":0.435,"15min":0.435},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.27600000000000002},"min":{"1min":0.22900000000000001,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.40300000000000002,"5min":0.437,"15min":0.437},"last":0.28899999999999998}]},{"osd":2,"last update":"Fri Sep 29 23:29:54 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.30099999999999999,"15min":0.27900000000000003},"min":{"1min":0.214,"5min":0.20699999999999999,"15min":0.186},"max":{"1min":0.42499999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.314},{"interface":"front","average":{"1min":0.318,"5min":0.316,"15min":0.29599999999999999},"min":{"1min":0.26900000000000002,"5min":0.191,"15min":0.191},"max":{"1min":0.437,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.30299999999999999}]}]},{"osd":2,"up_from":8,"seq":34359738451,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5564,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852036,"statfs":{"total":107374182400,"available":107368484864,"internally_reserved":0,"allocated":184320,"data_stored":53655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 29 23:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.28199999999999997,"15min":0.28799999999999998},"min":{"1min":0.21099999999999999,"5min":0.184,"15min":0.17699999999999999},"max":{"1min":0.40400000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.311,"5min":0.29299999999999998,"15min":0.29799999999999999},"min":{"1min":0.222,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.41899999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.29199999999999998}]},{"osd":1,"last update":"Fri Sep 29 23:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.30199999999999999,"15min":0.30099999999999999},"min":{"1min":0.224,"5min":0.20399999999999999,"15min":0.189},"max":{"1min":0.44400000000000001,"5min":0.498,"15min":0.498},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.314,"15min":0.318},"min":{"1min":0.23799999999999999,"5min":0.21199999999999999,"15min":0.20499999999999999},"max":{"1min":0.45700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.309}]}]},{"osd":0,"up_from":9,"seq":38654705747,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5688,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":104851912,"statfs":{"total":107374182400,"available":107368357888,"internally_reserved":0,"allocated":180224,"data_stored":52715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 29 23:29:48 2023","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.27800000000000002,"15min":0.28399999999999997},"min":{"1min":0.21099999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.29499999999999998,"5min":0.28799999999999998,"15min":0.27200000000000002},"min":{"1min":0.23100000000000001,"5min":0.187,"15min":0.17799999999999999},"max":{"1min":0.41699999999999998,"5min":0.44,"15min":0.44},"last":0.30299999999999999}]},{"osd":2,"last update":"Fri Sep 29 23:29:48 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.29599999999999999,"15min":0.27200000000000002},"min":{"1min":0.24099999999999999,"5min":0.19900000000000001,"15min":0.191},"max":{"1min":0.42999999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.312,"5min":0.30399999999999999,"15min":0.28999999999999998},"min":{"1min":0.245,"5min":0.215,"15min":0.215},"max":{"1min":0.441,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.32800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-29T23:30:24.286 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:24.286 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:24.286 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:24.286 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:24.287 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:24.287 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:24.287 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:24.287 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:24.287 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:24.287 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-09-29T23:23:45.052710+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=23, tm_sec=45, tm_wday=4, tm_yday=272, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=29, tm_hour=23, tm_min=29, tm_sec=0, tm_wday=4, tm_yday=272, tm_isdst=0) 2023-09-29T23:30:24.288 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-29T23:30:44.290 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-29T23:30:44.428 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.426+0000 7f4359dd6700 1 Processor -- start 2023-09-29T23:30:44.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.426+0000 7f4359dd6700 1 -- start start 2023-09-29T23:30:44.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.426+0000 7f4359dd6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f435406b0c0 0x7f435412f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:30:44.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.426+0000 7f4359dd6700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435409ca80 con 0x7f435412fb70 2023-09-29T23:30:44.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.426+0000 7f4359dd6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435406b490 con 0x7f435406b0c0 2023-09-29T23:30:44.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.427+0000 7f4358dd4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f435406b0c0 0x7f435412f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:30:44.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.427+0000 7f4353fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f435412fb70 0x7f4354099530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:48018/0 (socket says 172.21.15.92:48018) 2023-09-29T23:30:44.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.427+0000 7f4353fff700 1 -- 172.21.15.92:0/2020778867 learned_addr learned my addr 172.21.15.92:0/2020778867 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:30:44.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.427+0000 7f4358dd4700 1 -- 172.21.15.92:0/2020778867 >> v1:172.21.15.92:6789/0 conn(0x7f435412fb70 legacy=0x7f4354099530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:30:44.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.427+0000 7f4358dd4700 1 -- 172.21.15.92:0/2020778867 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435409be20 con 0x7f435406b0c0 2023-09-29T23:30:44.429 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.427+0000 7f43537fe700 1 -- 172.21.15.92:0/2020778867 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095410513 0 0) 0x7f4340001110 con 0x7f435412fb70 2023-09-29T23:30:44.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.427+0000 7f4358dd4700 1 --2- 172.21.15.92:0/2020778867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f435406b0c0 0x7f435412f630 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4348009860 tx=0x7f43480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa27681359a90d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:30:44.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.427+0000 7f43537fe700 1 -- 172.21.15.92:0/2020778867 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f434800b680 con 0x7f435406b0c0 2023-09-29T23:30:44.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.427+0000 7f43537fe700 1 -- 172.21.15.92:0/2020778867 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434800b7e0 con 0x7f435406b0c0 2023-09-29T23:30:44.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.427+0000 7f43537fe700 1 -- 172.21.15.92:0/2020778867 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f434800bad0 con 0x7f435406b0c0 2023-09-29T23:30:44.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.428+0000 7f4359dd6700 1 -- 172.21.15.92:0/2020778867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f435406b0c0 msgr2=0x7f435412f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:30:44.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.428+0000 7f4359dd6700 1 --2- 172.21.15.92:0/2020778867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f435406b0c0 0x7f435412f630 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4348009860 tx=0x7f43480091a0 comp rx=0 tx=0).stop 2023-09-29T23:30:44.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.428+0000 7f4359dd6700 1 -- 172.21.15.92:0/2020778867 shutdown_connections 2023-09-29T23:30:44.430 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.428+0000 7f4359dd6700 1 --2- 172.21.15.92:0/2020778867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f435406b0c0 0x7f435412f630 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:30:44.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.428+0000 7f4359dd6700 1 -- 172.21.15.92:0/2020778867 >> 172.21.15.92:0/2020778867 conn(0x7f435406a5b0 msgr2=0x7f435406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:30:44.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.428+0000 7f4359dd6700 1 -- 172.21.15.92:0/2020778867 shutdown_connections 2023-09-29T23:30:44.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.428+0000 7f4359dd6700 1 -- 172.21.15.92:0/2020778867 wait complete. 2023-09-29T23:30:44.431 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.429+0000 7f4359dd6700 1 Processor -- start 2023-09-29T23:30:44.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.429+0000 7f4359dd6700 1 -- start start 2023-09-29T23:30:44.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.429+0000 7f4359dd6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f435406b0c0 0x7f435412c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:30:44.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.429+0000 7f4359dd6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435411b5d0 con 0x7f435406b0c0 2023-09-29T23:30:44.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.429+0000 7f4358dd4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f435406b0c0 0x7f435412c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:30:44.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.429+0000 7f4358dd4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f435406b0c0 0x7f435412c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34748/0 (socket says 172.21.15.92:34748) 2023-09-29T23:30:44.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.429+0000 7f4358dd4700 1 -- 172.21.15.92:0/3377542216 learned_addr learned my addr 172.21.15.92:0/3377542216 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:30:44.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.430+0000 7f4358dd4700 1 -- 172.21.15.92:0/3377542216 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4348009420 con 0x7f435406b0c0 2023-09-29T23:30:44.433 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.430+0000 7f4358dd4700 1 --2- 172.21.15.92:0/3377542216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f435406b0c0 0x7f435412c4c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f43480091e0 tx=0x7f4348016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:30:44.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.430+0000 7f4350ff9700 1 -- 172.21.15.92:0/3377542216 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4348011cf0 con 0x7f435406b0c0 2023-09-29T23:30:44.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.430+0000 7f4350ff9700 1 -- 172.21.15.92:0/3377542216 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4348020070 con 0x7f435406b0c0 2023-09-29T23:30:44.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.430+0000 7f4359dd6700 1 -- 172.21.15.92:0/3377542216 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435411efc0 con 0x7f435406b0c0 2023-09-29T23:30:44.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.430+0000 7f4350ff9700 1 -- 172.21.15.92:0/3377542216 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f434801b450 con 0x7f435406b0c0 2023-09-29T23:30:44.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.430+0000 7f4359dd6700 1 -- 172.21.15.92:0/3377542216 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435411e5b0 con 0x7f435406b0c0 2023-09-29T23:30:44.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.431+0000 7f4350ff9700 1 -- 172.21.15.92:0/3377542216 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f4348022030 con 0x7f435406b0c0 2023-09-29T23:30:44.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.431+0000 7f4350ff9700 1 --2- 172.21.15.92:0/3377542216 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4338035630 0x7f4338037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:30:44.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.431+0000 7f4350ff9700 1 -- 172.21.15.92:0/3377542216 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f43480493f0 con 0x7f435406b0c0 2023-09-29T23:30:44.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.431+0000 7f4359dd6700 1 -- 172.21.15.92:0/3377542216 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435405f230 con 0x7f435406b0c0 2023-09-29T23:30:44.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.431+0000 7f4353fff700 1 --2- 172.21.15.92:0/3377542216 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4338035630 0x7f4338037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:30:44.434 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.431+0000 7f4353fff700 1 --2- 172.21.15.92:0/3377542216 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4338035630 0x7f4338037ae0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4340007fd0 tx=0x7f4340001250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:30:44.435 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.435+0000 7f4350ff9700 1 -- 172.21.15.92:0/3377542216 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f434801b680 con 0x7f435406b0c0 2023-09-29T23:30:44.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.615+0000 7f4359dd6700 1 -- 172.21.15.92:0/3377542216 --> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f435412f320 con 0x7f4338035630 2023-09-29T23:30:44.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.622+0000 7f4350ff9700 1 -- 172.21.15.92:0/3377542216 <== mgr.4101 v2:172.21.15.92:6824/85403 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+266632 (secure 0 0 0) 0x7f435412f320 con 0x7f4338035630 2023-09-29T23:30:44.625 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-09-29T23:30:44.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.625+0000 7f4359dd6700 1 -- 172.21.15.92:0/3377542216 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4338035630 msgr2=0x7f4338037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:30:44.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.625+0000 7f4359dd6700 1 --2- 172.21.15.92:0/3377542216 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4338035630 0x7f4338037ae0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4340007fd0 tx=0x7f4340001250 comp rx=0 tx=0).stop 2023-09-29T23:30:44.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.625+0000 7f4359dd6700 1 -- 172.21.15.92:0/3377542216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f435406b0c0 msgr2=0x7f435412c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:30:44.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.625+0000 7f4359dd6700 1 --2- 172.21.15.92:0/3377542216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f435406b0c0 0x7f435412c4c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f43480091e0 tx=0x7f4348016000 comp rx=0 tx=0).stop 2023-09-29T23:30:44.627 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.625+0000 7f4359dd6700 1 -- 172.21.15.92:0/3377542216 shutdown_connections 2023-09-29T23:30:44.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.625+0000 7f4359dd6700 1 --2- 172.21.15.92:0/3377542216 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f4338035630 0x7f4338037ae0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:30:44.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.625+0000 7f4359dd6700 1 --2- 172.21.15.92:0/3377542216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f435406b0c0 0x7f435412c4c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:30:44.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.625+0000 7f4359dd6700 1 -- 172.21.15.92:0/3377542216 >> 172.21.15.92:0/3377542216 conn(0x7f435406a5b0 msgr2=0x7f435412dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:30:44.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.625+0000 7f4359dd6700 1 -- 172.21.15.92:0/3377542216 shutdown_connections 2023-09-29T23:30:44.628 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.625+0000 7f4359dd6700 1 -- 172.21.15.92:0/3377542216 wait complete. 2023-09-29T23:30:44.628 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2023-09-29T23:30:44.636 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2023-09-29T23:30:44.134203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":208,"acting":208,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":16952,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":16384,"kb_avail":314555848,"statfs":{"total":322122547200,"available":322105188352,"internally_reserved":0,"allocated":557056,"data_stored":160657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16777216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003214"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:38.727593+0000","last_change":"2023-09-29T23:30:38.727564+0000","last_active":"2023-09-29T23:30:38.727593+0000","last_peered":"2023-09-29T23:30:38.727593+0000","last_clean":"2023-09-29T23:30:38.727593+0000","last_became_active":"2023-09-29T23:23:45.464271+0000","last_became_peered":"2023-09-29T23:23:45.464271+0000","last_unstale":"2023-09-29T23:30:38.727593+0000","last_undegraded":"2023-09-29T23:30:38.727593+0000","last_fullsized":"2023-09-29T23:30:38.727593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:38.727490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:38.727490+0000","last_clean_scrub_stamp":"2023-09-29T23:30:38.727490+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:39:19.233109+0000","scrub_duration":0.0012630639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:03.249509+0000","last_change":"2023-09-29T23:29:03.249480+0000","last_active":"2023-09-29T23:29:03.249509+0000","last_peered":"2023-09-29T23:29:03.249509+0000","last_clean":"2023-09-29T23:29:03.249509+0000","last_became_active":"2023-09-29T23:23:45.466338+0000","last_became_peered":"2023-09-29T23:23:45.466338+0000","last_unstale":"2023-09-29T23:29:03.249509+0000","last_undegraded":"2023-09-29T23:29:03.249509+0000","last_fullsized":"2023-09-29T23:29:03.249509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:03.249418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:03.249418+0000","last_clean_scrub_stamp":"2023-09-29T23:29:03.249418+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:59:00.108261+0000","scrub_duration":0.0011124380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:40.698550+0000","last_change":"2023-09-29T23:30:40.698503+0000","last_active":"2023-09-29T23:30:40.698550+0000","last_peered":"2023-09-29T23:30:40.698550+0000","last_clean":"2023-09-29T23:30:40.698550+0000","last_became_active":"2023-09-29T23:23:45.474129+0000","last_became_peered":"2023-09-29T23:23:45.474129+0000","last_unstale":"2023-09-29T23:30:40.698550+0000","last_undegraded":"2023-09-29T23:30:40.698550+0000","last_fullsized":"2023-09-29T23:30:40.698550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:40.698408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:40.698408+0000","last_clean_scrub_stamp":"2023-09-29T23:30:40.698408+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:25:06.528128+0000","scrub_duration":0.0014825210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:17.855334+0000","last_change":"2023-09-29T23:29:17.855305+0000","last_active":"2023-09-29T23:29:17.855334+0000","last_peered":"2023-09-29T23:29:17.855334+0000","last_clean":"2023-09-29T23:29:17.855334+0000","last_became_active":"2023-09-29T23:23:45.470971+0000","last_became_peered":"2023-09-29T23:23:45.470971+0000","last_unstale":"2023-09-29T23:29:17.855334+0000","last_undegraded":"2023-09-29T23:29:17.855334+0000","last_fullsized":"2023-09-29T23:29:17.855334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:17.855232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:17.855232+0000","last_clean_scrub_stamp":"2023-09-29T23:29:17.855232+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:07:36.954319+0000","scrub_duration":0.0012669980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:33.821293+0000","last_change":"2023-09-29T23:30:33.821261+0000","last_active":"2023-09-29T23:30:33.821293+0000","last_peered":"2023-09-29T23:30:33.821293+0000","last_clean":"2023-09-29T23:30:33.821293+0000","last_became_active":"2023-09-29T23:23:45.473570+0000","last_became_peered":"2023-09-29T23:23:45.473570+0000","last_unstale":"2023-09-29T23:30:33.821293+0000","last_undegraded":"2023-09-29T23:30:33.821293+0000","last_fullsized":"2023-09-29T23:30:33.821293+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:33.821189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:33.821189+0000","last_clean_scrub_stamp":"2023-09-29T23:30:33.821189+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:52:21.992401+0000","scrub_duration":0.001302594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:11.848798+0000","last_change":"2023-09-29T23:29:11.848767+0000","last_active":"2023-09-29T23:29:11.848798+0000","last_peered":"2023-09-29T23:29:11.848798+0000","last_clean":"2023-09-29T23:29:11.848798+0000","last_became_active":"2023-09-29T23:23:45.470349+0000","last_became_peered":"2023-09-29T23:23:45.470349+0000","last_unstale":"2023-09-29T23:29:11.848798+0000","last_undegraded":"2023-09-29T23:29:11.848798+0000","last_fullsized":"2023-09-29T23:29:11.848798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:11.848689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:11.848689+0000","last_clean_scrub_stamp":"2023-09-29T23:29:11.848689+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:18:31.778625+0000","scrub_duration":0.001396563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:30.748455+0000","last_change":"2023-09-29T23:30:30.748427+0000","last_active":"2023-09-29T23:30:30.748455+0000","last_peered":"2023-09-29T23:30:30.748455+0000","last_clean":"2023-09-29T23:30:30.748455+0000","last_became_active":"2023-09-29T23:23:45.464893+0000","last_became_peered":"2023-09-29T23:23:45.464893+0000","last_unstale":"2023-09-29T23:30:30.748455+0000","last_undegraded":"2023-09-29T23:30:30.748455+0000","last_fullsized":"2023-09-29T23:30:30.748455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:30.748350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:30.748350+0000","last_clean_scrub_stamp":"2023-09-29T23:30:30.748350+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:46:42.804584+0000","scrub_duration":0.001255789,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:14.185817+0000","last_change":"2023-09-29T23:30:14.185777+0000","last_active":"2023-09-29T23:30:14.185817+0000","last_peered":"2023-09-29T23:30:14.185817+0000","last_clean":"2023-09-29T23:30:14.185817+0000","last_became_active":"2023-09-29T23:23:45.462888+0000","last_became_peered":"2023-09-29T23:23:45.462888+0000","last_unstale":"2023-09-29T23:30:14.185817+0000","last_undegraded":"2023-09-29T23:30:14.185817+0000","last_fullsized":"2023-09-29T23:30:14.185817+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:14.185703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:14.185703+0000","last_clean_scrub_stamp":"2023-09-29T23:30:14.185703+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:12:29.673373+0000","scrub_duration":0.0012095039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:30.401783+0000","last_change":"2023-09-29T23:30:30.401736+0000","last_active":"2023-09-29T23:30:30.401783+0000","last_peered":"2023-09-29T23:30:30.401783+0000","last_clean":"2023-09-29T23:30:30.401783+0000","last_became_active":"2023-09-29T23:23:45.468303+0000","last_became_peered":"2023-09-29T23:23:45.468303+0000","last_unstale":"2023-09-29T23:30:30.401783+0000","last_undegraded":"2023-09-29T23:30:30.401783+0000","last_fullsized":"2023-09-29T23:30:30.401783+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:30.401659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:30.401659+0000","last_clean_scrub_stamp":"2023-09-29T23:30:30.401659+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:44:33.913382+0000","scrub_duration":0.0013483849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:31.390885+0000","last_change":"2023-09-29T23:30:31.390856+0000","last_active":"2023-09-29T23:30:31.390885+0000","last_peered":"2023-09-29T23:30:31.390885+0000","last_clean":"2023-09-29T23:30:31.390885+0000","last_became_active":"2023-09-29T23:24:37.285339+0000","last_became_peered":"2023-09-29T23:24:37.285339+0000","last_unstale":"2023-09-29T23:30:31.390885+0000","last_undegraded":"2023-09-29T23:30:31.390885+0000","last_fullsized":"2023-09-29T23:30:31.390885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:31.390780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:31.390780+0000","last_clean_scrub_stamp":"2023-09-29T23:30:31.390780+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:46:43.447013+0000","scrub_duration":0.001456134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:32.793147+0000","last_change":"2023-09-29T23:30:32.793120+0000","last_active":"2023-09-29T23:30:32.793147+0000","last_peered":"2023-09-29T23:30:32.793147+0000","last_clean":"2023-09-29T23:30:32.793147+0000","last_became_active":"2023-09-29T23:23:45.464083+0000","last_became_peered":"2023-09-29T23:23:45.464083+0000","last_unstale":"2023-09-29T23:30:32.793147+0000","last_undegraded":"2023-09-29T23:30:32.793147+0000","last_fullsized":"2023-09-29T23:30:32.793147+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:32.793040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:32.793040+0000","last_clean_scrub_stamp":"2023-09-29T23:30:32.793040+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:26:12.941346+0000","scrub_duration":0.0013791420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:29.738598+0000","last_change":"2023-09-29T23:30:29.738564+0000","last_active":"2023-09-29T23:30:29.738598+0000","last_peered":"2023-09-29T23:30:29.738598+0000","last_clean":"2023-09-29T23:30:29.738598+0000","last_became_active":"2023-09-29T23:23:45.466161+0000","last_became_peered":"2023-09-29T23:23:45.466161+0000","last_unstale":"2023-09-29T23:30:29.738598+0000","last_undegraded":"2023-09-29T23:30:29.738598+0000","last_fullsized":"2023-09-29T23:30:29.738598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:29.738459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:29.738459+0000","last_clean_scrub_stamp":"2023-09-29T23:30:29.738459+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:44:33.250182+0000","scrub_duration":0.001522891,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:04.477680+0000","last_change":"2023-09-29T23:29:04.477657+0000","last_active":"2023-09-29T23:29:04.477680+0000","last_peered":"2023-09-29T23:29:04.477680+0000","last_clean":"2023-09-29T23:29:04.477680+0000","last_became_active":"2023-09-29T23:23:45.467178+0000","last_became_peered":"2023-09-29T23:23:45.467178+0000","last_unstale":"2023-09-29T23:29:04.477680+0000","last_undegraded":"2023-09-29T23:29:04.477680+0000","last_fullsized":"2023-09-29T23:29:04.477680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:04.477596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:04.477596+0000","last_clean_scrub_stamp":"2023-09-29T23:29:04.477596+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:49.700926+0000","scrub_duration":0.001119543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:20.545759+0000","last_change":"2023-09-29T23:29:20.545730+0000","last_active":"2023-09-29T23:29:20.545759+0000","last_peered":"2023-09-29T23:29:20.545759+0000","last_clean":"2023-09-29T23:29:20.545759+0000","last_became_active":"2023-09-29T23:23:45.464523+0000","last_became_peered":"2023-09-29T23:23:45.464523+0000","last_unstale":"2023-09-29T23:29:20.545759+0000","last_undegraded":"2023-09-29T23:29:20.545759+0000","last_fullsized":"2023-09-29T23:29:20.545759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:20.545655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:20.545655+0000","last_clean_scrub_stamp":"2023-09-29T23:29:20.545655+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:33:27.694060+0000","scrub_duration":0.0013252279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:17.406630+0000","last_change":"2023-09-29T23:30:17.406596+0000","last_active":"2023-09-29T23:30:17.406630+0000","last_peered":"2023-09-29T23:30:17.406630+0000","last_clean":"2023-09-29T23:30:17.406630+0000","last_became_active":"2023-09-29T23:23:45.467004+0000","last_became_peered":"2023-09-29T23:23:45.467004+0000","last_unstale":"2023-09-29T23:30:17.406630+0000","last_undegraded":"2023-09-29T23:30:17.406630+0000","last_fullsized":"2023-09-29T23:30:17.406630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:17.406496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:17.406496+0000","last_clean_scrub_stamp":"2023-09-29T23:30:17.406496+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:14:55.441418+0000","scrub_duration":0.001404878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:11.232745+0000","last_change":"2023-09-29T23:30:11.232717+0000","last_active":"2023-09-29T23:30:11.232745+0000","last_peered":"2023-09-29T23:30:11.232745+0000","last_clean":"2023-09-29T23:30:11.232745+0000","last_became_active":"2023-09-29T23:23:45.471334+0000","last_became_peered":"2023-09-29T23:23:45.471334+0000","last_unstale":"2023-09-29T23:30:11.232745+0000","last_undegraded":"2023-09-29T23:30:11.232745+0000","last_fullsized":"2023-09-29T23:30:11.232745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:11.232638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:11.232638+0000","last_clean_scrub_stamp":"2023-09-29T23:30:11.232638+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:09:20.386800+0000","scrub_duration":0.001353686,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:43.304266+0000","last_change":"2023-09-29T23:29:43.304234+0000","last_active":"2023-09-29T23:29:43.304266+0000","last_peered":"2023-09-29T23:29:43.304266+0000","last_clean":"2023-09-29T23:29:43.304266+0000","last_became_active":"2023-09-29T23:23:45.468001+0000","last_became_peered":"2023-09-29T23:23:45.468001+0000","last_unstale":"2023-09-29T23:29:43.304266+0000","last_undegraded":"2023-09-29T23:29:43.304266+0000","last_fullsized":"2023-09-29T23:29:43.304266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:43.304142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:43.304142+0000","last_clean_scrub_stamp":"2023-09-29T23:29:43.304142+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:49:10.871636+0000","scrub_duration":0.001341552,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:08.209770+0000","last_change":"2023-09-29T23:30:08.209743+0000","last_active":"2023-09-29T23:30:08.209770+0000","last_peered":"2023-09-29T23:30:08.209770+0000","last_clean":"2023-09-29T23:30:08.209770+0000","last_became_active":"2023-09-29T23:23:45.467434+0000","last_became_peered":"2023-09-29T23:23:45.467434+0000","last_unstale":"2023-09-29T23:30:08.209770+0000","last_undegraded":"2023-09-29T23:30:08.209770+0000","last_fullsized":"2023-09-29T23:30:08.209770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:08.209667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:08.209667+0000","last_clean_scrub_stamp":"2023-09-29T23:30:08.209667+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:44:24.546919+0000","scrub_duration":0.001348896,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:24.675092+0000","last_change":"2023-09-29T23:30:24.675057+0000","last_active":"2023-09-29T23:30:24.675092+0000","last_peered":"2023-09-29T23:30:24.675092+0000","last_clean":"2023-09-29T23:30:24.675092+0000","last_became_active":"2023-09-29T23:23:45.473326+0000","last_became_peered":"2023-09-29T23:23:45.473326+0000","last_unstale":"2023-09-29T23:30:24.675092+0000","last_undegraded":"2023-09-29T23:30:24.675092+0000","last_fullsized":"2023-09-29T23:30:24.675092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:24.674987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:24.674987+0000","last_clean_scrub_stamp":"2023-09-29T23:30:24.674987+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:41:28.277368+0000","scrub_duration":0.001041688,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:02.476624+0000","last_change":"2023-09-29T23:29:02.476605+0000","last_active":"2023-09-29T23:29:02.476624+0000","last_peered":"2023-09-29T23:29:02.476624+0000","last_clean":"2023-09-29T23:29:02.476624+0000","last_became_active":"2023-09-29T23:23:45.467494+0000","last_became_peered":"2023-09-29T23:23:45.467494+0000","last_unstale":"2023-09-29T23:29:02.476624+0000","last_undegraded":"2023-09-29T23:29:02.476624+0000","last_fullsized":"2023-09-29T23:29:02.476624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:02.476541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:02.476541+0000","last_clean_scrub_stamp":"2023-09-29T23:29:02.476541+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:07:21.575629+0000","scrub_duration":0.0011731350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:06.426368+0000","last_change":"2023-09-29T23:29:06.426326+0000","last_active":"2023-09-29T23:29:06.426368+0000","last_peered":"2023-09-29T23:29:06.426368+0000","last_clean":"2023-09-29T23:29:06.426368+0000","last_became_active":"2023-09-29T23:23:45.477408+0000","last_became_peered":"2023-09-29T23:23:45.477408+0000","last_unstale":"2023-09-29T23:29:06.426368+0000","last_undegraded":"2023-09-29T23:29:06.426368+0000","last_fullsized":"2023-09-29T23:29:06.426368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:06.426255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:06.426255+0000","last_clean_scrub_stamp":"2023-09-29T23:29:06.426255+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:16:36.592771+0000","scrub_duration":0.001349893,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:25.396631+0000","last_change":"2023-09-29T23:30:25.396606+0000","last_active":"2023-09-29T23:30:25.396631+0000","last_peered":"2023-09-29T23:30:25.396631+0000","last_clean":"2023-09-29T23:30:25.396631+0000","last_became_active":"2023-09-29T23:23:45.470574+0000","last_became_peered":"2023-09-29T23:23:45.470574+0000","last_unstale":"2023-09-29T23:30:25.396631+0000","last_undegraded":"2023-09-29T23:30:25.396631+0000","last_fullsized":"2023-09-29T23:30:25.396631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:25.396535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:25.396535+0000","last_clean_scrub_stamp":"2023-09-29T23:30:25.396535+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:41:28.998915+0000","scrub_duration":0.0012433749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:07.470966+0000","last_change":"2023-09-29T23:29:07.470936+0000","last_active":"2023-09-29T23:29:07.470966+0000","last_peered":"2023-09-29T23:29:07.470966+0000","last_clean":"2023-09-29T23:29:07.470966+0000","last_became_active":"2023-09-29T23:23:45.473789+0000","last_became_peered":"2023-09-29T23:23:45.473789+0000","last_unstale":"2023-09-29T23:29:07.470966+0000","last_undegraded":"2023-09-29T23:29:07.470966+0000","last_fullsized":"2023-09-29T23:29:07.470966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:07.470870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:07.470870+0000","last_clean_scrub_stamp":"2023-09-29T23:29:07.470870+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:35:33.595449+0000","scrub_duration":0.0012289239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:03.460784+0000","last_change":"2023-09-29T23:29:03.460762+0000","last_active":"2023-09-29T23:29:03.460784+0000","last_peered":"2023-09-29T23:29:03.460784+0000","last_clean":"2023-09-29T23:29:03.460784+0000","last_became_active":"2023-09-29T23:23:45.465443+0000","last_became_peered":"2023-09-29T23:23:45.465443+0000","last_unstale":"2023-09-29T23:29:03.460784+0000","last_undegraded":"2023-09-29T23:29:03.460784+0000","last_fullsized":"2023-09-29T23:29:03.460784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:03.460703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:03.460703+0000","last_clean_scrub_stamp":"2023-09-29T23:29:03.460703+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:59:00.319545+0000","scrub_duration":0.00097215699999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:09.204485+0000","last_change":"2023-09-29T23:30:09.204454+0000","last_active":"2023-09-29T23:30:09.204485+0000","last_peered":"2023-09-29T23:30:09.204485+0000","last_clean":"2023-09-29T23:30:09.204485+0000","last_became_active":"2023-09-29T23:23:45.457799+0000","last_became_peered":"2023-09-29T23:23:45.457799+0000","last_unstale":"2023-09-29T23:30:09.204485+0000","last_undegraded":"2023-09-29T23:30:09.204485+0000","last_fullsized":"2023-09-29T23:30:09.204485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:09.204359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:09.204359+0000","last_clean_scrub_stamp":"2023-09-29T23:30:09.204359+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:50:01.010628+0000","scrub_duration":0.0012939049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:15.837977+0000","last_change":"2023-09-29T23:29:15.837942+0000","last_active":"2023-09-29T23:29:15.837977+0000","last_peered":"2023-09-29T23:29:15.837977+0000","last_clean":"2023-09-29T23:29:15.837977+0000","last_became_active":"2023-09-29T23:23:45.467730+0000","last_became_peered":"2023-09-29T23:23:45.467730+0000","last_unstale":"2023-09-29T23:29:15.837977+0000","last_undegraded":"2023-09-29T23:29:15.837977+0000","last_fullsized":"2023-09-29T23:29:15.837977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:15.837865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:15.837865+0000","last_clean_scrub_stamp":"2023-09-29T23:29:15.837865+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:04:13.297945+0000","scrub_duration":0.001397206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"16'1","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:06.283311+0000","last_change":"2023-09-29T23:29:06.283268+0000","last_active":"2023-09-29T23:29:06.283311+0000","last_peered":"2023-09-29T23:29:06.283311+0000","last_clean":"2023-09-29T23:29:06.283311+0000","last_became_active":"2023-09-29T23:23:45.075848+0000","last_became_peered":"2023-09-29T23:23:45.075848+0000","last_unstale":"2023-09-29T23:29:06.283311+0000","last_undegraded":"2023-09-29T23:29:06.283311+0000","last_fullsized":"2023-09-29T23:29:06.283311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'1","last_scrub_stamp":"2023-09-29T23:29:06.283188+0000","last_deep_scrub":"16'1","last_deep_scrub_stamp":"2023-09-29T23:29:06.283188+0000","last_clean_scrub_stamp":"2023-09-29T23:29:06.283188+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:16:36.449704+0000","scrub_duration":0.0013356450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:04.277638+0000","last_change":"2023-09-29T23:29:04.277614+0000","last_active":"2023-09-29T23:29:04.277638+0000","last_peered":"2023-09-29T23:29:04.277638+0000","last_clean":"2023-09-29T23:29:04.277638+0000","last_became_active":"2023-09-29T23:23:45.462155+0000","last_became_peered":"2023-09-29T23:23:45.462155+0000","last_unstale":"2023-09-29T23:29:04.277638+0000","last_undegraded":"2023-09-29T23:29:04.277638+0000","last_fullsized":"2023-09-29T23:29:04.277638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:04.277542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:04.277542+0000","last_clean_scrub_stamp":"2023-09-29T23:29:04.277542+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:49.500872+0000","scrub_duration":0.0010848310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:22.883137+0000","last_change":"2023-09-29T23:29:22.883103+0000","last_active":"2023-09-29T23:29:22.883137+0000","last_peered":"2023-09-29T23:29:22.883137+0000","last_clean":"2023-09-29T23:29:22.883137+0000","last_became_active":"2023-09-29T23:23:45.092273+0000","last_became_peered":"2023-09-29T23:23:45.092273+0000","last_unstale":"2023-09-29T23:29:22.883137+0000","last_undegraded":"2023-09-29T23:29:22.883137+0000","last_fullsized":"2023-09-29T23:29:22.883137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'1","last_scrub_stamp":"2023-09-29T23:29:22.883002+0000","last_deep_scrub":"16'1","last_deep_scrub_stamp":"2023-09-29T23:29:22.883002+0000","last_clean_scrub_stamp":"2023-09-29T23:29:22.883002+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:35:49.007581+0000","scrub_duration":0.001353417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:37.545175+0000","last_change":"2023-09-29T23:29:37.545146+0000","last_active":"2023-09-29T23:29:37.545175+0000","last_peered":"2023-09-29T23:29:37.545175+0000","last_clean":"2023-09-29T23:29:37.545175+0000","last_became_active":"2023-09-29T23:23:45.464027+0000","last_became_peered":"2023-09-29T23:23:45.464027+0000","last_unstale":"2023-09-29T23:29:37.545175+0000","last_undegraded":"2023-09-29T23:29:37.545175+0000","last_fullsized":"2023-09-29T23:29:37.545175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:37.545065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:37.545065+0000","last_clean_scrub_stamp":"2023-09-29T23:29:37.545065+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:31:27.151684+0000","scrub_duration":0.001339413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:42.453564+0000","last_change":"2023-09-29T23:29:42.453521+0000","last_active":"2023-09-29T23:29:42.453564+0000","last_peered":"2023-09-29T23:29:42.453564+0000","last_clean":"2023-09-29T23:29:42.453564+0000","last_became_active":"2023-09-29T23:23:45.088405+0000","last_became_peered":"2023-09-29T23:23:45.088405+0000","last_unstale":"2023-09-29T23:29:42.453564+0000","last_undegraded":"2023-09-29T23:29:42.453564+0000","last_fullsized":"2023-09-29T23:29:42.453564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:42.453441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:42.453441+0000","last_clean_scrub_stamp":"2023-09-29T23:29:42.453441+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:49:10.020935+0000","scrub_duration":0.001281113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:18.842822+0000","last_change":"2023-09-29T23:29:18.842794+0000","last_active":"2023-09-29T23:29:18.842822+0000","last_peered":"2023-09-29T23:29:18.842822+0000","last_clean":"2023-09-29T23:29:18.842822+0000","last_became_active":"2023-09-29T23:23:45.470917+0000","last_became_peered":"2023-09-29T23:23:45.470917+0000","last_unstale":"2023-09-29T23:29:18.842822+0000","last_undegraded":"2023-09-29T23:29:18.842822+0000","last_fullsized":"2023-09-29T23:29:18.842822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:18.842718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:18.842718+0000","last_clean_scrub_stamp":"2023-09-29T23:29:18.842718+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:59:15.701560+0000","scrub_duration":0.0012829569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:54.488388+0000","last_change":"2023-09-29T23:29:54.488362+0000","last_active":"2023-09-29T23:29:54.488388+0000","last_peered":"2023-09-29T23:29:54.488388+0000","last_clean":"2023-09-29T23:29:54.488388+0000","last_became_active":"2023-09-29T23:23:45.070610+0000","last_became_peered":"2023-09-29T23:23:45.070610+0000","last_unstale":"2023-09-29T23:29:54.488388+0000","last_undegraded":"2023-09-29T23:29:54.488388+0000","last_fullsized":"2023-09-29T23:29:54.488388+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:54.488296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:54.488296+0000","last_clean_scrub_stamp":"2023-09-29T23:29:54.488296+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:49:46.294564+0000","scrub_duration":0.0011955780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:32.058629+0000","last_change":"2023-09-29T23:29:32.058597+0000","last_active":"2023-09-29T23:29:32.058629+0000","last_peered":"2023-09-29T23:29:32.058629+0000","last_clean":"2023-09-29T23:29:32.058629+0000","last_became_active":"2023-09-29T23:23:45.475634+0000","last_became_peered":"2023-09-29T23:23:45.475634+0000","last_unstale":"2023-09-29T23:29:32.058629+0000","last_undegraded":"2023-09-29T23:29:32.058629+0000","last_fullsized":"2023-09-29T23:29:32.058629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:32.058524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:32.058524+0000","last_clean_scrub_stamp":"2023-09-29T23:29:32.058524+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:28:19.384325+0000","scrub_duration":0.0012732959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:16.093276+0000","last_change":"2023-09-29T23:29:16.093250+0000","last_active":"2023-09-29T23:29:16.093276+0000","last_peered":"2023-09-29T23:29:16.093276+0000","last_clean":"2023-09-29T23:29:16.093276+0000","last_became_active":"2023-09-29T23:23:45.091317+0000","last_became_peered":"2023-09-29T23:23:45.091317+0000","last_unstale":"2023-09-29T23:29:16.093276+0000","last_undegraded":"2023-09-29T23:29:16.093276+0000","last_fullsized":"2023-09-29T23:29:16.093276+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:16.093182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:16.093182+0000","last_clean_scrub_stamp":"2023-09-29T23:29:16.093182+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:31:53.593525+0000","scrub_duration":0.001347411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:36.981638+0000","last_change":"2023-09-29T23:29:36.981613+0000","last_active":"2023-09-29T23:29:36.981638+0000","last_peered":"2023-09-29T23:29:36.981638+0000","last_clean":"2023-09-29T23:29:36.981638+0000","last_became_active":"2023-09-29T23:23:45.458585+0000","last_became_peered":"2023-09-29T23:23:45.458585+0000","last_unstale":"2023-09-29T23:29:36.981638+0000","last_undegraded":"2023-09-29T23:29:36.981638+0000","last_fullsized":"2023-09-29T23:29:36.981638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:36.981533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:36.981533+0000","last_clean_scrub_stamp":"2023-09-29T23:29:36.981533+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:12:03.229046+0000","scrub_duration":0.001333363,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:09.628659+0000","last_change":"2023-09-29T23:30:09.628630+0000","last_active":"2023-09-29T23:30:09.628659+0000","last_peered":"2023-09-29T23:30:09.628659+0000","last_clean":"2023-09-29T23:30:09.628659+0000","last_became_active":"2023-09-29T23:23:45.070986+0000","last_became_peered":"2023-09-29T23:23:45.070986+0000","last_unstale":"2023-09-29T23:30:09.628659+0000","last_undegraded":"2023-09-29T23:30:09.628659+0000","last_fullsized":"2023-09-29T23:30:09.628659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:09.628551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:09.628551+0000","last_clean_scrub_stamp":"2023-09-29T23:30:09.628551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:45:41.129348+0000","scrub_duration":0.0012872210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:51.461303+0000","last_change":"2023-09-29T23:29:51.461276+0000","last_active":"2023-09-29T23:29:51.461303+0000","last_peered":"2023-09-29T23:29:51.461303+0000","last_clean":"2023-09-29T23:29:51.461303+0000","last_became_active":"2023-09-29T23:23:45.464510+0000","last_became_peered":"2023-09-29T23:23:45.464510+0000","last_unstale":"2023-09-29T23:29:51.461303+0000","last_undegraded":"2023-09-29T23:29:51.461303+0000","last_fullsized":"2023-09-29T23:29:51.461303+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:51.461193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:51.461193+0000","last_clean_scrub_stamp":"2023-09-29T23:29:51.461193+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:18:41.728129+0000","scrub_duration":0.0013191209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'5","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:20.978198+0000","last_change":"2023-09-29T23:29:20.978161+0000","last_active":"2023-09-29T23:29:20.978198+0000","last_peered":"2023-09-29T23:29:20.978198+0000","last_clean":"2023-09-29T23:29:20.978198+0000","last_became_active":"2023-09-29T23:23:45.076856+0000","last_became_peered":"2023-09-29T23:23:45.076856+0000","last_unstale":"2023-09-29T23:29:20.978198+0000","last_undegraded":"2023-09-29T23:29:20.978198+0000","last_fullsized":"2023-09-29T23:29:20.978198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5","last_scrub_stamp":"2023-09-29T23:29:20.978063+0000","last_deep_scrub":"19'5","last_deep_scrub_stamp":"2023-09-29T23:29:20.978063+0000","last_clean_scrub_stamp":"2023-09-29T23:29:20.978063+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:43:25.681012+0000","scrub_duration":0.002692945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:22.024275+0000","last_change":"2023-09-29T23:29:22.024242+0000","last_active":"2023-09-29T23:29:22.024275+0000","last_peered":"2023-09-29T23:29:22.024275+0000","last_clean":"2023-09-29T23:29:22.024275+0000","last_became_active":"2023-09-29T23:23:45.461199+0000","last_became_peered":"2023-09-29T23:23:45.461199+0000","last_unstale":"2023-09-29T23:29:22.024275+0000","last_undegraded":"2023-09-29T23:29:22.024275+0000","last_fullsized":"2023-09-29T23:29:22.024275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:22.024151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:22.024151+0000","last_clean_scrub_stamp":"2023-09-29T23:29:22.024151+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:13:23.585922+0000","scrub_duration":0.001280705,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"19'10","reported_seq":33,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:35.954350+0000","last_change":"2023-09-29T23:29:35.954319+0000","last_active":"2023-09-29T23:29:35.954350+0000","last_peered":"2023-09-29T23:29:35.954350+0000","last_clean":"2023-09-29T23:29:35.954350+0000","last_became_active":"2023-09-29T23:23:45.093487+0000","last_became_peered":"2023-09-29T23:23:45.093487+0000","last_unstale":"2023-09-29T23:29:35.954350+0000","last_undegraded":"2023-09-29T23:29:35.954350+0000","last_fullsized":"2023-09-29T23:29:35.954350+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'10","last_scrub_stamp":"2023-09-29T23:29:35.954248+0000","last_deep_scrub":"19'10","last_deep_scrub_stamp":"2023-09-29T23:29:35.954248+0000","last_clean_scrub_stamp":"2023-09-29T23:29:35.954248+0000","objects_scrubbed":4,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:33:43.102652+0000","scrub_duration":0.0072578629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:32.588353+0000","last_change":"2023-09-29T23:29:32.588319+0000","last_active":"2023-09-29T23:29:32.588353+0000","last_peered":"2023-09-29T23:29:32.588353+0000","last_clean":"2023-09-29T23:29:32.588353+0000","last_became_active":"2023-09-29T23:23:45.466667+0000","last_became_peered":"2023-09-29T23:23:45.466667+0000","last_unstale":"2023-09-29T23:29:32.588353+0000","last_undegraded":"2023-09-29T23:29:32.588353+0000","last_fullsized":"2023-09-29T23:29:32.588353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:32.588241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:32.588241+0000","last_clean_scrub_stamp":"2023-09-29T23:29:32.588241+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:40:31.970519+0000","scrub_duration":0.001381953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'4","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:12.643299+0000","last_change":"2023-09-29T23:30:12.643251+0000","last_active":"2023-09-29T23:30:12.643299+0000","last_peered":"2023-09-29T23:30:12.643299+0000","last_clean":"2023-09-29T23:30:12.643299+0000","last_became_active":"2023-09-29T23:23:45.089450+0000","last_became_peered":"2023-09-29T23:23:45.089450+0000","last_unstale":"2023-09-29T23:30:12.643299+0000","last_undegraded":"2023-09-29T23:30:12.643299+0000","last_fullsized":"2023-09-29T23:30:12.643299+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4","last_scrub_stamp":"2023-09-29T23:30:12.643173+0000","last_deep_scrub":"19'4","last_deep_scrub_stamp":"2023-09-29T23:30:12.643173+0000","last_clean_scrub_stamp":"2023-09-29T23:30:12.643173+0000","objects_scrubbed":2,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:32:21.187703+0000","scrub_duration":0.00355631,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:43.493923+0000","last_change":"2023-09-29T23:29:43.493902+0000","last_active":"2023-09-29T23:29:43.493923+0000","last_peered":"2023-09-29T23:29:43.493923+0000","last_clean":"2023-09-29T23:29:43.493923+0000","last_became_active":"2023-09-29T23:23:45.464801+0000","last_became_peered":"2023-09-29T23:23:45.464801+0000","last_unstale":"2023-09-29T23:29:43.493923+0000","last_undegraded":"2023-09-29T23:29:43.493923+0000","last_fullsized":"2023-09-29T23:29:43.493923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:43.493841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:43.493841+0000","last_clean_scrub_stamp":"2023-09-29T23:29:43.493841+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:38:16.507037+0000","scrub_duration":0.0010336309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:37.951615+0000","last_change":"2023-09-29T23:29:37.951590+0000","last_active":"2023-09-29T23:29:37.951615+0000","last_peered":"2023-09-29T23:29:37.951615+0000","last_clean":"2023-09-29T23:29:37.951615+0000","last_became_active":"2023-09-29T23:23:45.092902+0000","last_became_peered":"2023-09-29T23:23:45.092902+0000","last_unstale":"2023-09-29T23:29:37.951615+0000","last_undegraded":"2023-09-29T23:29:37.951615+0000","last_fullsized":"2023-09-29T23:29:37.951615+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:37.951522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:37.951522+0000","last_clean_scrub_stamp":"2023-09-29T23:29:37.951522+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:13:39.513294+0000","scrub_duration":0.0012267249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:30.055361+0000","last_change":"2023-09-29T23:29:30.055315+0000","last_active":"2023-09-29T23:29:30.055361+0000","last_peered":"2023-09-29T23:29:30.055361+0000","last_clean":"2023-09-29T23:29:30.055361+0000","last_became_active":"2023-09-29T23:23:45.465743+0000","last_became_peered":"2023-09-29T23:23:45.465743+0000","last_unstale":"2023-09-29T23:29:30.055361+0000","last_undegraded":"2023-09-29T23:29:30.055361+0000","last_fullsized":"2023-09-29T23:29:30.055361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:30.055241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:30.055241+0000","last_clean_scrub_stamp":"2023-09-29T23:29:30.055241+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:37:44.486033+0000","scrub_duration":0.001322852,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:14.693189+0000","last_change":"2023-09-29T23:30:14.693163+0000","last_active":"2023-09-29T23:30:14.693189+0000","last_peered":"2023-09-29T23:30:14.693189+0000","last_clean":"2023-09-29T23:30:14.693189+0000","last_became_active":"2023-09-29T23:23:45.072009+0000","last_became_peered":"2023-09-29T23:23:45.072009+0000","last_unstale":"2023-09-29T23:30:14.693189+0000","last_undegraded":"2023-09-29T23:30:14.693189+0000","last_fullsized":"2023-09-29T23:30:14.693189+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:14.693093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:14.693093+0000","last_clean_scrub_stamp":"2023-09-29T23:30:14.693093+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:09:42.785167+0000","scrub_duration":0.0012283400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:36.169278+0000","last_change":"2023-09-29T23:29:36.169248+0000","last_active":"2023-09-29T23:29:36.169278+0000","last_peered":"2023-09-29T23:29:36.169278+0000","last_clean":"2023-09-29T23:29:36.169278+0000","last_became_active":"2023-09-29T23:23:45.466169+0000","last_became_peered":"2023-09-29T23:23:45.466169+0000","last_unstale":"2023-09-29T23:29:36.169278+0000","last_undegraded":"2023-09-29T23:29:36.169278+0000","last_fullsized":"2023-09-29T23:29:36.169278+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:36.169178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:36.169178+0000","last_clean_scrub_stamp":"2023-09-29T23:29:36.169178+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:19:28.821242+0000","scrub_duration":0.001334238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'12","reported_seq":35,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:53.088645+0000","last_change":"2023-09-29T23:29:53.088595+0000","last_active":"2023-09-29T23:29:53.088645+0000","last_peered":"2023-09-29T23:29:53.088645+0000","last_clean":"2023-09-29T23:29:53.088645+0000","last_became_active":"2023-09-29T23:23:45.091386+0000","last_became_peered":"2023-09-29T23:23:45.091386+0000","last_unstale":"2023-09-29T23:29:53.088645+0000","last_undegraded":"2023-09-29T23:29:53.088645+0000","last_fullsized":"2023-09-29T23:29:53.088645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'12","last_scrub_stamp":"2023-09-29T23:29:53.088511+0000","last_deep_scrub":"19'12","last_deep_scrub_stamp":"2023-09-29T23:29:53.088511+0000","last_clean_scrub_stamp":"2023-09-29T23:29:53.088511+0000","objects_scrubbed":4,"log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:23:52.888979+0000","scrub_duration":0.0038113370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:05.861334+0000","last_change":"2023-09-29T23:29:05.861311+0000","last_active":"2023-09-29T23:29:05.861334+0000","last_peered":"2023-09-29T23:29:05.861334+0000","last_clean":"2023-09-29T23:29:05.861334+0000","last_became_active":"2023-09-29T23:23:45.460643+0000","last_became_peered":"2023-09-29T23:23:45.460643+0000","last_unstale":"2023-09-29T23:29:05.861334+0000","last_undegraded":"2023-09-29T23:29:05.861334+0000","last_fullsized":"2023-09-29T23:29:05.861334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:05.861236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:05.861236+0000","last_clean_scrub_stamp":"2023-09-29T23:29:05.861236+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:01:12.962284+0000","scrub_duration":0.0013132969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"19'2","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:49.521484+0000","last_change":"2023-09-29T23:29:49.521453+0000","last_active":"2023-09-29T23:29:49.521484+0000","last_peered":"2023-09-29T23:29:49.521484+0000","last_clean":"2023-09-29T23:29:49.521484+0000","last_became_active":"2023-09-29T23:23:45.077734+0000","last_became_peered":"2023-09-29T23:23:45.077734+0000","last_unstale":"2023-09-29T23:29:49.521484+0000","last_undegraded":"2023-09-29T23:29:49.521484+0000","last_fullsized":"2023-09-29T23:29:49.521484+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2023-09-29T23:29:49.521380+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2023-09-29T23:29:49.521380+0000","last_clean_scrub_stamp":"2023-09-29T23:29:49.521380+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:55:51.218343+0000","scrub_duration":0.0024495670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:21.923919+0000","last_change":"2023-09-29T23:29:21.923888+0000","last_active":"2023-09-29T23:29:21.923919+0000","last_peered":"2023-09-29T23:29:21.923919+0000","last_clean":"2023-09-29T23:29:21.923919+0000","last_became_active":"2023-09-29T23:23:45.467555+0000","last_became_peered":"2023-09-29T23:23:45.467555+0000","last_unstale":"2023-09-29T23:29:21.923919+0000","last_undegraded":"2023-09-29T23:29:21.923919+0000","last_fullsized":"2023-09-29T23:29:21.923919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:21.923791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:21.923791+0000","last_clean_scrub_stamp":"2023-09-29T23:29:21.923791+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:16:52.090307+0000","scrub_duration":0.0011468419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'3","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:48.985616+0000","last_change":"2023-09-29T23:29:48.985585+0000","last_active":"2023-09-29T23:29:48.985616+0000","last_peered":"2023-09-29T23:29:48.985616+0000","last_clean":"2023-09-29T23:29:48.985616+0000","last_became_active":"2023-09-29T23:23:45.092185+0000","last_became_peered":"2023-09-29T23:23:45.092185+0000","last_unstale":"2023-09-29T23:29:48.985616+0000","last_undegraded":"2023-09-29T23:29:48.985616+0000","last_fullsized":"2023-09-29T23:29:48.985616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2023-09-29T23:29:48.985514+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2023-09-29T23:29:48.985514+0000","last_clean_scrub_stamp":"2023-09-29T23:29:48.985514+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:40:48.367793+0000","scrub_duration":0.0024199220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:30.603213+0000","last_change":"2023-09-29T23:29:30.603186+0000","last_active":"2023-09-29T23:29:30.603213+0000","last_peered":"2023-09-29T23:29:30.603213+0000","last_clean":"2023-09-29T23:29:30.603213+0000","last_became_active":"2023-09-29T23:23:45.463806+0000","last_became_peered":"2023-09-29T23:23:45.463806+0000","last_unstale":"2023-09-29T23:29:30.603213+0000","last_undegraded":"2023-09-29T23:29:30.603213+0000","last_fullsized":"2023-09-29T23:29:30.603213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:30.603106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:30.603106+0000","last_clean_scrub_stamp":"2023-09-29T23:29:30.603106+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:58:06.609302+0000","scrub_duration":0.001486621,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'2","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:25.020656+0000","last_change":"2023-09-29T23:29:25.020628+0000","last_active":"2023-09-29T23:29:25.020656+0000","last_peered":"2023-09-29T23:29:25.020656+0000","last_clean":"2023-09-29T23:29:25.020656+0000","last_became_active":"2023-09-29T23:23:45.088535+0000","last_became_peered":"2023-09-29T23:23:45.088535+0000","last_unstale":"2023-09-29T23:29:25.020656+0000","last_undegraded":"2023-09-29T23:29:25.020656+0000","last_fullsized":"2023-09-29T23:29:25.020656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2023-09-29T23:29:25.020562+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2023-09-29T23:29:25.020562+0000","last_clean_scrub_stamp":"2023-09-29T23:29:25.020562+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:48:08.201258+0000","scrub_duration":0.0023368690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:22.533037+0000","last_change":"2023-09-29T23:29:22.533013+0000","last_active":"2023-09-29T23:29:22.533037+0000","last_peered":"2023-09-29T23:29:22.533037+0000","last_clean":"2023-09-29T23:29:22.533037+0000","last_became_active":"2023-09-29T23:23:45.465855+0000","last_became_peered":"2023-09-29T23:23:45.465855+0000","last_unstale":"2023-09-29T23:29:22.533037+0000","last_undegraded":"2023-09-29T23:29:22.533037+0000","last_fullsized":"2023-09-29T23:29:22.533037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:22.532933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:22.532933+0000","last_clean_scrub_stamp":"2023-09-29T23:29:22.532933+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:13:24.094704+0000","scrub_duration":0.001327693,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:49.992317+0000","last_change":"2023-09-29T23:29:49.992287+0000","last_active":"2023-09-29T23:29:49.992317+0000","last_peered":"2023-09-29T23:29:49.992317+0000","last_clean":"2023-09-29T23:29:49.992317+0000","last_became_active":"2023-09-29T23:23:45.092476+0000","last_became_peered":"2023-09-29T23:23:45.092476+0000","last_unstale":"2023-09-29T23:29:49.992317+0000","last_undegraded":"2023-09-29T23:29:49.992317+0000","last_fullsized":"2023-09-29T23:29:49.992317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:49.992215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:49.992215+0000","last_clean_scrub_stamp":"2023-09-29T23:29:49.992215+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:55:16.062531+0000","scrub_duration":0.0012909480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:22.330820+0000","last_change":"2023-09-29T23:30:22.330792+0000","last_active":"2023-09-29T23:30:22.330820+0000","last_peered":"2023-09-29T23:30:22.330820+0000","last_clean":"2023-09-29T23:30:22.330820+0000","last_became_active":"2023-09-29T23:23:45.466694+0000","last_became_peered":"2023-09-29T23:23:45.466694+0000","last_unstale":"2023-09-29T23:30:22.330820+0000","last_undegraded":"2023-09-29T23:30:22.330820+0000","last_fullsized":"2023-09-29T23:30:22.330820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:22.330723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:22.330723+0000","last_clean_scrub_stamp":"2023-09-29T23:30:22.330723+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:04:31.041259+0000","scrub_duration":0.0012801990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"19'3","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:16.689060+0000","last_change":"2023-09-29T23:30:16.689030+0000","last_active":"2023-09-29T23:30:16.689060+0000","last_peered":"2023-09-29T23:30:16.689060+0000","last_clean":"2023-09-29T23:30:16.689060+0000","last_became_active":"2023-09-29T23:23:45.089176+0000","last_became_peered":"2023-09-29T23:23:45.089176+0000","last_unstale":"2023-09-29T23:30:16.689060+0000","last_undegraded":"2023-09-29T23:30:16.689060+0000","last_fullsized":"2023-09-29T23:30:16.689060+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2023-09-29T23:30:16.688946+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2023-09-29T23:30:16.688946+0000","last_clean_scrub_stamp":"2023-09-29T23:30:16.688946+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T00:14:54.723869+0000","scrub_duration":0.0024773629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:27.538075+0000","last_change":"2023-09-29T23:29:27.538029+0000","last_active":"2023-09-29T23:29:27.538075+0000","last_peered":"2023-09-29T23:29:27.538075+0000","last_clean":"2023-09-29T23:29:27.538075+0000","last_became_active":"2023-09-29T23:23:45.465127+0000","last_became_peered":"2023-09-29T23:23:45.465127+0000","last_unstale":"2023-09-29T23:29:27.538075+0000","last_undegraded":"2023-09-29T23:29:27.538075+0000","last_fullsized":"2023-09-29T23:29:27.538075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:27.537939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:27.537939+0000","last_clean_scrub_stamp":"2023-09-29T23:29:27.537939+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:00:35.594777+0000","scrub_duration":0.00147858,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:31.072328+0000","last_change":"2023-09-29T23:29:31.072300+0000","last_active":"2023-09-29T23:29:31.072328+0000","last_peered":"2023-09-29T23:29:31.072328+0000","last_clean":"2023-09-29T23:29:31.072328+0000","last_became_active":"2023-09-29T23:23:45.075313+0000","last_became_peered":"2023-09-29T23:23:45.075313+0000","last_unstale":"2023-09-29T23:29:31.072328+0000","last_undegraded":"2023-09-29T23:29:31.072328+0000","last_fullsized":"2023-09-29T23:29:31.072328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:31.072231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:31.072231+0000","last_clean_scrub_stamp":"2023-09-29T23:29:31.072231+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:58:07.078428+0000","scrub_duration":0.001297475,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:20.010506+0000","last_change":"2023-09-29T23:29:20.010458+0000","last_active":"2023-09-29T23:29:20.010506+0000","last_peered":"2023-09-29T23:29:20.010506+0000","last_clean":"2023-09-29T23:29:20.010506+0000","last_became_active":"2023-09-29T23:24:37.288220+0000","last_became_peered":"2023-09-29T23:24:37.288220+0000","last_unstale":"2023-09-29T23:29:20.010506+0000","last_undegraded":"2023-09-29T23:29:20.010506+0000","last_fullsized":"2023-09-29T23:29:20.010506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:20.010379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:20.010379+0000","last_clean_scrub_stamp":"2023-09-29T23:29:20.010379+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:33:27.158783+0000","scrub_duration":0.0012507110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:34.135079+0000","last_change":"2023-09-29T23:29:34.135052+0000","last_active":"2023-09-29T23:29:34.135079+0000","last_peered":"2023-09-29T23:29:34.135079+0000","last_clean":"2023-09-29T23:29:34.135079+0000","last_became_active":"2023-09-29T23:23:45.075772+0000","last_became_peered":"2023-09-29T23:23:45.075772+0000","last_unstale":"2023-09-29T23:29:34.135079+0000","last_undegraded":"2023-09-29T23:29:34.135079+0000","last_fullsized":"2023-09-29T23:29:34.135079+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:34.134977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:34.134977+0000","last_clean_scrub_stamp":"2023-09-29T23:29:34.134977+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:55:00.205293+0000","scrub_duration":0.0011951520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:10.225499+0000","last_change":"2023-09-29T23:30:10.225458+0000","last_active":"2023-09-29T23:30:10.225499+0000","last_peered":"2023-09-29T23:30:10.225499+0000","last_clean":"2023-09-29T23:30:10.225499+0000","last_became_active":"2023-09-29T23:23:45.462583+0000","last_became_peered":"2023-09-29T23:23:45.462583+0000","last_unstale":"2023-09-29T23:30:10.225499+0000","last_undegraded":"2023-09-29T23:30:10.225499+0000","last_fullsized":"2023-09-29T23:30:10.225499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:10.225384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:10.225384+0000","last_clean_scrub_stamp":"2023-09-29T23:30:10.225384+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:47:22.711647+0000","scrub_duration":0.0012512929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:06.538053+0000","last_change":"2023-09-29T23:30:06.538019+0000","last_active":"2023-09-29T23:30:06.538053+0000","last_peered":"2023-09-29T23:30:06.538053+0000","last_clean":"2023-09-29T23:30:06.538053+0000","last_became_active":"2023-09-29T23:23:45.088506+0000","last_became_peered":"2023-09-29T23:23:45.088506+0000","last_unstale":"2023-09-29T23:30:06.538053+0000","last_undegraded":"2023-09-29T23:30:06.538053+0000","last_fullsized":"2023-09-29T23:30:06.538053+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:06.537917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:06.537917+0000","last_clean_scrub_stamp":"2023-09-29T23:30:06.537917+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:08:43.654885+0000","scrub_duration":0.001427242,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:25.556018+0000","last_change":"2023-09-29T23:29:25.555980+0000","last_active":"2023-09-29T23:29:25.556018+0000","last_peered":"2023-09-29T23:29:25.556018+0000","last_clean":"2023-09-29T23:29:25.556018+0000","last_became_active":"2023-09-29T23:23:45.477335+0000","last_became_peered":"2023-09-29T23:23:45.477335+0000","last_unstale":"2023-09-29T23:29:25.556018+0000","last_undegraded":"2023-09-29T23:29:25.556018+0000","last_fullsized":"2023-09-29T23:29:25.556018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:25.555859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:25.555859+0000","last_clean_scrub_stamp":"2023-09-29T23:29:25.555859+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:48:08.736556+0000","scrub_duration":0.001410761,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:44.036092+0000","last_change":"2023-09-29T23:29:44.036057+0000","last_active":"2023-09-29T23:29:44.036092+0000","last_peered":"2023-09-29T23:29:44.036092+0000","last_clean":"2023-09-29T23:29:44.036092+0000","last_became_active":"2023-09-29T23:23:41.047701+0000","last_became_peered":"2023-09-29T23:23:41.047701+0000","last_unstale":"2023-09-29T23:29:44.036092+0000","last_undegraded":"2023-09-29T23:29:44.036092+0000","last_fullsized":"2023-09-29T23:29:44.036092+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:44.035955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:44.035955+0000","last_clean_scrub_stamp":"2023-09-29T23:29:44.035955+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:00:52.092793+0000","scrub_duration":0.0012373569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"19'2","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:38.169235+0000","last_change":"2023-09-29T23:29:38.169200+0000","last_active":"2023-09-29T23:29:38.169235+0000","last_peered":"2023-09-29T23:29:38.169235+0000","last_clean":"2023-09-29T23:29:38.169235+0000","last_became_active":"2023-09-29T23:23:45.075249+0000","last_became_peered":"2023-09-29T23:23:45.075249+0000","last_unstale":"2023-09-29T23:29:38.169235+0000","last_undegraded":"2023-09-29T23:29:38.169235+0000","last_fullsized":"2023-09-29T23:29:38.169235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2023-09-29T23:29:38.169127+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2023-09-29T23:29:38.169127+0000","last_clean_scrub_stamp":"2023-09-29T23:29:38.169127+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:31:27.775746+0000","scrub_duration":0.0022639449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:57.160844+0000","last_change":"2023-09-29T23:29:57.160818+0000","last_active":"2023-09-29T23:29:57.160844+0000","last_peered":"2023-09-29T23:29:57.160844+0000","last_clean":"2023-09-29T23:29:57.160844+0000","last_became_active":"2023-09-29T23:23:45.459933+0000","last_became_peered":"2023-09-29T23:23:45.459933+0000","last_unstale":"2023-09-29T23:29:57.160844+0000","last_undegraded":"2023-09-29T23:29:57.160844+0000","last_fullsized":"2023-09-29T23:29:57.160844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:57.160742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:57.160742+0000","last_clean_scrub_stamp":"2023-09-29T23:29:57.160742+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:49:24.728236+0000","scrub_duration":0.00150358,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:58.280783+0000","last_change":"2023-09-29T23:29:58.280753+0000","last_active":"2023-09-29T23:29:58.280783+0000","last_peered":"2023-09-29T23:29:58.280783+0000","last_clean":"2023-09-29T23:29:58.280783+0000","last_became_active":"2023-09-29T23:23:41.051398+0000","last_became_peered":"2023-09-29T23:23:41.051398+0000","last_unstale":"2023-09-29T23:29:58.280783+0000","last_undegraded":"2023-09-29T23:29:58.280783+0000","last_fullsized":"2023-09-29T23:29:58.280783+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:58.280681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:58.280681+0000","last_clean_scrub_stamp":"2023-09-29T23:29:58.280681+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:09:07.434844+0000","scrub_duration":0.0012573930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"19'3","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:44.269068+0000","last_change":"2023-09-29T23:29:44.269039+0000","last_active":"2023-09-29T23:29:44.269068+0000","last_peered":"2023-09-29T23:29:44.269068+0000","last_clean":"2023-09-29T23:29:44.269068+0000","last_became_active":"2023-09-29T23:23:45.076293+0000","last_became_peered":"2023-09-29T23:23:45.076293+0000","last_unstale":"2023-09-29T23:29:44.269068+0000","last_undegraded":"2023-09-29T23:29:44.269068+0000","last_fullsized":"2023-09-29T23:29:44.269068+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2023-09-29T23:29:44.268975+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2023-09-29T23:29:44.268975+0000","last_clean_scrub_stamp":"2023-09-29T23:29:44.268975+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:38:17.282170+0000","scrub_duration":0.001934049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:29.587702+0000","last_change":"2023-09-29T23:29:29.587659+0000","last_active":"2023-09-29T23:29:29.587702+0000","last_peered":"2023-09-29T23:29:29.587702+0000","last_clean":"2023-09-29T23:29:29.587702+0000","last_became_active":"2023-09-29T23:23:45.466115+0000","last_became_peered":"2023-09-29T23:23:45.466115+0000","last_unstale":"2023-09-29T23:29:29.587702+0000","last_undegraded":"2023-09-29T23:29:29.587702+0000","last_fullsized":"2023-09-29T23:29:29.587702+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:29.587583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:29.587583+0000","last_clean_scrub_stamp":"2023-09-29T23:29:29.587583+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:37:44.018376+0000","scrub_duration":0.001426788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:52.216025+0000","last_change":"2023-09-29T23:29:52.216000+0000","last_active":"2023-09-29T23:29:52.216025+0000","last_peered":"2023-09-29T23:29:52.216025+0000","last_clean":"2023-09-29T23:29:52.216025+0000","last_became_active":"2023-09-29T23:23:41.049786+0000","last_became_peered":"2023-09-29T23:23:41.049786+0000","last_unstale":"2023-09-29T23:29:52.216025+0000","last_undegraded":"2023-09-29T23:29:52.216025+0000","last_fullsized":"2023-09-29T23:29:52.216025+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:52.215917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:52.215917+0000","last_clean_scrub_stamp":"2023-09-29T23:29:52.215917+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:18:42.482853+0000","scrub_duration":0.001382861,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:47.017087+0000","last_change":"2023-09-29T23:29:47.017056+0000","last_active":"2023-09-29T23:29:47.017087+0000","last_peered":"2023-09-29T23:29:47.017087+0000","last_clean":"2023-09-29T23:29:47.017087+0000","last_became_active":"2023-09-29T23:23:45.091162+0000","last_became_peered":"2023-09-29T23:23:45.091162+0000","last_unstale":"2023-09-29T23:29:47.017087+0000","last_undegraded":"2023-09-29T23:29:47.017087+0000","last_fullsized":"2023-09-29T23:29:47.017087+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:47.016976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:47.016976+0000","last_clean_scrub_stamp":"2023-09-29T23:29:47.016976+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:58:23.023172+0000","scrub_duration":0.0015069770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:35.597361+0000","last_change":"2023-09-29T23:29:35.597332+0000","last_active":"2023-09-29T23:29:35.597361+0000","last_peered":"2023-09-29T23:29:35.597361+0000","last_clean":"2023-09-29T23:29:35.597361+0000","last_became_active":"2023-09-29T23:23:45.473861+0000","last_became_peered":"2023-09-29T23:23:45.473861+0000","last_unstale":"2023-09-29T23:29:35.597361+0000","last_undegraded":"2023-09-29T23:29:35.597361+0000","last_fullsized":"2023-09-29T23:29:35.597361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:35.597256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:35.597256+0000","last_clean_scrub_stamp":"2023-09-29T23:29:35.597256+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:19:28.249320+0000","scrub_duration":0.001352902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:04.499106+0000","last_change":"2023-09-29T23:30:04.499084+0000","last_active":"2023-09-29T23:30:04.499106+0000","last_peered":"2023-09-29T23:30:04.499106+0000","last_clean":"2023-09-29T23:30:04.499106+0000","last_became_active":"2023-09-29T23:23:41.049442+0000","last_became_peered":"2023-09-29T23:23:41.049442+0000","last_unstale":"2023-09-29T23:30:04.499106+0000","last_undegraded":"2023-09-29T23:30:04.499106+0000","last_fullsized":"2023-09-29T23:30:04.499106+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:04.499020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:04.499020+0000","last_clean_scrub_stamp":"2023-09-29T23:30:04.499020+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:44:35.237185+0000","scrub_duration":0.001192598,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:48.013392+0000","last_change":"2023-09-29T23:29:48.013344+0000","last_active":"2023-09-29T23:29:48.013392+0000","last_peered":"2023-09-29T23:29:48.013392+0000","last_clean":"2023-09-29T23:29:48.013392+0000","last_became_active":"2023-09-29T23:23:45.092042+0000","last_became_peered":"2023-09-29T23:23:45.092042+0000","last_unstale":"2023-09-29T23:29:48.013392+0000","last_undegraded":"2023-09-29T23:29:48.013392+0000","last_fullsized":"2023-09-29T23:29:48.013392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:48.013267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:48.013267+0000","last_clean_scrub_stamp":"2023-09-29T23:29:48.013267+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:28:35.339069+0000","scrub_duration":0.0013823450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:16.358044+0000","last_change":"2023-09-29T23:30:16.358001+0000","last_active":"2023-09-29T23:30:16.358044+0000","last_peered":"2023-09-29T23:30:16.358044+0000","last_clean":"2023-09-29T23:30:16.358044+0000","last_became_active":"2023-09-29T23:23:45.461228+0000","last_became_peered":"2023-09-29T23:23:45.461228+0000","last_unstale":"2023-09-29T23:30:16.358044+0000","last_undegraded":"2023-09-29T23:30:16.358044+0000","last_fullsized":"2023-09-29T23:30:16.358044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:16.357918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:16.357918+0000","last_clean_scrub_stamp":"2023-09-29T23:30:16.357918+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:48:53.604154+0000","scrub_duration":0.001175169,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:50.258815+0000","last_change":"2023-09-29T23:29:50.258790+0000","last_active":"2023-09-29T23:29:50.258815+0000","last_peered":"2023-09-29T23:29:50.258815+0000","last_clean":"2023-09-29T23:29:50.258815+0000","last_became_active":"2023-09-29T23:23:41.050731+0000","last_became_peered":"2023-09-29T23:23:41.050731+0000","last_unstale":"2023-09-29T23:29:50.258815+0000","last_undegraded":"2023-09-29T23:29:50.258815+0000","last_fullsized":"2023-09-29T23:29:50.258815+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:50.258719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:50.258719+0000","last_clean_scrub_stamp":"2023-09-29T23:29:50.258719+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:55:51.955682+0000","scrub_duration":0.0012560539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:06.378016+0000","last_change":"2023-09-29T23:30:06.377990+0000","last_active":"2023-09-29T23:30:06.378016+0000","last_peered":"2023-09-29T23:30:06.378016+0000","last_clean":"2023-09-29T23:30:06.378016+0000","last_became_active":"2023-09-29T23:23:45.088510+0000","last_became_peered":"2023-09-29T23:23:45.088510+0000","last_unstale":"2023-09-29T23:30:06.378016+0000","last_undegraded":"2023-09-29T23:30:06.378016+0000","last_fullsized":"2023-09-29T23:30:06.378016+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:06.377904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:06.377904+0000","last_clean_scrub_stamp":"2023-09-29T23:30:06.377904+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:11:17.804105+0000","scrub_duration":0.0014090369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:02.256509+0000","last_change":"2023-09-29T23:29:02.256478+0000","last_active":"2023-09-29T23:29:02.256509+0000","last_peered":"2023-09-29T23:29:02.256509+0000","last_clean":"2023-09-29T23:29:02.256509+0000","last_became_active":"2023-09-29T23:23:45.461672+0000","last_became_peered":"2023-09-29T23:23:45.461672+0000","last_unstale":"2023-09-29T23:29:02.256509+0000","last_undegraded":"2023-09-29T23:29:02.256509+0000","last_fullsized":"2023-09-29T23:29:02.256509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:02.256385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:02.256385+0000","last_clean_scrub_stamp":"2023-09-29T23:29:02.256385+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:07:21.355472+0000","scrub_duration":0.0012288970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:40.998542+0000","last_change":"2023-09-29T23:29:40.998515+0000","last_active":"2023-09-29T23:29:40.998542+0000","last_peered":"2023-09-29T23:29:40.998542+0000","last_clean":"2023-09-29T23:29:40.998542+0000","last_became_active":"2023-09-29T23:23:41.046803+0000","last_became_peered":"2023-09-29T23:23:41.046803+0000","last_unstale":"2023-09-29T23:29:40.998542+0000","last_undegraded":"2023-09-29T23:29:40.998542+0000","last_fullsized":"2023-09-29T23:29:40.998542+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:40.998440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:40.998440+0000","last_clean_scrub_stamp":"2023-09-29T23:29:40.998440+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:39:47.280530+0000","scrub_duration":0.0015252709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:08.596401+0000","last_change":"2023-09-29T23:30:08.596357+0000","last_active":"2023-09-29T23:30:08.596401+0000","last_peered":"2023-09-29T23:30:08.596401+0000","last_clean":"2023-09-29T23:30:08.596401+0000","last_became_active":"2023-09-29T23:23:45.072973+0000","last_became_peered":"2023-09-29T23:23:45.072973+0000","last_unstale":"2023-09-29T23:30:08.596401+0000","last_undegraded":"2023-09-29T23:30:08.596401+0000","last_fullsized":"2023-09-29T23:30:08.596401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:08.596275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:08.596275+0000","last_clean_scrub_stamp":"2023-09-29T23:30:08.596275+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:34:47.410206+0000","scrub_duration":0.001392052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:31.558487+0000","last_change":"2023-09-29T23:29:31.558456+0000","last_active":"2023-09-29T23:29:31.558487+0000","last_peered":"2023-09-29T23:29:31.558487+0000","last_clean":"2023-09-29T23:29:31.558487+0000","last_became_active":"2023-09-29T23:23:45.474318+0000","last_became_peered":"2023-09-29T23:23:45.474318+0000","last_unstale":"2023-09-29T23:29:31.558487+0000","last_undegraded":"2023-09-29T23:29:31.558487+0000","last_fullsized":"2023-09-29T23:29:31.558487+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:31.558347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:31.558347+0000","last_clean_scrub_stamp":"2023-09-29T23:29:31.558347+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:28:18.884148+0000","scrub_duration":0.0014565979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:55.181446+0000","last_change":"2023-09-29T23:29:55.181415+0000","last_active":"2023-09-29T23:29:55.181446+0000","last_peered":"2023-09-29T23:29:55.181446+0000","last_clean":"2023-09-29T23:29:55.181446+0000","last_became_active":"2023-09-29T23:23:41.050639+0000","last_became_peered":"2023-09-29T23:23:41.050639+0000","last_unstale":"2023-09-29T23:29:55.181446+0000","last_undegraded":"2023-09-29T23:29:55.181446+0000","last_fullsized":"2023-09-29T23:29:55.181446+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:55.181345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:55.181345+0000","last_clean_scrub_stamp":"2023-09-29T23:29:55.181345+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:49:46.987614+0000","scrub_duration":0.0012601999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:08.359118+0000","last_change":"2023-09-29T23:30:08.359083+0000","last_active":"2023-09-29T23:30:08.359118+0000","last_peered":"2023-09-29T23:30:08.359118+0000","last_clean":"2023-09-29T23:30:08.359118+0000","last_became_active":"2023-09-29T23:23:45.076806+0000","last_became_peered":"2023-09-29T23:23:45.076806+0000","last_unstale":"2023-09-29T23:30:08.359118+0000","last_undegraded":"2023-09-29T23:30:08.359118+0000","last_fullsized":"2023-09-29T23:30:08.359118+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:08.358980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:08.358980+0000","last_clean_scrub_stamp":"2023-09-29T23:30:08.358980+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:57:06.355192+0000","scrub_duration":0.0013920250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:07.259573+0000","last_change":"2023-09-29T23:29:07.259539+0000","last_active":"2023-09-29T23:29:07.259573+0000","last_peered":"2023-09-29T23:29:07.259573+0000","last_clean":"2023-09-29T23:29:07.259573+0000","last_became_active":"2023-09-29T23:23:45.460913+0000","last_became_peered":"2023-09-29T23:23:45.460913+0000","last_unstale":"2023-09-29T23:29:07.259573+0000","last_undegraded":"2023-09-29T23:29:07.259573+0000","last_fullsized":"2023-09-29T23:29:07.259573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:07.259462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:07.259462+0000","last_clean_scrub_stamp":"2023-09-29T23:29:07.259462+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:35:33.384041+0000","scrub_duration":0.001325735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:05.367173+0000","last_change":"2023-09-29T23:30:05.367130+0000","last_active":"2023-09-29T23:30:05.367173+0000","last_peered":"2023-09-29T23:30:05.367173+0000","last_clean":"2023-09-29T23:30:05.367173+0000","last_became_active":"2023-09-29T23:23:41.049783+0000","last_became_peered":"2023-09-29T23:23:41.049783+0000","last_unstale":"2023-09-29T23:30:05.367173+0000","last_undegraded":"2023-09-29T23:30:05.367173+0000","last_fullsized":"2023-09-29T23:30:05.367173+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:05.367055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:05.367055+0000","last_clean_scrub_stamp":"2023-09-29T23:30:05.367055+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:44:36.105220+0000","scrub_duration":0.001402354,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:10.361725+0000","last_change":"2023-09-29T23:30:10.361697+0000","last_active":"2023-09-29T23:30:10.361725+0000","last_peered":"2023-09-29T23:30:10.361725+0000","last_clean":"2023-09-29T23:30:10.361725+0000","last_became_active":"2023-09-29T23:23:45.075273+0000","last_became_peered":"2023-09-29T23:23:45.075273+0000","last_unstale":"2023-09-29T23:30:10.361725+0000","last_undegraded":"2023-09-29T23:30:10.361725+0000","last_fullsized":"2023-09-29T23:30:10.361725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:10.361623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:10.361623+0000","last_clean_scrub_stamp":"2023-09-29T23:30:10.361623+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:45:41.862419+0000","scrub_duration":0.001344767,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:56.134483+0000","last_change":"2023-09-29T23:29:56.134457+0000","last_active":"2023-09-29T23:29:56.134483+0000","last_peered":"2023-09-29T23:29:56.134483+0000","last_clean":"2023-09-29T23:29:56.134483+0000","last_became_active":"2023-09-29T23:23:45.458250+0000","last_became_peered":"2023-09-29T23:23:45.458250+0000","last_unstale":"2023-09-29T23:29:56.134483+0000","last_undegraded":"2023-09-29T23:29:56.134483+0000","last_fullsized":"2023-09-29T23:29:56.134483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:56.134376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:56.134376+0000","last_clean_scrub_stamp":"2023-09-29T23:29:56.134376+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-30T23:37:36.784301+0000","scrub_duration":0.0013877640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"19'3","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:01.470635+0000","last_change":"2023-09-29T23:30:01.470603+0000","last_active":"2023-09-29T23:30:01.470635+0000","last_peered":"2023-09-29T23:30:01.470635+0000","last_clean":"2023-09-29T23:30:01.470635+0000","last_became_active":"2023-09-29T23:23:45.076638+0000","last_became_peered":"2023-09-29T23:23:45.076638+0000","last_unstale":"2023-09-29T23:30:01.470635+0000","last_undegraded":"2023-09-29T23:30:01.470635+0000","last_fullsized":"2023-09-29T23:30:01.470635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2023-09-29T23:30:01.470532+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2023-09-29T23:30:01.470532+0000","last_clean_scrub_stamp":"2023-09-29T23:30:01.470532+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:12:16.958202+0000","scrub_duration":0.002617299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:31.872101+0000","last_change":"2023-09-29T23:29:31.872071+0000","last_active":"2023-09-29T23:29:31.872101+0000","last_peered":"2023-09-29T23:29:31.872101+0000","last_clean":"2023-09-29T23:29:31.872101+0000","last_became_active":"2023-09-29T23:23:45.471013+0000","last_became_peered":"2023-09-29T23:23:45.471013+0000","last_unstale":"2023-09-29T23:29:31.872101+0000","last_undegraded":"2023-09-29T23:29:31.872101+0000","last_fullsized":"2023-09-29T23:29:31.872101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:31.871991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:31.871991+0000","last_clean_scrub_stamp":"2023-09-29T23:29:31.871991+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:32:09.372334+0000","scrub_duration":0.0012566319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"19'3","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:17.257604+0000","last_change":"2023-09-29T23:30:17.257555+0000","last_active":"2023-09-29T23:30:17.257604+0000","last_peered":"2023-09-29T23:30:17.257604+0000","last_clean":"2023-09-29T23:30:17.257604+0000","last_became_active":"2023-09-29T23:24:37.292123+0000","last_became_peered":"2023-09-29T23:24:37.292123+0000","last_unstale":"2023-09-29T23:30:17.257604+0000","last_undegraded":"2023-09-29T23:30:17.257604+0000","last_fullsized":"2023-09-29T23:30:17.257604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2023-09-29T23:30:17.257479+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2023-09-29T23:30:17.257479+0000","last_clean_scrub_stamp":"2023-09-29T23:30:17.257479+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:44:47.995644+0000","scrub_duration":0.0023675160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:15.390901+0000","last_change":"2023-09-29T23:30:15.390875+0000","last_active":"2023-09-29T23:30:15.390901+0000","last_peered":"2023-09-29T23:30:15.390901+0000","last_clean":"2023-09-29T23:30:15.390901+0000","last_became_active":"2023-09-29T23:23:45.471673+0000","last_became_peered":"2023-09-29T23:23:45.471673+0000","last_unstale":"2023-09-29T23:30:15.390901+0000","last_undegraded":"2023-09-29T23:30:15.390901+0000","last_fullsized":"2023-09-29T23:30:15.390901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:15.390806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:15.390806+0000","last_clean_scrub_stamp":"2023-09-29T23:30:15.390806+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T01:09:43.482879+0000","scrub_duration":0.0012633570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:54.125173+0000","last_change":"2023-09-29T23:29:54.125148+0000","last_active":"2023-09-29T23:29:54.125173+0000","last_peered":"2023-09-29T23:29:54.125173+0000","last_clean":"2023-09-29T23:29:54.125173+0000","last_became_active":"2023-09-29T23:23:45.092203+0000","last_became_peered":"2023-09-29T23:23:45.092203+0000","last_unstale":"2023-09-29T23:29:54.125173+0000","last_undegraded":"2023-09-29T23:29:54.125173+0000","last_fullsized":"2023-09-29T23:29:54.125173+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'1","last_scrub_stamp":"2023-09-29T23:29:54.125069+0000","last_deep_scrub":"16'1","last_deep_scrub_stamp":"2023-09-29T23:29:54.125069+0000","last_clean_scrub_stamp":"2023-09-29T23:29:54.125069+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:41:19.507992+0000","scrub_duration":0.0014059070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:57.528090+0000","last_change":"2023-09-29T23:29:57.528059+0000","last_active":"2023-09-29T23:29:57.528090+0000","last_peered":"2023-09-29T23:29:57.528090+0000","last_clean":"2023-09-29T23:29:57.528090+0000","last_became_active":"2023-09-29T23:23:45.464202+0000","last_became_peered":"2023-09-29T23:23:45.464202+0000","last_unstale":"2023-09-29T23:29:57.528090+0000","last_undegraded":"2023-09-29T23:29:57.528090+0000","last_fullsized":"2023-09-29T23:29:57.528090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:57.527982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:57.527982+0000","last_clean_scrub_stamp":"2023-09-29T23:29:57.527982+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:09:06.682144+0000","scrub_duration":0.0013085379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1f","version":"19'6","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:15.702253+0000","last_change":"2023-09-29T23:30:15.702222+0000","last_active":"2023-09-29T23:30:15.702253+0000","last_peered":"2023-09-29T23:30:15.702253+0000","last_clean":"2023-09-29T23:30:15.702253+0000","last_became_active":"2023-09-29T23:23:45.073772+0000","last_became_peered":"2023-09-29T23:23:45.073772+0000","last_unstale":"2023-09-29T23:30:15.702253+0000","last_undegraded":"2023-09-29T23:30:15.702253+0000","last_fullsized":"2023-09-29T23:30:15.702253+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'6","last_scrub_stamp":"2023-09-29T23:30:15.702153+0000","last_deep_scrub":"19'6","last_deep_scrub_stamp":"2023-09-29T23:30:15.702153+0000","last_clean_scrub_stamp":"2023-09-29T23:30:15.702153+0000","objects_scrubbed":2,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:48:52.948388+0000","scrub_duration":0.0032293310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:14.852011+0000","last_change":"2023-09-29T23:29:14.851983+0000","last_active":"2023-09-29T23:29:14.852011+0000","last_peered":"2023-09-29T23:29:14.852011+0000","last_clean":"2023-09-29T23:29:14.852011+0000","last_became_active":"2023-09-29T23:23:45.460548+0000","last_became_peered":"2023-09-29T23:23:45.460548+0000","last_unstale":"2023-09-29T23:29:14.852011+0000","last_undegraded":"2023-09-29T23:29:14.852011+0000","last_fullsized":"2023-09-29T23:29:14.852011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:14.851891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:14.851891+0000","last_clean_scrub_stamp":"2023-09-29T23:29:14.851891+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:08:19.031301+0000","scrub_duration":0.0015205469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:19.888652+0000","last_change":"2023-09-29T23:29:19.888625+0000","last_active":"2023-09-29T23:29:19.888652+0000","last_peered":"2023-09-29T23:29:19.888652+0000","last_clean":"2023-09-29T23:29:19.888652+0000","last_became_active":"2023-09-29T23:23:45.471294+0000","last_became_peered":"2023-09-29T23:23:45.471294+0000","last_unstale":"2023-09-29T23:29:19.888652+0000","last_undegraded":"2023-09-29T23:29:19.888652+0000","last_fullsized":"2023-09-29T23:29:19.888652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:19.888553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:19.888553+0000","last_clean_scrub_stamp":"2023-09-29T23:29:19.888553+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:21:05.111883+0000","scrub_duration":0.0012268019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:16.870489+0000","last_change":"2023-09-29T23:29:16.870462+0000","last_active":"2023-09-29T23:29:16.870489+0000","last_peered":"2023-09-29T23:29:16.870489+0000","last_clean":"2023-09-29T23:29:16.870489+0000","last_became_active":"2023-09-29T23:23:45.461188+0000","last_became_peered":"2023-09-29T23:23:45.461188+0000","last_unstale":"2023-09-29T23:29:16.870489+0000","last_undegraded":"2023-09-29T23:29:16.870489+0000","last_fullsized":"2023-09-29T23:29:16.870489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:16.870393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:16.870393+0000","last_clean_scrub_stamp":"2023-09-29T23:29:16.870393+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:08:57.437070+0000","scrub_duration":0.00131145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:21.651991+0000","last_change":"2023-09-29T23:30:21.651954+0000","last_active":"2023-09-29T23:30:21.651991+0000","last_peered":"2023-09-29T23:30:21.651991+0000","last_clean":"2023-09-29T23:30:21.651991+0000","last_became_active":"2023-09-29T23:23:45.473438+0000","last_became_peered":"2023-09-29T23:23:45.473438+0000","last_unstale":"2023-09-29T23:30:21.651991+0000","last_undegraded":"2023-09-29T23:30:21.651991+0000","last_fullsized":"2023-09-29T23:30:21.651991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:21.651881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:21.651881+0000","last_clean_scrub_stamp":"2023-09-29T23:30:21.651881+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:04:30.362417+0000","scrub_duration":0.001315739,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:21.580746+0000","last_change":"2023-09-29T23:29:21.580719+0000","last_active":"2023-09-29T23:29:21.580746+0000","last_peered":"2023-09-29T23:29:21.580746+0000","last_clean":"2023-09-29T23:29:21.580746+0000","last_became_active":"2023-09-29T23:23:45.474163+0000","last_became_peered":"2023-09-29T23:23:45.474163+0000","last_unstale":"2023-09-29T23:29:21.580746+0000","last_undegraded":"2023-09-29T23:29:21.580746+0000","last_fullsized":"2023-09-29T23:29:21.580746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:21.580646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:21.580646+0000","last_clean_scrub_stamp":"2023-09-29T23:29:21.580646+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:43:26.283595+0000","scrub_duration":0.001312361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:29:16.435331+0000","last_change":"2023-09-29T23:29:16.435290+0000","last_active":"2023-09-29T23:29:16.435331+0000","last_peered":"2023-09-29T23:29:16.435331+0000","last_clean":"2023-09-29T23:29:16.435331+0000","last_became_active":"2023-09-29T23:23:45.473063+0000","last_became_peered":"2023-09-29T23:23:45.473063+0000","last_unstale":"2023-09-29T23:29:16.435331+0000","last_undegraded":"2023-09-29T23:29:16.435331+0000","last_fullsized":"2023-09-29T23:29:16.435331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:29:16.435179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:29:16.435179+0000","last_clean_scrub_stamp":"2023-09-29T23:29:16.435179+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:31:53.935521+0000","scrub_duration":0.001480377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-29T23:30:13.403881+0000","last_change":"2023-09-29T23:30:13.403854+0000","last_active":"2023-09-29T23:30:13.403881+0000","last_peered":"2023-09-29T23:30:13.403881+0000","last_clean":"2023-09-29T23:30:13.403881+0000","last_became_active":"2023-09-29T23:23:45.463269+0000","last_became_peered":"2023-09-29T23:23:45.463269+0000","last_unstale":"2023-09-29T23:30:13.403881+0000","last_undegraded":"2023-09-29T23:30:13.403881+0000","last_fullsized":"2023-09-29T23:30:13.403881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-29T23:30:13.403784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-29T23:30:13.403784+0000","last_clean_scrub_stamp":"2023-09-29T23:30:13.403784+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:32:21.948314+0000","scrub_duration":0.001227697,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705752,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5700,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":104851900,"statfs":{"total":107374182400,"available":107368345600,"internally_reserved":0,"allocated":192512,"data_stored":54287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 29 23:29:54 2023","interfaces":[{"interface":"back","average":{"1min":0.27900000000000003,"5min":0.28599999999999998,"15min":0.27600000000000002},"min":{"1min":0.22800000000000001,"5min":0.14499999999999999,"15min":0.14499999999999999},"max":{"1min":0.377,"5min":0.435,"15min":0.435},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.27600000000000002},"min":{"1min":0.22900000000000001,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.40300000000000002,"5min":0.437,"15min":0.437},"last":0.25900000000000001}]},{"osd":2,"last update":"Fri Sep 29 23:29:54 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.30099999999999999,"15min":0.27900000000000003},"min":{"1min":0.214,"5min":0.20699999999999999,"15min":0.186},"max":{"1min":0.42499999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.318,"5min":0.316,"15min":0.29599999999999999},"min":{"1min":0.26900000000000002,"5min":0.191,"15min":0.191},"max":{"1min":0.437,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.33500000000000002}]}]},{"osd":2,"up_from":8,"seq":34359738455,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5564,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":104852036,"statfs":{"total":107374182400,"available":107368484864,"internally_reserved":0,"allocated":184320,"data_stored":53655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 29 23:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.28199999999999997,"15min":0.28799999999999998},"min":{"1min":0.21099999999999999,"5min":0.184,"15min":0.17699999999999999},"max":{"1min":0.40400000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.29299999999999998,"15min":0.29799999999999999},"min":{"1min":0.222,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.41899999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Sep 29 23:29:51 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.30199999999999999,"15min":0.30099999999999999},"min":{"1min":0.224,"5min":0.20399999999999999,"15min":0.189},"max":{"1min":0.44400000000000001,"5min":0.498,"15min":0.498},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.314,"15min":0.318},"min":{"1min":0.23799999999999999,"5min":0.21199999999999999,"15min":0.20499999999999999},"max":{"1min":0.45700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.307}]}]},{"osd":0,"up_from":9,"seq":38654705751,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":5688,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":104851912,"statfs":{"total":107374182400,"available":107368357888,"internally_reserved":0,"allocated":180224,"data_stored":52715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 29 23:29:48 2023","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.27800000000000002,"15min":0.28399999999999997},"min":{"1min":0.21099999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.254},{"interface":"front","average":{"1min":0.29499999999999998,"5min":0.28799999999999998,"15min":0.27200000000000002},"min":{"1min":0.23100000000000001,"5min":0.187,"15min":0.17799999999999999},"max":{"1min":0.41699999999999998,"5min":0.44,"15min":0.44},"last":0.29899999999999999}]},{"osd":2,"last update":"Fri Sep 29 23:29:48 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.29599999999999999,"15min":0.27200000000000002},"min":{"1min":0.24099999999999999,"5min":0.19900000000000001,"15min":0.191},"max":{"1min":0.42999999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.312,"5min":0.30399999999999999,"15min":0.28999999999999998},"min":{"1min":0.245,"5min":0.215,"15min":0.215},"max":{"1min":0.441,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.32200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-29T23:30:44.644 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-09-29T23:30:44.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.790+0000 7f893a727700 1 Processor -- start 2023-09-29T23:30:44.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.790+0000 7f893a727700 1 -- start start 2023-09-29T23:30:44.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.791+0000 7f893a727700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f893412fcb0 0x7f8934134620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:30:44.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.791+0000 7f893a727700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89340997f0 con 0x7f89340a3030 2023-09-29T23:30:44.791 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.791+0000 7f893a727700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89340a3400 con 0x7f893412fcb0 2023-09-29T23:30:44.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.791+0000 7f8933fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f89340a3030 0x7f893412f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:48030/0 (socket says 172.21.15.92:48030) 2023-09-29T23:30:44.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.791+0000 7f8933fff700 1 -- 172.21.15.92:0/4079746062 learned_addr learned my addr 172.21.15.92:0/4079746062 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-09-29T23:30:44.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.791+0000 7f89337fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f893412fcb0 0x7f8934134620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:30:44.794 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.791+0000 7f8932ffd700 1 -- 172.21.15.92:0/4079746062 <== mon.0 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2089769136 0 0) 0x7f89340997f0 con 0x7f89340a3030 2023-09-29T23:30:44.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.791+0000 7f8932ffd700 1 -- 172.21.15.92:0/4079746062 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f891c003570 con 0x7f89340a3030 2023-09-29T23:30:44.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.791+0000 7f89337fe700 1 -- 172.21.15.92:0/4079746062 >> v1:172.21.15.92:6789/0 conn(0x7f89340a3030 legacy=0x7f893412f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:30:44.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.791+0000 7f89337fe700 1 -- 172.21.15.92:0/4079746062 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89340977a0 con 0x7f893412fcb0 2023-09-29T23:30:44.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.791+0000 7f89337fe700 1 --2- 172.21.15.92:0/4079746062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f893412fcb0 0x7f8934134620 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8928009860 tx=0x7f89280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91082d1d1b9bfaa server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:30:44.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.792+0000 7f8932ffd700 1 -- 172.21.15.92:0/4079746062 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f892800b690 con 0x7f893412fcb0 2023-09-29T23:30:44.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.792+0000 7f8932ffd700 1 -- 172.21.15.92:0/4079746062 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892800b7f0 con 0x7f893412fcb0 2023-09-29T23:30:44.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.792+0000 7f8932ffd700 1 -- 172.21.15.92:0/4079746062 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f892800b980 con 0x7f893412fcb0 2023-09-29T23:30:44.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.792+0000 7f893a727700 1 -- 172.21.15.92:0/4079746062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f893412fcb0 msgr2=0x7f8934134620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:30:44.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.792+0000 7f893a727700 1 --2- 172.21.15.92:0/4079746062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f893412fcb0 0x7f8934134620 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8928009860 tx=0x7f89280091a0 comp rx=0 tx=0).stop 2023-09-29T23:30:44.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.792+0000 7f893a727700 1 -- 172.21.15.92:0/4079746062 shutdown_connections 2023-09-29T23:30:44.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.792+0000 7f893a727700 1 --2- 172.21.15.92:0/4079746062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f893412fcb0 0x7f8934134620 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:30:44.795 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.792+0000 7f893a727700 1 -- 172.21.15.92:0/4079746062 >> 172.21.15.92:0/4079746062 conn(0x7f8934067fc0 msgr2=0x7f89340a2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:30:44.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.792+0000 7f893a727700 1 -- 172.21.15.92:0/4079746062 shutdown_connections 2023-09-29T23:30:44.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.792+0000 7f893a727700 1 -- 172.21.15.92:0/4079746062 wait complete. 2023-09-29T23:30:44.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.793+0000 7f893a727700 1 Processor -- start 2023-09-29T23:30:44.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.793+0000 7f893a727700 1 -- start start 2023-09-29T23:30:44.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.793+0000 7f893a727700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89340a3030 0x7f893412c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:30:44.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.793+0000 7f893a727700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893411e710 con 0x7f89340a3030 2023-09-29T23:30:44.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.793+0000 7f8933fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89340a3030 0x7f893412c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:30:44.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.794+0000 7f8933fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89340a3030 0x7f893412c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34772/0 (socket says 172.21.15.92:34772) 2023-09-29T23:30:44.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.794+0000 7f8933fff700 1 -- 172.21.15.92:0/3498265297 learned_addr learned my addr 172.21.15.92:0/3498265297 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-09-29T23:30:44.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.794+0000 7f8933fff700 1 -- 172.21.15.92:0/3498265297 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8928009420 con 0x7f89340a3030 2023-09-29T23:30:44.796 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.794+0000 7f8933fff700 1 --2- 172.21.15.92:0/3498265297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89340a3030 0x7f893412c150 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f892400c6c0 tx=0x7f8924007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:30:44.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.794+0000 7f891bfff700 1 -- 172.21.15.92:0/3498265297 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8924005b30 con 0x7f89340a3030 2023-09-29T23:30:44.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.794+0000 7f891bfff700 1 -- 172.21.15.92:0/3498265297 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8924005c90 con 0x7f89340a3030 2023-09-29T23:30:44.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.794+0000 7f893a727700 1 -- 172.21.15.92:0/3498265297 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893411ec50 con 0x7f89340a3030 2023-09-29T23:30:44.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.794+0000 7f891bfff700 1 -- 172.21.15.92:0/3498265297 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89240070d0 con 0x7f89340a3030 2023-09-29T23:30:44.797 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.794+0000 7f893a727700 1 -- 172.21.15.92:0/3498265297 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893411e940 con 0x7f89340a3030 2023-09-29T23:30:44.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.795+0000 7f891bfff700 1 -- 172.21.15.92:0/3498265297 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 42485+0+0 (secure 0 0 0) 0x7f8924007230 con 0x7f89340a3030 2023-09-29T23:30:44.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.795+0000 7f893a727700 1 -- 172.21.15.92:0/3498265297 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893411b490 con 0x7f89340a3030 2023-09-29T23:30:44.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.795+0000 7f891bfff700 1 --2- 172.21.15.92:0/3498265297 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8920035640 0x7f8920037af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-29T23:30:44.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.795+0000 7f891bfff700 1 -- 172.21.15.92:0/3498265297 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3489+0+0 (secure 0 0 0) 0x7f8924046a40 con 0x7f89340a3030 2023-09-29T23:30:44.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.795+0000 7f89337fe700 1 --2- 172.21.15.92:0/3498265297 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8920035640 0x7f8920037af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-29T23:30:44.798 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.795+0000 7f89337fe700 1 --2- 172.21.15.92:0/3498265297 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8920035640 0x7f8920037af0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f89280091e0 tx=0x7f8928016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-29T23:30:44.799 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.799+0000 7f891bfff700 1 -- 172.21.15.92:0/3498265297 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8924048e60 con 0x7f89340a3030 2023-09-29T23:30:44.981 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.981+0000 7f893a727700 1 -- 172.21.15.92:0/3498265297 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f8934096410 con 0x7f89340a3030 2023-09-29T23:30:44.983 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.983+0000 7f891bfff700 1 -- 172.21.15.92:0/3498265297 <== mon.0 v2:172.21.15.92:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f892400eca0 con 0x7f89340a3030 2023-09-29T23:30:44.984 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.984+0000 7f891bfff700 1 -- 172.21.15.92:0/3498265297 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v3)=0 v3) v1 ==== 123+0+0 (secure 0 0 0) 0x7f8924017070 con 0x7f89340a3030 2023-09-29T23:30:44.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.987+0000 7f893a727700 1 -- 172.21.15.92:0/3498265297 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8920035640 msgr2=0x7f8920037af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:30:44.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.987+0000 7f893a727700 1 --2- 172.21.15.92:0/3498265297 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8920035640 0x7f8920037af0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f89280091e0 tx=0x7f8928016000 comp rx=0 tx=0).stop 2023-09-29T23:30:44.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.987+0000 7f893a727700 1 -- 172.21.15.92:0/3498265297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89340a3030 msgr2=0x7f893412c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-29T23:30:44.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.987+0000 7f893a727700 1 --2- 172.21.15.92:0/3498265297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89340a3030 0x7f893412c150 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f892400c6c0 tx=0x7f8924007e00 comp rx=0 tx=0).stop 2023-09-29T23:30:44.987 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.987+0000 7f893a727700 1 -- 172.21.15.92:0/3498265297 shutdown_connections 2023-09-29T23:30:44.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.987+0000 7f893a727700 1 --2- 172.21.15.92:0/3498265297 >> [v2:172.21.15.92:6824/85403,v1:172.21.15.92:6825/85403] conn(0x7f8920035640 0x7f8920037af0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:30:44.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.987+0000 7f893a727700 1 --2- 172.21.15.92:0/3498265297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89340a3030 0x7f893412c150 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-29T23:30:44.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.987+0000 7f893a727700 1 -- 172.21.15.92:0/3498265297 >> 172.21.15.92:0/3498265297 conn(0x7f8934067fc0 msgr2=0x7f893412d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-29T23:30:44.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.987+0000 7f893a727700 1 -- 172.21.15.92:0/3498265297 shutdown_connections 2023-09-29T23:30:44.988 INFO:teuthology.orchestra.run.smithi092.stderr:2023-09-29T23:30:44.987+0000 7f893a727700 1 -- 172.21.15.92:0/3498265297 wait complete. 2023-09-29T23:30:44.999 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph.py", line 1895, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph.py", line 1472, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph_manager.py", line 3189, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2023-09-29T23:30:45.000 INFO:teuthology.misc:Shutting down mds daemons... 2023-09-29T23:30:45.000 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-29T23:30:45.000 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:30:45.009 INFO:tasks.ceph.mds.a:Stopped 2023-09-29T23:30:45.009 INFO:teuthology.misc:Shutting down osd daemons... 2023-09-29T23:30:45.009 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-29T23:30:45.009 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:30:45.074 INFO:tasks.ceph.osd.0:Stopped 2023-09-29T23:30:45.074 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-29T23:30:45.074 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:30:45.142 INFO:tasks.ceph.osd.1:Stopped 2023-09-29T23:30:45.142 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-29T23:30:45.142 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:30:45.208 INFO:tasks.ceph.osd.2:Stopped 2023-09-29T23:30:45.208 INFO:teuthology.misc:Shutting down mgr daemons... 2023-09-29T23:30:45.208 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-29T23:30:45.208 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:30:45.271 INFO:tasks.ceph.mgr.x:Stopped 2023-09-29T23:30:45.272 INFO:teuthology.misc:Shutting down mon daemons... 2023-09-29T23:30:45.272 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-29T23:30:45.272 INFO:teuthology.orchestra.run:waiting for 300 2023-09-29T23:30:45.322 INFO:tasks.ceph.mon.a:Stopped 2023-09-29T23:30:45.322 INFO:tasks.ceph:Checking cluster log for badness... 2023-09-29T23:30:45.323 DEBUG:teuthology.orchestra.run.smithi092:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2023-09-29T23:30:45.387 INFO:teuthology.orchestra.run.smithi092.stdout:1696029816.0563352 mgr.x (mgr.4101) 1 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: 'PgAutoscaler' object has no attribute 'noautoscale' 2023-09-29T23:30:45.388 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-09-29T23:30:45.388 DEBUG:teuthology.orchestra.run.smithi092:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2023-09-29T23:30:45.453 DEBUG:teuthology.orchestra.run.smithi092:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2023-09-29T23:30:45.519 INFO:teuthology.orchestra.run.smithi092.stdout:1696029816.0563352 mgr.x (mgr.4101) 1 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: 'PgAutoscaler' object has no attribute 'noautoscale' 2023-09-29T23:30:45.519 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi092.front.sepia.ceph.com 2023-09-29T23:30:45.520 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-09-29T23:30:45.806 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi092.front.sepia.ceph.com 2023-09-29T23:30:45.807 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-09-29T23:30:45.912 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi092.front.sepia.ceph.com 2023-09-29T23:30:45.912 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-09-29T23:30:45.975 INFO:tasks.ceph:Archiving mon data... 2023-09-29T23:30:45.976 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406546/data/mon.a.tgz 2023-09-29T23:30:45.976 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2023-09-29T23:30:45.990 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.OScb99gqlg 2023-09-29T23:30:45.991 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.OScb99gqlg 2023-09-29T23:30:46.106 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.OScb99gqlg 2023-09-29T23:30:46.187 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.OScb99gqlg is 213KB 2023-09-29T23:30:46.251 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.OScb99gqlg 2023-09-29T23:30:46.265 INFO:tasks.ceph:Cleaning ceph cluster... 2023-09-29T23:30:46.265 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-29T23:30:46.329 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-09-29T23:30:46.329 DEBUG:teuthology.orchestra.run.smithi092:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-29T23:30:46.393 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-29T23:30:46.399 INFO:tasks.ceph:Archiving crash dumps... 2023-09-29T23:30:46.400 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406546/remote/smithi092/crash 2023-09-29T23:30:46.401 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-29T23:30:46.465 INFO:tasks.ceph:Compressing logs... 2023-09-29T23:30:46.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-29T23:30:47.646 INFO:tasks.ceph:Archiving logs... 2023-09-29T23:30:47.647 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406546/remote/smithi092/log 2023-09-29T23:30:47.648 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-29T23:30:47.937 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph.py", line 1895, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph.py", line 1472, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph_manager.py", line 3189, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2023-09-29T23:30:48.000 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=37b99eaa54594e3cb9a3c3949bbc0b41 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph.py", line 1895, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph.py", line 1472, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph_manager.py", line 3189, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2023-09-29T23:30:48.003 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-09-29T23:30:48.021 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-29T23:30:48.061 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-29T23:30:48.061 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-29T23:30:48.115 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-29T23:30:48.123 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-29T23:30:48.123 DEBUG:teuthology.orchestra.run.smithi092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-29T23:30:48.143 INFO:teuthology.orchestra.run.smithi092.stderr:bash: ntpq: command not found 2023-09-29T23:30:48.147 INFO:teuthology.orchestra.run.smithi092.stdout:210 Number of sources = 4 2023-09-29T23:30:48.147 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-29T23:30:48.147 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2023-09-29T23:30:48.147 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 14 -323us[ -298us] +/- 96ms 2023-09-29T23:30:48.147 INFO:teuthology.orchestra.run.smithi092.stdout:^* hv02.front.sepia.ceph.com 3 6 377 9 -525us[ -499us] +/- 60ms 2023-09-29T23:30:48.148 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +899us[ +924us] +/- 73ms 2023-09-29T23:30:48.148 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-29T23:30:48.148 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-29T23:30:48.157 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-29T23:30:48.157 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-29T23:30:48.165 DEBUG:teuthology.orchestra.run.smithi092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-29T23:30:48.278 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-29T23:30:48.306 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-29T23:30:48.307 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-29T23:30:48.316 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-29T23:30:48.333 INFO:teuthology.task.internal:Duration was 1230.856563 seconds 2023-09-29T23:30:48.333 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-29T23:30:48.342 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-29T23:30:48.342 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-29T23:30:48.390 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-29T23:30:48.869 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-29T23:30:48.869 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi092.front.sepia.ceph.com 2023-09-29T23:30:48.870 DEBUG:teuthology.orchestra.run.smithi092:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-29T23:30:48.928 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-29T23:30:48.928 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-29T23:30:49.006 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-29T23:30:49.006 DEBUG:teuthology.orchestra.run.smithi092:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-29T23:30:49.119 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-29T23:30:49.130 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-29T23:30:49.131 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-29T23:30:49.155 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-29T23:30:49.167 DEBUG:teuthology.orchestra.run.smithi092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-29T23:30:49.220 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = core 2023-09-29T23:30:49.233 DEBUG:teuthology.orchestra.run.smithi092:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-29T23:30:49.286 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-29T23:30:49.287 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-29T23:30:49.298 INFO:teuthology.task.internal:Transferring archived files... 2023-09-29T23:30:49.299 DEBUG:teuthology.misc:Transferring archived files from smithi092:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406546/remote/smithi092 2023-09-29T23:30:49.299 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-29T23:30:49.363 INFO:teuthology.task.internal:Removing archive directory... 2023-09-29T23:30:49.363 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-29T23:30:49.412 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-29T23:30:49.423 INFO:teuthology.task.internal:Not uploading archives. 2023-09-29T23:30:49.424 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-29T23:30:49.434 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-29T23:30:49.434 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-29T23:30:49.466 INFO:teuthology.orchestra.run.smithi092.stdout: 263007 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 29 23:30 /home/ubuntu/cephtest 2023-09-29T23:30:49.467 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-29T23:30:49.477 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-29T23:30:49.496 INFO:teuthology.nuke:Checking targets against current locks 2023-09-29T23:30:49.523 DEBUG:teuthology.nuke:shortname: smithi092 2023-09-29T23:30:49.524 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-29T23:30:49.548 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406546', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 23:03:18.197746', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMhfltsGKpUmCXl1oABVs8wfFdkdTW1lrepqc4TEsJ0l5wV1QeJJcASKfZIDDGp5/pPXF1kFdXK18YfJGJ0MCzk='} 2023-09-29T23:30:49.597 INFO:teuthology.orchestra.console.smithi092:Power off 2023-09-29T23:30:49.598 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-29T23:30:49.622 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-09-29T23:30:49.622 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:30:49.647 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-09-29T23:30:53.648 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:30:53.759 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-09-29T23:30:57.762 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:30:57.871 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-09-29T23:30:57.972 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-09-29T23:30:58.076 INFO:teuthology.run:Summary data: description: rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} duration: 1230.8565633296967 failure_reason: '"1696029816.0563352 mgr.x (mgr.4101) 1 : cluster [ERR] Unhandled exception from module ''pg_autoscaler'' while running on mgr.x: ''PgAutoscaler'' object has no attribute ''noautoscale''" in cluster log' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=37b99eaa54594e3cb9a3c3949bbc0b41 status: fail success: false 2023-09-29T23:30:58.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T23:30:58.155 INFO:teuthology.run:FAIL